-- Logs begin at Tue 2022-08-02 08:06:50 UTC, end at Tue 2022-08-02 09:20:20 UTC. -- Aug 02 08:38:53.305265 dv-cinder-787296-14-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 02 08:38:53.314439 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 02 08:38:53.316413 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 08:38:53 2022] *** Aug 02 08:38:53.316413 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 08:38:53.316413 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 08:38:53.316413 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: nodename: dv-cinder-787296-14-iscsi Aug 02 08:38:53.316413 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: machine: x86_64 Aug 02 08:38:53.316413 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: clock source: unix Aug 02 08:38:53.316413 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: pcre jit disabled Aug 02 08:38:53.316413 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: detected number of CPU cores: 4 Aug 02 08:38:53.316413 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: current working directory: / Aug 02 08:38:53.316413 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: detected binary path: /usr/bin/uwsgi-core Aug 02 08:38:53.316413 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: your processes number limit is 47680 Aug 02 08:38:53.317033 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: your memory page size is 4096 bytes Aug 02 08:38:53.317033 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: detected max file descriptor number: 2048 Aug 02 08:38:53.317033 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: lock engine: pthread robust mutexes Aug 02 08:38:53.317033 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: thunder lock: enabled Aug 02 08:38:53.317033 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 02 08:38:53.317033 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 08:38:53.355945 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: Python main interpreter initialized at 0x56245fef29c0 Aug 02 08:38:53.355945 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: python threads support enabled Aug 02 08:38:53.355945 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: your server socket listen backlog is limited to 100 connections Aug 02 08:38:53.355945 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: your mercy for graceful operations on workers is 90 seconds Aug 02 08:38:53.356302 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 08:38:53.356400 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: *** Operational MODE: preforking *** Aug 02 08:38:53.356678 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: *** uWSGI is running in multiple interpreter mode *** Aug 02 08:38:53.356678 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: spawned uWSGI master process (pid: 80199) Aug 02 08:38:53.356865 dv-cinder-787296-14-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 02 08:38:53.364156 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: spawned uWSGI worker 1 (pid: 80209, cores: 1) Aug 02 08:38:53.364156 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: spawned uWSGI worker 2 (pid: 80210, cores: 1) Aug 02 08:38:53.364156 dv-cinder-787296-14-iscsi devstack@keystone.service[80199]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 08:38:58.862903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:38:58.862903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: from cryptography.utils import int_from_bytes Aug 02 08:38:58.863677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:38:58.863677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: from cryptography.utils import int_from_bytes Aug 02 08:38:58.863950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:38:58.863950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: from cryptography.utils import int_from_bytes Aug 02 08:38:58.864428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:38:58.864428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: from cryptography.utils import int_from_bytes Aug 02 08:38:58.912775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 08:38:58.912973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 08:38:58.913156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] command line args: [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 08:38:58.913426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 08:38:58.913603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ================================================================================ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 08:38:58.913779 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 08:38:58.913861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] admin_token = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.913978 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 08:38:58.914084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] config_dir = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.914161 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] command line args: [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 08:38:58.914271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.914442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 08:38:58.914528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] config_source = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.914620 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] debug = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.914703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ================================================================================ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 08:38:58.914819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.915082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] admin_token = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.915760 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] config_dir = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.915826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.915885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.915947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.916099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] config_source = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.916253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.916408 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] debug = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.916521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.916626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.916768 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.916872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.916974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_config_append = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.917076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.917171 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.917278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.917390 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_dir = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.917390 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_file = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.917609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.917737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.917819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.917819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_config_append = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.918010 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.918082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.918151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.918270 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_dir = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.918347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.918424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_file = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.918547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.918668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.918749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.918826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.918947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.919029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.919152 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.919236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.919315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.919435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.919516 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.919588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.919711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.919792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.919868 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.919983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.920058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.920212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.920335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.920410 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.920586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.920681 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.920837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.921093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.921205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.921339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.921420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] publish_errors = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.921579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.921657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.921809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.921989 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.922109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.922234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.922313 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] publish_errors = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.922467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.922544 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.922699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] standard_threads = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.922793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.922900 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.922977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.923148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.923226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.923344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.923417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.923486 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] use_journal = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.923609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] standard_threads = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.923692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] use_json = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.923804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] use_stderr = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.923889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.923982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] use_syslog = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.924066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.924236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.924315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.924440 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] use_journal = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.924520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.924619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] use_json = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.924697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.924796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] use_stderr = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.924958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.925045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] use_syslog = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.925194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:38:58.925276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.925439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.925527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.925674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.925760 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.925919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.925997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.926153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.926237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.926397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.926483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.926634 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.926710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.926878 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.926960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.927110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.927197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.927355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.927433 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.927588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.927671 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.927833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.927922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.928068 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.928188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.928339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.928424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.928576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.928725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.928828 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.928907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.929069 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.929146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.929302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.929391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.929555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.929639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.929812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.929888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.930060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.930145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.930300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.930377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.930527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.930616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.930780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.930867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.931037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.931114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.931271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.931349 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.931517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.931603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.931765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.931843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.931994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.932072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.932245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.932332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.932492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.932576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.932738 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.932816 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.932972 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.933051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.933219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.933297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.933447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.933573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.933681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.933760 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.933914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.933991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.934142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.934226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.934370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.934450 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.934584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.934668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.934813 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.934890 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.935048 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.935127 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.935282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.935360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.935509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.935585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.935745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.935859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.935984 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.936058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.936260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.936341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.936497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.936566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.938289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.938460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.938642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.938772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.938860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.938934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.938999 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939112 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939112 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939410 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.939974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.940036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.940109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.940230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.940230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.940348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.940409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.940465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.940522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.940586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.940645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.940815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.940891 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.941055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.941133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.941305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.941381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.941552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.941621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.941788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.941979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.942174 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.942319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.942398 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.942521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.942604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.942677 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.942801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.942878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.942987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.943065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.943137 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.943287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.943378 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.943530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.943651 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.943770 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.943850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.944033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.944153 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.944288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.944358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.944550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.944644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.944784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.944969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.945047 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.945171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.945247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.945363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.945474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.945604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.945710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.945788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.945942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.946020 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.946177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.946328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.946432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.946511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.946662 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.946747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.946894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.947004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.947122 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.947206 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.947350 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.947419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.947589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.947657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.947828 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.947954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.948071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.948244 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.948353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.948491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.948631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.948777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.948859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.948921 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.949044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.949154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.949278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.949368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.external = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.949517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.949653 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.949738 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.949834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.950045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.950141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.950289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.password = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.950417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.950509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.token = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.950635 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.950725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.950905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.951057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.951199 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.951341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.951438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.951536 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.external = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.951669 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.951763 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.951888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.952009 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.952150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.952287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.952420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.952568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.password = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.952697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.952778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.token = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.952878 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.953038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.953177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.953320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.953409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.953540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.953677 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.953809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.953944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.954038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.954114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.954320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.954472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.954603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.954691 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.954763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.954951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.955096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.955225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.955314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.955446 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.955584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.955703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.955790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.956058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.956226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.956317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.956393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.956511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.956648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.956815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.956951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.957073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.957198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.957329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.957459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.957592 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.957701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.957866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.958006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.958141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.958274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.958364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.958532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.958685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.958828 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.959209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.959326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.959405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.959586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.959729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.959854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.959971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.960071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.960283 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.960423 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.960579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.960680 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.960840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.960947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.961067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.961251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.961392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.961611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.961746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.961889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.962482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.962568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.962746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.962886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.963017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.963148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.963272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.963400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.963492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.963683 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.963774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.963948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.964029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.964231 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.964376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.964504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.964611 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.964781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.964904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.965012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.965141 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.965251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.965360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.965477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.965566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.965703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.965801 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.965910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.966085 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.966170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.966405 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.966547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.969005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.969173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.969252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.969313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.969383 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.969443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.969539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.969715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.969836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.969946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.970060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.970161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.970247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.970322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.970393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.970453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.970509 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.970579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.970658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.970731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.971200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.971279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.971350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.971421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.971503 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.971577 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.971637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.971695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.971766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.971825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.971890 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.971890 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972074 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972155 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972356 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972681 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.972944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.973013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.973079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.973174 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.973250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.973309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.973366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.973423 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.973495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.973642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.973740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.973830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.973957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.974077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.974199 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.974325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.974454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.974573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.974710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.974808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.974947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.975027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.975182 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.975261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.975440 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.975527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.975694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.975774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.975922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.976000 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.976185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.976281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.976430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.976510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.976667 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.976745 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.976913 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.977046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.977496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.977578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.978300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.978300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.978825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.978917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.978992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.979064 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.979064 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.979181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.979239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.979304 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.979376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.979524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.979604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.979763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.979842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.980010 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.980091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.980284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.980364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.980524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.980604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.980777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.980857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.981005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.981083 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.981248 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.981327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.981486 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.981567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.981720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.981800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.981956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.982034 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.982193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.982273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.982433 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.982512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.982662 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.982812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.982899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.983069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.983148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.983329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.983407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.983573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.983660 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.983816 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.983894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.984060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.984190 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.984333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.984423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.984862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.984951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.984951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.985058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.985203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.985667 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.985757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.985830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.985901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.985901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.986018 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] role.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.986097 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.986266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] role.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.986346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.986499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.986577 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.986751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.986903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.987004 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.987085 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.987254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.987334 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.987504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.987594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.987744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.987822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.987989 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.988067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.988252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.988345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.988498 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.988577 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.988729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.988807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] role.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.988978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.989066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] role.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.989212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.989290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.989461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.989538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.989708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.989789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.989961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.990149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.990228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.990382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.990469 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.990631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.990711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.990879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.990957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.991128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.991216 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.991380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.991459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.991613 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.991693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.991865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.991952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.992134 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.992219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.992380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.992460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.992610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.992822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.992905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.993057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.993136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.993329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.993411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.993586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.993667 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.993832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.993912 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.994067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.994147 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.994299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.994380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.994527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.994606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.994761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.994848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.994996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.995070 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.995243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.995322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.995479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.995565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.995715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.995795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.995966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.996044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.996226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.996325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.996470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.996549 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.996712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.996791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.996949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.997035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.997181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.997259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.997415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.997494 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.997647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.997734 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.997892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.997972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.998130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.998209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.998357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.998443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.998597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.998676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.998857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.998935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.999104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.999191 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.999355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.999487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.999606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.999728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.999849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:58.999965 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.000090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.000260 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.000340 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.000456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.000590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.000691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.000843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.000931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.001078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.001158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.001323 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.001402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.001597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.001684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.001837 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.001924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.002071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.002161 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.002317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.002397 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.002551 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.002633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.002792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.002872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.003021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.003099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.003258 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.003338 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.003487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.003566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.003658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 08:38:59.003815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.003957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.004234 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.004484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.004722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.004976 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.005214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.005460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.005697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.005939 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.006176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:38:59.006350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 08:38:59.033234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.033460 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.033686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.035110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.035346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.035572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.042726 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.044646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.072490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.072672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.074361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.074598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.125302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.126222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.175948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.176197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.180974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.181214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.242151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.242371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.242594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.242694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.242799 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.242881 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.243015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.243120 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.243254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.243386 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.243570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.243838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.267755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.267999 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.268152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.268243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.268323 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.268438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.268524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.268657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.268744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.268872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.268956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.269086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.269168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.269343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.281418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.282007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.294225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.294452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.294677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.294899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.295030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.295161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.295289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.295426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.295555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.295682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.295821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.295821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.296068 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.296286 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:38:59.312613 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.312823 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 08:38:59.312915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.313102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 08:38:59.313383 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.313515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.313644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 08:38:59.313787 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 08:38:59.313919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.314051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.314190 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.314319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.314446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.314576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.314707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.314843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.324794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.324938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.325078 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.325210 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.325341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.325480 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.325611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.325739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.332586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.332800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.338142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.338414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.338690 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.338941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.339025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.339225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.339309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.339475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.339558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.339737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.339828 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.340004 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.340088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.340293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.340376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.340564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.340657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.340824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.340906 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.341095 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.341370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.341638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.364030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.365537 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.365816 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.366710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.368267 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.368553 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.370498 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.370777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.371056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.373204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.373486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.373768 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.377834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.378114 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.380413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.380701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.382228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.382514 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.382792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.383078 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.383351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.383624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.384442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.384719 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.385482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.385777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.386063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.386344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.386617 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.386899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.387183 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.387467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.401295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.401567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.404143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.404441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.405643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.408436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.408815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.409108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.411603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.411900 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.413487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.416884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.417275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.420138 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.420439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.420734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.421021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.421433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.421726 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.422015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.423391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.423695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.423984 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.424314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.424606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.424896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.438654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.438933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.439197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.439458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.441718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.442007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.442278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.442542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.446413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.447971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.448269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.449576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.451079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.451211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.451339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.451476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.451631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.451926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.452247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.454275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.454558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.454856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.455150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.455441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.464054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.464357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.464638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.464918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.465197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.465470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.465749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.467293 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.467578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.467861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.468163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.468445 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.468719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.468995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.481980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.485104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.485359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.488051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.488390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.490514 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.491354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.492028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.492332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.492612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.494476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.496051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.496415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.496699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.499746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.501379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.503360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.504323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.504614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.504897 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.505006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.505170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.507942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.508264 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.508567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.508863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.513240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.513526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.513805 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.517022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.517308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.517588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.520831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.521111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.521389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.521661 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.521945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.522230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.522502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.522766 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.523130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.523410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.523694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.523956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.524242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.525014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.525104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:38:59.525352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.525633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.525908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.526192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.526462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.526734 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.527012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.527427 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.527757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.528033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.528345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.528612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.528930 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:38:59.559719 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56245fef29c0 pid: 80209 (default app) Aug 02 08:38:59.563276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aae7a-a47b-4437-a24c-70abf4e01106 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:38:59.563688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aae7a-a47b-4437-a24c-70abf4e01106 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:38:59.563967 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aae7a-a47b-4437-a24c-70abf4e01106 None None] PATH_INFO: `/v3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:38:59.565500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56245fef29c0 pid: 80210 (default app) Aug 02 08:38:59.568355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Tue Aug 2 08:38:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:07.204148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30c7b-fe16-4894-9456-912b4a2c1557 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:07.204697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30c7b-fe16-4894-9456-912b4a2c1557 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:07.204697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30c7b-fe16-4894-9456-912b4a2c1557 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:07.209342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:07.215330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fca9e5-a1d5-41ca-98e7-081a2f6cdaeb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:07.215771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fca9e5-a1d5-41ca-98e7-081a2f6cdaeb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:07.215862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fca9e5-a1d5-41ca-98e7-081a2f6cdaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:07.288765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: INFO dbcounter [None req-12fca9e5-a1d5-41ca-98e7-081a2f6cdaeb None None] Registered counter for database keystone Aug 02 08:39:07.309832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG oslo_db.sqlalchemy.engines [None req-12fca9e5-a1d5-41ca-98e7-081a2f6cdaeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:39:07.316405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writer thread running {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:39:07.503163 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG passlib.handlers.bcrypt [None req-12fca9e5-a1d5-41ca-98e7-081a2f6cdaeb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80209) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 08:39:07.503492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG passlib.handlers.bcrypt [None req-12fca9e5-a1d5-41ca-98e7-081a2f6cdaeb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80209) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 08:39:07.559755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-12fca9e5-a1d5-41ca-98e7-081a2f6cdaeb None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:07.561447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-12fca9e5-a1d5-41ca-98e7-081a2f6cdaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:07.697472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 02 08:39:07.827843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30c7b-fe16-4894-9456-912b4a2c1557 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:07.898571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: INFO dbcounter [None req-75b30c7b-fe16-4894-9456-912b4a2c1557 None None] Registered counter for database keystone Aug 02 08:39:07.921260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG oslo_db.sqlalchemy.engines [None req-75b30c7b-fe16-4894-9456-912b4a2c1557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:39:07.927755 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writer thread running {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:39:08.047476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30c7b-fe16-4894-9456-912b4a2c1557 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:08.051729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6722f-0452-4718-8f03-a145d5638985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:08.052401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6722f-0452-4718-8f03-a145d5638985 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:08.052693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6722f-0452-4718-8f03-a145d5638985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:08.053022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6722f-0452-4718-8f03-a145d5638985 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:08.061579 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6722f-0452-4718-8f03-a145d5638985 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:08.113080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: WARNING keystone.common.rbac_enforcer.enforcer [None req-98e6722f-0452-4718-8f03-a145d5638985 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 08:39:08.113429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6722f-0452-4718-8f03-a145d5638985 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:08.124050 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Tue Aug 2 08:39:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 08:39:08.130262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fca9e5-a1d5-41ca-98e7-081a2f6cdaeb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:08.145196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fca9e5-a1d5-41ca-98e7-081a2f6cdaeb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:08.149592 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3016ab-54a7-43e7-8573-64b811ee9088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:08.150729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3016ab-54a7-43e7-8573-64b811ee9088 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:08.151019 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3016ab-54a7-43e7-8573-64b811ee9088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:08.151297 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3016ab-54a7-43e7-8573-64b811ee9088 admin admin] PATH_INFO: `/v3/projects/373878c44f1d4227ba8ac54103602eff` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:08.152811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3016ab-54a7-43e7-8573-64b811ee9088 admin admin] RBAC: Authorizing `identity:get_project(project_id=373878c44f1d4227ba8ac54103602eff)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:08.203268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9c3016ab-54a7-43e7-8573-64b811ee9088 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 08:39:08.203619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3016ab-54a7-43e7-8573-64b811ee9088 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:08.211770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Tue Aug 2 08:39:08 2022] GET /identity/v3/projects/373878c44f1d4227ba8ac54103602eff => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:10.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f37c9-4e92-4108-b227-a536bc5782a3 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:10.193057 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f37c9-4e92-4108-b227-a536bc5782a3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:10.193057 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f37c9-4e92-4108-b227-a536bc5782a3 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:10.197200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:10.202616 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f547c35-c3a6-4a4b-9373-923952ea9bd2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:10.203039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f547c35-c3a6-4a4b-9373-923952ea9bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:10.203185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f547c35-c3a6-4a4b-9373-923952ea9bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:10.223527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6f547c35-c3a6-4a4b-9373-923952ea9bd2 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:10.225144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6f547c35-c3a6-4a4b-9373-923952ea9bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:10.233550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 02 08:39:10.254607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f37c9-4e92-4108-b227-a536bc5782a3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:10.266512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f37c9-4e92-4108-b227-a536bc5782a3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:10.270643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023feb54-a253-4d46-a637-b5e5a94572d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:10.271238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023feb54-a253-4d46-a637-b5e5a94572d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:10.271522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023feb54-a253-4d46-a637-b5e5a94572d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:10.271802 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023feb54-a253-4d46-a637-b5e5a94572d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:10.279884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023feb54-a253-4d46-a637-b5e5a94572d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:10.281680 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023feb54-a253-4d46-a637-b5e5a94572d6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:10.290312 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Tue Aug 2 08:39:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:39:10.296277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f547c35-c3a6-4a4b-9373-923952ea9bd2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:10.306020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f547c35-c3a6-4a4b-9373-923952ea9bd2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:10.312375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7da853-2ebe-4f35-8314-9df3f37123e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:10.313040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7da853-2ebe-4f35-8314-9df3f37123e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:10.313322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7da853-2ebe-4f35-8314-9df3f37123e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:10.313605 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7da853-2ebe-4f35-8314-9df3f37123e6 admin admin] PATH_INFO: `/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:10.315685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7da853-2ebe-4f35-8314-9df3f37123e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c37b28fc7d64a6c86abaeae5a87cc16)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:10.317590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7da853-2ebe-4f35-8314-9df3f37123e6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:10.320599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Tue Aug 2 08:39:10 2022] GET /identity/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:12.361640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564af3a-eccf-4252-90b2-1dc55404fdfd None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:12.362149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564af3a-eccf-4252-90b2-1dc55404fdfd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:12.362247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564af3a-eccf-4252-90b2-1dc55404fdfd None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:12.363521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:12.368541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d457a2-b369-4737-be22-46ba137e3f81 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:12.369473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d457a2-b369-4737-be22-46ba137e3f81 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:12.369653 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d457a2-b369-4737-be22-46ba137e3f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:12.389114 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-08d457a2-b369-4737-be22-46ba137e3f81 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:12.390303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-08d457a2-b369-4737-be22-46ba137e3f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:12.412143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d6025-ecc2-43bb-b4fb-10b477a6921c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:12.412463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d6025-ecc2-43bb-b4fb-10b477a6921c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:12.412748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d6025-ecc2-43bb-b4fb-10b477a6921c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:12.414067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:39:12.418884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb3e3-c5fd-4645-b925-2d2e8deb8cbf None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:12.419179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb3e3-c5fd-4645-b925-2d2e8deb8cbf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:12.419461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb3e3-c5fd-4645-b925-2d2e8deb8cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:12.461793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG passlib.handlers.bcrypt [None req-f71fb3e3-c5fd-4645-b925-2d2e8deb8cbf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80210) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 08:39:12.462221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG passlib.handlers.bcrypt [None req-f71fb3e3-c5fd-4645-b925-2d2e8deb8cbf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80210) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 08:39:12.468587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:12.490523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d457a2-b369-4737-be22-46ba137e3f81 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:12.507665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f71fb3e3-c5fd-4645-b925-2d2e8deb8cbf None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:12.509305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f71fb3e3-c5fd-4645-b925-2d2e8deb8cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:12.514417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:12.595686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d457a2-b369-4737-be22-46ba137e3f81 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:12.610041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:12.632778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fb3e3-c5fd-4645-b925-2d2e8deb8cbf None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:12.635557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecccb71-9091-4c77-afc9-9174aa5d78dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:12.636243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecccb71-9091-4c77-afc9-9174aa5d78dc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:12.636527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecccb71-9091-4c77-afc9-9174aa5d78dc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:12.636891 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecccb71-9091-4c77-afc9-9174aa5d78dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:12.648167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecccb71-9091-4c77-afc9-9174aa5d78dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-2ecccb71-9091-4c77-afc9-9174aa5d78dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:12.657053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:12.658029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:12.659011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:39:12.664282 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecccb71-9091-4c77-afc9-9174aa5d78dc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:12.735599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fb3e3-c5fd-4645-b925-2d2e8deb8cbf None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:12.737964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:12.746977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:12.765638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecccb71-9091-4c77-afc9-9174aa5d78dc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:12.773432 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8f754-9c97-42ba-8177-54ed3467567d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:12.774293 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8f754-9c97-42ba-8177-54ed3467567d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:12.774578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8f754-9c97-42ba-8177-54ed3467567d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:12.774855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8f754-9c97-42ba-8177-54ed3467567d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:12.800242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82953456-dbed-41d2-93f0-bb8d7d8b71a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:12.800861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82953456-dbed-41d2-93f0-bb8d7d8b71a6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:12.801207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82953456-dbed-41d2-93f0-bb8d7d8b71a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:12.801421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82953456-dbed-41d2-93f0-bb8d7d8b71a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:12.802149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82953456-dbed-41d2-93f0-bb8d7d8b71a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:12.802457 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82953456-dbed-41d2-93f0-bb8d7d8b71a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:12.803861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82953456-dbed-41d2-93f0-bb8d7d8b71a6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:12.816532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:12.822169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82953456-dbed-41d2-93f0-bb8d7d8b71a6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:12.845997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8f754-9c97-42ba-8177-54ed3467567d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:12.847531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8f754-9c97-42ba-8177-54ed3467567d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:12.923362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82953456-dbed-41d2-93f0-bb8d7d8b71a6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:12.947503 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:39:12.953554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8f754-9c97-42ba-8177-54ed3467567d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:12.956841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:13.059020 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8f754-9c97-42ba-8177-54ed3467567d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:13.068505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193982e-e682-4f84-982a-24d82fb9a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:13.069150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193982e-e682-4f84-982a-24d82fb9a75a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:13.069431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193982e-e682-4f84-982a-24d82fb9a75a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:13.069710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193982e-e682-4f84-982a-24d82fb9a75a None admin] PATH_INFO: `/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:13.070871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193982e-e682-4f84-982a-24d82fb9a75a None admin] RBAC: Authorizing `identity:get_user(user_id=5c37b28fc7d64a6c86abaeae5a87cc16)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:13.072381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193982e-e682-4f84-982a-24d82fb9a75a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:13.073967 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:12 2022] GET /identity/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:13.079402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193982e-e682-4f84-982a-24d82fb9a75a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:13.094424 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:13.095300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b9f46-3b2b-4e58-ae72-a302077e478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:13.096399 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9f46-3b2b-4e58-ae72-a302077e478b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:13.096686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9f46-3b2b-4e58-ae72-a302077e478b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:13.096987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9f46-3b2b-4e58-ae72-a302077e478b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:13.115576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b9f46-3b2b-4e58-ae72-a302077e478b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:13.117084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b9f46-3b2b-4e58-ae72-a302077e478b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-829b9f46-3b2b-4e58-ae72-a302077e478b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:39:13.135010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:13.135821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:13.137144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:39:13.137144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:39:13.137144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:39:13.137144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:13.137144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 9/18] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:13.141970 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b9f46-3b2b-4e58-ae72-a302077e478b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:13.181856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193982e-e682-4f84-982a-24d82fb9a75a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:13.199294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:13.215598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0415ff-d6a2-4e48-8227-1ecac77d4f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:13.216282 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0415ff-d6a2-4e48-8227-1ecac77d4f38 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:13.216569 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0415ff-d6a2-4e48-8227-1ecac77d4f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:13.216849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0415ff-d6a2-4e48-8227-1ecac77d4f38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:13.218014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0415ff-d6a2-4e48-8227-1ecac77d4f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:13.219466 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0415ff-d6a2-4e48-8227-1ecac77d4f38 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:13.221083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 10/19] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:13.226783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0415ff-d6a2-4e48-8227-1ecac77d4f38 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:13.244902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b9f46-3b2b-4e58-ae72-a302077e478b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:13.278151 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838a3c8-e412-4f19-99bf-fd4c82304d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:13.278782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838a3c8-e412-4f19-99bf-fd4c82304d04 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:13.279067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838a3c8-e412-4f19-99bf-fd4c82304d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:13.279348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838a3c8-e412-4f19-99bf-fd4c82304d04 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:13.280044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838a3c8-e412-4f19-99bf-fd4c82304d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:13.280381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838a3c8-e412-4f19-99bf-fd4c82304d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:13.281781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838a3c8-e412-4f19-99bf-fd4c82304d04 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:13.299711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 10/20] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:13.307162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:13.333403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0415ff-d6a2-4e48-8227-1ecac77d4f38 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:13.371805 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bb654-be70-4633-824c-e90d1c33ca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:13.372502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bb654-be70-4633-824c-e90d1c33ca74 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:13.372743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bb654-be70-4633-824c-e90d1c33ca74 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:13.373017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bb654-be70-4633-824c-e90d1c33ca74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:13.373851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bb654-be70-4633-824c-e90d1c33ca74 None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.domain.id=default, user.id=5c37b28fc7d64a6c86abaeae5a87cc16) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:13.374148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bb654-be70-4633-824c-e90d1c33ca74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:13.375627 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bb654-be70-4633-824c-e90d1c33ca74 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:13.383224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 11/21] 10.222.0.17 () {56 vars in 1322 bytes} [Tue Aug 2 08:39:13 2022] GET /identity/v3/role_assignments?user.id=5c37b28fc7d64a6c86abaeae5a87cc16&scope.domain.id=default&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:15.810921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835982-8b32-4f47-b282-12a95d304665 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:15.810921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835982-8b32-4f47-b282-12a95d304665 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:15.810921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835982-8b32-4f47-b282-12a95d304665 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:15.811731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 11/22] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:15.817819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6df211-f83d-45b6-9580-9d15e64ee0c8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:15.818299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6df211-f83d-45b6-9580-9d15e64ee0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:15.818980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6df211-f83d-45b6-9580-9d15e64ee0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:15.863389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4c6df211-f83d-45b6-9580-9d15e64ee0c8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:15.869944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4c6df211-f83d-45b6-9580-9d15e64ee0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:15.987055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 12/23] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:16.021687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec835982-8b32-4f47-b282-12a95d304665 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:16.037761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6a6a2-10cf-4c7e-9809-86b9f326e324 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:16.038604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6a6a2-10cf-4c7e-9809-86b9f326e324 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:16.039267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6a6a2-10cf-4c7e-9809-86b9f326e324 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:16.041855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:39:16.048057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3a276-7022-42e3-a120-369f07bd4959 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:16.052010 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3a276-7022-42e3-a120-369f07bd4959 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:16.052742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3a276-7022-42e3-a120-369f07bd4959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:16.105505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-64a3a276-7022-42e3-a120-369f07bd4959 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:16.108911 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-64a3a276-7022-42e3-a120-369f07bd4959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:16.270500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 14/25] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:16.272093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7683c-7eba-4699-9a6a-5460b27b40b1 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:16.272505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7683c-7eba-4699-9a6a-5460b27b40b1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:16.273029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7683c-7eba-4699-9a6a-5460b27b40b1 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:16.275909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 15/26] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:16.280457 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1e5f-5f77-4a47-bd69-e52b1508f551 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:16.280998 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1e5f-5f77-4a47-bd69-e52b1508f551 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:16.281481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1e5f-5f77-4a47-bd69-e52b1508f551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:16.292591 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec835982-8b32-4f47-b282-12a95d304665 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:16.302930 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:16.324697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:16.325181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3a9f1e5f-5f77-4a47-bd69-e52b1508f551 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:16.326430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3a9f1e5f-5f77-4a47-bd69-e52b1508f551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:16.355459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8c3ba-b9f0-4488-8385-f31b27fb47e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:16.356527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8c3ba-b9f0-4488-8385-f31b27fb47e7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:16.356961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8c3ba-b9f0-4488-8385-f31b27fb47e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:16.357385 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8c3ba-b9f0-4488-8385-f31b27fb47e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:16.370812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8c3ba-b9f0-4488-8385-f31b27fb47e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d0a8c3ba-b9f0-4488-8385-f31b27fb47e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:16.377842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:16.379363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 12/27] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:39:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:16.380797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8c3ba-b9f0-4488-8385-f31b27fb47e7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:16.451150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 16/28] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:16.453379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5b9e8-4134-4f26-b084-740cc8d3a9ff None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:16.453887 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5b9e8-4134-4f26-b084-740cc8d3a9ff None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:16.454428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5b9e8-4134-4f26-b084-740cc8d3a9ff None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:16.456414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 17/29] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:16.457784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5b9e8-4134-4f26-b084-740cc8d3a9ff None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:16.515631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8c3ba-b9f0-4488-8385-f31b27fb47e7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:16.558943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecd5fb-fd09-4438-b7df-f472ae49771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:16.560688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecd5fb-fd09-4438-b7df-f472ae49771e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:16.561208 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecd5fb-fd09-4438-b7df-f472ae49771e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:16.562275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecd5fb-fd09-4438-b7df-f472ae49771e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:16.580314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecd5fb-fd09-4438-b7df-f472ae49771e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:16.583306 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecd5fb-fd09-4438-b7df-f472ae49771e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:16.589698 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5b9e8-4134-4f26-b084-740cc8d3a9ff None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:16.642315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efecfc-6ffc-4a81-aa27-9e245278a1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:16.643395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efecfc-6ffc-4a81-aa27-9e245278a1aa None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:16.643835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efecfc-6ffc-4a81-aa27-9e245278a1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:16.644397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efecfc-6ffc-4a81-aa27-9e245278a1aa None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:16.645476 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efecfc-6ffc-4a81-aa27-9e245278a1aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:16.646082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efecfc-6ffc-4a81-aa27-9e245278a1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:16.647912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efecfc-6ffc-4a81-aa27-9e245278a1aa None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:16.650239 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:16.663906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 18/30] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:16.666865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b1a1e-ed67-4e43-adfb-a789b36d8727 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:16.667508 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b1a1e-ed67-4e43-adfb-a789b36d8727 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:16.668077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b1a1e-ed67-4e43-adfb-a789b36d8727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:16.693130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-058b1a1e-ed67-4e43-adfb-a789b36d8727 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:16.694879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-058b1a1e-ed67-4e43-adfb-a789b36d8727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-63ecd5fb-fd09-4438-b7df-f472ae49771e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:39:16.716983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:16.718465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:16.719626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:39:16.719626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:39:16.719626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:39:16.719626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:16.720194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 13/31] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:16.721078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecd5fb-fd09-4438-b7df-f472ae49771e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:16.754119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:16.827864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 19/32] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:16.828609 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b1a1e-ed67-4e43-adfb-a789b36d8727 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:16.886835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecd5fb-fd09-4438-b7df-f472ae49771e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:16.935103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8902e58-7cef-4fc4-82ac-ef774cd48308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:16.936614 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8902e58-7cef-4fc4-82ac-ef774cd48308 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:16.937111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8902e58-7cef-4fc4-82ac-ef774cd48308 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:16.937861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8902e58-7cef-4fc4-82ac-ef774cd48308 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:16.938801 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8902e58-7cef-4fc4-82ac-ef774cd48308 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:16.941281 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8902e58-7cef-4fc4-82ac-ef774cd48308 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:16.950360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b1a1e-ed67-4e43-adfb-a789b36d8727 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:16.985023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:16.995546 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f0293-5bce-4624-9eee-debf05dcb513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:16.996566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f0293-5bce-4624-9eee-debf05dcb513 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:16.997098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f0293-5bce-4624-9eee-debf05dcb513 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:16.997553 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f0293-5bce-4624-9eee-debf05dcb513 None admin] PATH_INFO: `/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:16.998933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f0293-5bce-4624-9eee-debf05dcb513 None admin] RBAC: Authorizing `identity:get_user(user_id=5c37b28fc7d64a6c86abaeae5a87cc16)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:17.001092 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f0293-5bce-4624-9eee-debf05dcb513 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:17.003367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 20/33] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:16 2022] GET /identity/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:17.004382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f0293-5bce-4624-9eee-debf05dcb513 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:17.087255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 14/34] 10.222.0.17 () {60 vars in 1131 bytes} [Tue Aug 2 08:39:16 2022] POST /identity/v3/roles => generated 225 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:39:17.087255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8902e58-7cef-4fc4-82ac-ef774cd48308 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:17.149171 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f0293-5bce-4624-9eee-debf05dcb513 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:17.195717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b4fea-4d20-48cc-88e1-d7b1f70558e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:17.196307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b4fea-4d20-48cc-88e1-d7b1f70558e7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:17.196590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b4fea-4d20-48cc-88e1-d7b1f70558e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:17.197401 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b4fea-4d20-48cc-88e1-d7b1f70558e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:17.198528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b4fea-4d20-48cc-88e1-d7b1f70558e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:17.198849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b4fea-4d20-48cc-88e1-d7b1f70558e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:17.200712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b4fea-4d20-48cc-88e1-d7b1f70558e7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:17.227074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 21/35] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:17.228891 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b4fea-4d20-48cc-88e1-d7b1f70558e7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:17.277697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:17.292693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8902e58-7cef-4fc4-82ac-ef774cd48308 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:17.308997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:17.334765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7680eb2-37f3-4459-9730-066e3ed3bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:17.335934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7680eb2-37f3-4459-9730-066e3ed3bdd2 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:17.336256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7680eb2-37f3-4459-9730-066e3ed3bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:17.336544 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7680eb2-37f3-4459-9730-066e3ed3bdd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:17.338207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7680eb2-37f3-4459-9730-066e3ed3bdd2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:17.340184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7680eb2-37f3-4459-9730-066e3ed3bdd2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:17.362981 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 15/36] 10.222.0.17 () {60 vars in 1131 bytes} [Tue Aug 2 08:39:17 2022] POST /identity/v3/roles => generated 219 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:39:17.366293 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7680eb2-37f3-4459-9730-066e3ed3bdd2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:17.368709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b4fea-4d20-48cc-88e1-d7b1f70558e7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:17.423629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9ec3a-a31d-46dd-8f94-e5bbb8779d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:17.424622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ec3a-a31d-46dd-8f94-e5bbb8779d55 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:17.425054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ec3a-a31d-46dd-8f94-e5bbb8779d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:17.425542 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ec3a-a31d-46dd-8f94-e5bbb8779d55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:17.427077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9ec3a-a31d-46dd-8f94-e5bbb8779d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:17.428794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9ec3a-a31d-46dd-8f94-e5bbb8779d55 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:17.431604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 22/37] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:17.433876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d77bc7-8c17-44b5-94b9-3efea2340813 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:17.434345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d77bc7-8c17-44b5-94b9-3efea2340813 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:17.434790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d77bc7-8c17-44b5-94b9-3efea2340813 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:17.437318 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 23/38] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:17.438387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d77bc7-8c17-44b5-94b9-3efea2340813 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:17.522792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7680eb2-37f3-4459-9730-066e3ed3bdd2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:17.567953 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877a67d-20f9-42c4-b48a-aa961199413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:17.569636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877a67d-20f9-42c4-b48a-aa961199413c None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:17.569636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877a67d-20f9-42c4-b48a-aa961199413c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:17.569636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877a67d-20f9-42c4-b48a-aa961199413c None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:17.571774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877a67d-20f9-42c4-b48a-aa961199413c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:17.574845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877a67d-20f9-42c4-b48a-aa961199413c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:17.579695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d77bc7-8c17-44b5-94b9-3efea2340813 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:17.607356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:17.610963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:17.620168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 16/39] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:39:17 2022] POST /identity/v3/projects => generated 301 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:39:17.620168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6909a-2fcf-4113-9a7d-75d9ea84ba7c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:17.620168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6909a-2fcf-4113-9a7d-75d9ea84ba7c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:17.620168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6909a-2fcf-4113-9a7d-75d9ea84ba7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:17.632343 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a727c9a-5e11-4012-8b66-5bc3ca9431c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:17.633430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a727c9a-5e11-4012-8b66-5bc3ca9431c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:17.633430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a727c9a-5e11-4012-8b66-5bc3ca9431c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:17.633677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a727c9a-5e11-4012-8b66-5bc3ca9431c1 None admin] PATH_INFO: `/v3/domains/default/users/5c37b28fc7d64a6c86abaeae5a87cc16/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:17.636823 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a727c9a-5e11-4012-8b66-5bc3ca9431c1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5c37b28fc7d64a6c86abaeae5a87cc16, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:17.638799 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a727c9a-5e11-4012-8b66-5bc3ca9431c1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:17.642167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3fc6909a-2fcf-4113-9a7d-75d9ea84ba7c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:17.644423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3fc6909a-2fcf-4113-9a7d-75d9ea84ba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:17.732415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 17/40] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:17.734733 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5718ef-c063-45b7-9275-74965d9075c8 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:17.735467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5718ef-c063-45b7-9275-74965d9075c8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:17.736096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5718ef-c063-45b7-9275-74965d9075c8 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:17.738598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 18/41] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:17.746048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbc0de-c51d-46f2-8f47-37333a90600f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:17.746373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbc0de-c51d-46f2-8f47-37333a90600f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:17.746621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbc0de-c51d-46f2-8f47-37333a90600f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:17.770866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c8fbc0de-c51d-46f2-8f47-37333a90600f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:17.772370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 24/42] 10.222.0.17 () {58 vars in 1361 bytes} [Tue Aug 2 08:39:17 2022] PUT /identity/v3/domains/default/users/5c37b28fc7d64a6c86abaeae5a87cc16/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:39:17.773036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c8fbc0de-c51d-46f2-8f47-37333a90600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:17.773727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a727c9a-5e11-4012-8b66-5bc3ca9431c1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:17.888453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 19/43] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:17.919209 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbc0de-c51d-46f2-8f47-37333a90600f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:17.936777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a727c9a-5e11-4012-8b66-5bc3ca9431c1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:17.973931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590f056-07f1-4b33-832c-4ca6f4977e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:17.974649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590f056-07f1-4b33-832c-4ca6f4977e55 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:17.974932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590f056-07f1-4b33-832c-4ca6f4977e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:17.975208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590f056-07f1-4b33-832c-4ca6f4977e55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:17.976687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590f056-07f1-4b33-832c-4ca6f4977e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:17.979057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590f056-07f1-4b33-832c-4ca6f4977e55 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:17.984602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 25/44] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:17.990260 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590f056-07f1-4b33-832c-4ca6f4977e55 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:17.999722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:18.052264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:18.059080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbc0de-c51d-46f2-8f47-37333a90600f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:18.105725 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c37b79-01fb-4ba0-841e-4b2d81fdad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:18.110024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c37b79-01fb-4ba0-841e-4b2d81fdad7c None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:18.110024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c37b79-01fb-4ba0-841e-4b2d81fdad7c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:18.110024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c37b79-01fb-4ba0-841e-4b2d81fdad7c None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:18.110024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c37b79-01fb-4ba0-841e-4b2d81fdad7c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:18.110024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c37b79-01fb-4ba0-841e-4b2d81fdad7c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:18.125688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590f056-07f1-4b33-832c-4ca6f4977e55 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:18.126305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 20/45] 10.222.0.17 () {60 vars in 1131 bytes} [Tue Aug 2 08:39:17 2022] POST /identity/v3/roles => generated 223 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:39:18.180216 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d82f7-a9e4-41a1-88bb-2a688ce8314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:18.181228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d82f7-a9e4-41a1-88bb-2a688ce8314b None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:18.181530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d82f7-a9e4-41a1-88bb-2a688ce8314b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:18.181926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d82f7-a9e4-41a1-88bb-2a688ce8314b None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:18.182804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d82f7-a9e4-41a1-88bb-2a688ce8314b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:18.185218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d82f7-a9e4-41a1-88bb-2a688ce8314b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:18.240160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 26/46] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:39:17 2022] POST /identity/v3/projects => generated 312 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:39:19.862911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3ac3-bf90-447f-8818-2a58bbbaa7a6 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:19.863643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3ac3-bf90-447f-8818-2a58bbbaa7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:19.863643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3ac3-bf90-447f-8818-2a58bbbaa7a6 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:19.864954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 21/47] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:19.870780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39676bcb-5dc7-454b-93f7-ab65e9936146 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:19.871272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39676bcb-5dc7-454b-93f7-ab65e9936146 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:19.871355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39676bcb-5dc7-454b-93f7-ab65e9936146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:19.891364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-39676bcb-5dc7-454b-93f7-ab65e9936146 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:19.893020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-39676bcb-5dc7-454b-93f7-ab65e9936146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:19.963351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 27/48] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:19.986661 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe3ac3-bf90-447f-8818-2a58bbbaa7a6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:20.095369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe3ac3-bf90-447f-8818-2a58bbbaa7a6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:20.114663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:20.130386 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b7899-1952-441d-afec-aec5fbc278c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:20.131037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b7899-1952-441d-afec-aec5fbc278c3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:20.131320 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b7899-1952-441d-afec-aec5fbc278c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:20.131597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b7899-1952-441d-afec-aec5fbc278c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:20.143487 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b7899-1952-441d-afec-aec5fbc278c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-3b6b7899-1952-441d-afec-aec5fbc278c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:20.148555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:20.150368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:20.152048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 22/49] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:39:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:20.156853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39676bcb-5dc7-454b-93f7-ab65e9936146 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:20.191992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:20.263468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39676bcb-5dc7-454b-93f7-ab65e9936146 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:20.297730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ec232-ea1f-4c55-8290-283f153c8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:20.298350 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ec232-ea1f-4c55-8290-283f153c8795 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:20.298636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ec232-ea1f-4c55-8290-283f153c8795 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:20.298915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ec232-ea1f-4c55-8290-283f153c8795 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:20.299642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ec232-ea1f-4c55-8290-283f153c8795 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:20.299952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ec232-ea1f-4c55-8290-283f153c8795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:20.301391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ec232-ea1f-4c55-8290-283f153c8795 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:20.310240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 28/50] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:20.312308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6f204-73ee-4e65-a314-d0434c3cc6af None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:20.312612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6f204-73ee-4e65-a314-d0434c3cc6af None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:20.312994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6f204-73ee-4e65-a314-d0434c3cc6af None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:20.314643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 23/51] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:20.315950 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ec232-ea1f-4c55-8290-283f153c8795 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:20.319706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bb2bd-70c8-4029-9305-a60c4ac76964 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:20.320058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bb2bd-70c8-4029-9305-a60c4ac76964 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:20.320477 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bb2bd-70c8-4029-9305-a60c4ac76964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:20.343455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-074bb2bd-70c8-4029-9305-a60c4ac76964 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:20.344946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-074bb2bd-70c8-4029-9305-a60c4ac76964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:20.417190 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:20.421843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 24/52] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:20.424421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ec232-ea1f-4c55-8290-283f153c8795 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:20.444968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074bb2bd-70c8-4029-9305-a60c4ac76964 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:20.459751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cb128-a323-4709-87c0-e6bef77bf1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:20.460436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cb128-a323-4709-87c0-e6bef77bf1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:20.460728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cb128-a323-4709-87c0-e6bef77bf1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:20.461067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cb128-a323-4709-87c0-e6bef77bf1e8 None admin] PATH_INFO: `/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:20.462196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cb128-a323-4709-87c0-e6bef77bf1e8 None admin] RBAC: Authorizing `identity:get_user(user_id=5c37b28fc7d64a6c86abaeae5a87cc16)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:20.463686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cb128-a323-4709-87c0-e6bef77bf1e8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:20.465330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 29/53] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:20 2022] GET /identity/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:20.470683 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cb128-a323-4709-87c0-e6bef77bf1e8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:20.551730 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074bb2bd-70c8-4029-9305-a60c4ac76964 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:20.562403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:20.575454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cb128-a323-4709-87c0-e6bef77bf1e8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:20.586197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90cbe7-a3ad-41ee-949a-46409c69cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:20.586841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90cbe7-a3ad-41ee-949a-46409c69cd8c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:20.587128 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90cbe7-a3ad-41ee-949a-46409c69cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:20.587937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90cbe7-a3ad-41ee-949a-46409c69cd8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:20.589109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90cbe7-a3ad-41ee-949a-46409c69cd8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:20.590577 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90cbe7-a3ad-41ee-949a-46409c69cd8c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:20.596793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 25/54] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:20.597719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90cbe7-a3ad-41ee-949a-46409c69cd8c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:20.610267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1696448-e4a4-4d2d-8167-179070c176a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:20.610915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1696448-e4a4-4d2d-8167-179070c176a1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:20.611194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1696448-e4a4-4d2d-8167-179070c176a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:20.611472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1696448-e4a4-4d2d-8167-179070c176a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:20.612715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1696448-e4a4-4d2d-8167-179070c176a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:20.614084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1696448-e4a4-4d2d-8167-179070c176a1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:20.615678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 30/55] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:20.621352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1696448-e4a4-4d2d-8167-179070c176a1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:20.651580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:20.702355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90cbe7-a3ad-41ee-949a-46409c69cd8c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:20.735278 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1696448-e4a4-4d2d-8167-179070c176a1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:20.738731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4332d77-60cf-49bd-a32b-ddd837191f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:20.739368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4332d77-60cf-49bd-a32b-ddd837191f6b None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:20.739658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4332d77-60cf-49bd-a32b-ddd837191f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:20.739940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4332d77-60cf-49bd-a32b-ddd837191f6b None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:20.740665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4332d77-60cf-49bd-a32b-ddd837191f6b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:20.742135 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4332d77-60cf-49bd-a32b-ddd837191f6b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:20.768767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 26/56] 10.222.0.17 () {60 vars in 1140 bytes} [Tue Aug 2 08:39:20 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:39:20.778571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5446b89-36ba-4fb7-88e6-c15ec356e862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:20.779223 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5446b89-36ba-4fb7-88e6-c15ec356e862 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:20.779509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5446b89-36ba-4fb7-88e6-c15ec356e862 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:20.779790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5446b89-36ba-4fb7-88e6-c15ec356e862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:20.780665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5446b89-36ba-4fb7-88e6-c15ec356e862 None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.domain.id=default, user.id=5c37b28fc7d64a6c86abaeae5a87cc16) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:20.780982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5446b89-36ba-4fb7-88e6-c15ec356e862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:20.782516 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5446b89-36ba-4fb7-88e6-c15ec356e862 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:20.804156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 31/57] 10.222.0.17 () {56 vars in 1322 bytes} [Tue Aug 2 08:39:20 2022] GET /identity/v3/role_assignments?user.id=5c37b28fc7d64a6c86abaeae5a87cc16&scope.domain.id=default&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 530 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:22.795286 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cf7e8-a233-48d6-8526-47c0ffcf0500 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:22.795799 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cf7e8-a233-48d6-8526-47c0ffcf0500 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:22.795993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cf7e8-a233-48d6-8526-47c0ffcf0500 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:22.797381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 27/58] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:22.802657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6870b-fa37-4a5d-a82b-f5394b53c588 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:22.803073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6870b-fa37-4a5d-a82b-f5394b53c588 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:22.803596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6870b-fa37-4a5d-a82b-f5394b53c588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:22.822894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-06a6870b-fa37-4a5d-a82b-f5394b53c588 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:22.824354 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-06a6870b-fa37-4a5d-a82b-f5394b53c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:22.914859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 32/59] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:22.939496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cf7e8-a233-48d6-8526-47c0ffcf0500 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:22.971652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:23.048764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cf7e8-a233-48d6-8526-47c0ffcf0500 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:23.081838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e4179-fb0e-489b-841b-8b9f43f5e499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:23.082475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e4179-fb0e-489b-841b-8b9f43f5e499 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:23.082755 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e4179-fb0e-489b-841b-8b9f43f5e499 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:23.083033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e4179-fb0e-489b-841b-8b9f43f5e499 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:23.084443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e4179-fb0e-489b-841b-8b9f43f5e499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:23.085902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e4179-fb0e-489b-841b-8b9f43f5e499 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:23.087961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 28/60] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:23.093754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6870b-fa37-4a5d-a82b-f5394b53c588 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:23.117998 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:23.198695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6870b-fa37-4a5d-a82b-f5394b53c588 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:23.235551 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdd984-9bb7-4e07-a4da-ca7e3e02f77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:23.236450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdd984-9bb7-4e07-a4da-ca7e3e02f77b None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:23.236731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdd984-9bb7-4e07-a4da-ca7e3e02f77b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:23.237007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdd984-9bb7-4e07-a4da-ca7e3e02f77b None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:23.237696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdd984-9bb7-4e07-a4da-ca7e3e02f77b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:23.239148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdd984-9bb7-4e07-a4da-ca7e3e02f77b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:23.266152 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 33/61] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:39:23 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:39:26.517265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02ab0-d4c6-4354-b6bf-7ed08efffe36 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:26.518210 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02ab0-d4c6-4354-b6bf-7ed08efffe36 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:26.518633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02ab0-d4c6-4354-b6bf-7ed08efffe36 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:26.520236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 29/62] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:26.526449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0636db-0003-4961-be5f-cb47fe22b971 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:26.527368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0636db-0003-4961-be5f-cb47fe22b971 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:26.528130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0636db-0003-4961-be5f-cb47fe22b971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:26.532844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac8cf4-af9f-4440-bc08-a11ed5791489 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:26.533437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac8cf4-af9f-4440-bc08-a11ed5791489 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:26.533940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac8cf4-af9f-4440-bc08-a11ed5791489 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:26.536090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 30/63] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:26.544020 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64310933-3649-445e-b36c-37d4f7fddeca None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:26.544418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64310933-3649-445e-b36c-37d4f7fddeca None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:26.544703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64310933-3649-445e-b36c-37d4f7fddeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:26.562849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-dc0636db-0003-4961-be5f-cb47fe22b971 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:26.569243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dc0636db-0003-4961-be5f-cb47fe22b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:26.583233 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-64310933-3649-445e-b36c-37d4f7fddeca None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:26.584703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-64310933-3649-445e-b36c-37d4f7fddeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:26.684838 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 34/64] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:26.707686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0636db-0003-4961-be5f-cb47fe22b971 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:26.728840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:26.740043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 31/65] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:26.793201 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64310933-3649-445e-b36c-37d4f7fddeca None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:26.837006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:26.869504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0636db-0003-4961-be5f-cb47fe22b971 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:26.913580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769307a0-ecb3-44b7-a140-9921eeff5230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:26.915268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769307a0-ecb3-44b7-a140-9921eeff5230 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:26.915827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769307a0-ecb3-44b7-a140-9921eeff5230 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:26.916278 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769307a0-ecb3-44b7-a140-9921eeff5230 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:26.929466 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769307a0-ecb3-44b7-a140-9921eeff5230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:26.933227 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64310933-3649-445e-b36c-37d4f7fddeca None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-769307a0-ecb3-44b7-a140-9921eeff5230 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:26.935906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:26.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:26.937899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:26.937899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:26.937899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:26.937899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:26.937899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:26.937899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:26.937899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:26.937899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:26.937899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:26.937899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:26.937899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:26.937899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:26.940619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 35/66] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:39:26.942892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1b623-8879-41a6-bc68-a572d3fe2b70 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:26.943435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1b623-8879-41a6-bc68-a572d3fe2b70 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:26.943948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1b623-8879-41a6-bc68-a572d3fe2b70 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:26.946012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 36/67] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:26.952156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1b623-8879-41a6-bc68-a572d3fe2b70 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:26.975809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b974-2588-4e4c-90e9-c3fed419898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:26.976578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b974-2588-4e4c-90e9-c3fed419898e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:26.976929 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b974-2588-4e4c-90e9-c3fed419898e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:26.977281 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b974-2588-4e4c-90e9-c3fed419898e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:26.991296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487b974-2588-4e4c-90e9-c3fed419898e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-3487b974-2588-4e4c-90e9-c3fed419898e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:26.997869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:26.998742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:26.999588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 32/68] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:39:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:27.000806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a509c1-1a1f-4bc6-b8e9-631225c597d2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.001574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a509c1-1a1f-4bc6-b8e9-631225c597d2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.001903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a509c1-1a1f-4bc6-b8e9-631225c597d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.024273 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-49a509c1-1a1f-4bc6-b8e9-631225c597d2 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:27.026025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-49a509c1-1a1f-4bc6-b8e9-631225c597d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:27.038787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:27.074341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1b623-8879-41a6-bc68-a572d3fe2b70 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:27.112143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 33/69] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:27.112143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a509c1-1a1f-4bc6-b8e9-631225c597d2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:27.112457 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acf27a-0ec3-46c9-93e4-03d33afa53db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:27.113034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf27a-0ec3-46c9-93e4-03d33afa53db None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.113329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf27a-0ec3-46c9-93e4-03d33afa53db None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.113607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf27a-0ec3-46c9-93e4-03d33afa53db None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.114337 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf27a-0ec3-46c9-93e4-03d33afa53db None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:27.114647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf27a-0ec3-46c9-93e4-03d33afa53db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:27.116062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf27a-0ec3-46c9-93e4-03d33afa53db None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:27.120878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:27.125146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 37/70] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:27.131199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e568d7-1d21-4918-8a8c-a31b4a5174ab None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.131498 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e568d7-1d21-4918-8a8c-a31b4a5174ab None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.131788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e568d7-1d21-4918-8a8c-a31b4a5174ab None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.133122 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 38/71] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:27.134692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7a65d-4fe1-4421-99f3-e0cd97a66ec6 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.135041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7a65d-4fe1-4421-99f3-e0cd97a66ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.135326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7a65d-4fe1-4421-99f3-e0cd97a66ec6 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.136702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 39/72] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:27.140440 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7a65d-4fe1-4421-99f3-e0cd97a66ec6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:27.213516 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a509c1-1a1f-4bc6-b8e9-631225c597d2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:27.244858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7a65d-4fe1-4421-99f3-e0cd97a66ec6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:27.246518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967a2c4-085f-47c7-bf55-579959e03499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:27.247143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a2c4-085f-47c7-bf55-579959e03499 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.247431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a2c4-085f-47c7-bf55-579959e03499 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.247708 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a2c4-085f-47c7-bf55-579959e03499 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.248456 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967a2c4-085f-47c7-bf55-579959e03499 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:27.248770 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967a2c4-085f-47c7-bf55-579959e03499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:27.250153 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967a2c4-085f-47c7-bf55-579959e03499 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:27.262514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 34/73] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:27.263336 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967a2c4-085f-47c7-bf55-579959e03499 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:27.274373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:27.280778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb168f6-8c2e-4a9e-9a45-668119c885ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:27.281428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb168f6-8c2e-4a9e-9a45-668119c885ac None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.281710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb168f6-8c2e-4a9e-9a45-668119c885ac None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.281991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb168f6-8c2e-4a9e-9a45-668119c885ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.292702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb168f6-8c2e-4a9e-9a45-668119c885ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-beb168f6-8c2e-4a9e-9a45-668119c885ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:27.298905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:27.300009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:27.300872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 40/74] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:39:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:27.301582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17170b3d-f619-416f-b487-524b2144cfe1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.302141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17170b3d-f619-416f-b487-524b2144cfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.302141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17170b3d-f619-416f-b487-524b2144cfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.319784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-17170b3d-f619-416f-b487-524b2144cfe1 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:27.321001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-17170b3d-f619-416f-b487-524b2144cfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:27.353899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:27.375398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967a2c4-085f-47c7-bf55-579959e03499 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:27.390481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 41/75] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:27.391801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac678-3dbb-485a-8020-ce959afd2a49 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.392092 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac678-3dbb-485a-8020-ce959afd2a49 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.392402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac678-3dbb-485a-8020-ce959afd2a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.409212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-308ac678-3dbb-485a-8020-ce959afd2a49 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:27.410389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-308ac678-3dbb-485a-8020-ce959afd2a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:27.418723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b33739-41db-4da9-8bac-311979f90482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:27.419401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b33739-41db-4da9-8bac-311979f90482 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.419688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b33739-41db-4da9-8bac-311979f90482 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.419970 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b33739-41db-4da9-8bac-311979f90482 None admin] PATH_INFO: `/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.438300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b33739-41db-4da9-8bac-311979f90482 None admin] RBAC: Authorizing `identity:get_user(user_id=6ac1f63a2d744ed6af882ae350d0cdfd)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:27.443165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b33739-41db-4da9-8bac-311979f90482 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:27.445737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 35/76] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:27 2022] GET /identity/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:27.446711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b33739-41db-4da9-8bac-311979f90482 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:27.486594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 42/77] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:27.487453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ac678-3dbb-485a-8020-ce959afd2a49 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:27.541692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:27.548596 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b33739-41db-4da9-8bac-311979f90482 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:27.586622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a6912-27f3-4660-9756-1cfd917ca5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:27.587357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a6912-27f3-4660-9756-1cfd917ca5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.587645 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a6912-27f3-4660-9756-1cfd917ca5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.588000 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a6912-27f3-4660-9756-1cfd917ca5d6 None admin] PATH_INFO: `/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.589326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a6912-27f3-4660-9756-1cfd917ca5d6 None admin] RBAC: Authorizing `identity:get_user(user_id=5c37b28fc7d64a6c86abaeae5a87cc16)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:27.590120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ac678-3dbb-485a-8020-ce959afd2a49 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:27.590953 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a6912-27f3-4660-9756-1cfd917ca5d6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:27.592774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 36/78] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:27 2022] GET /identity/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:27.593669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a6912-27f3-4660-9756-1cfd917ca5d6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:27.604473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:27.626171 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1752050-f797-4b34-b4fe-9ea18b9daf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:27.626799 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1752050-f797-4b34-b4fe-9ea18b9daf92 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.627075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1752050-f797-4b34-b4fe-9ea18b9daf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.627355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1752050-f797-4b34-b4fe-9ea18b9daf92 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.628071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1752050-f797-4b34-b4fe-9ea18b9daf92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:27.628401 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1752050-f797-4b34-b4fe-9ea18b9daf92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:27.629799 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1752050-f797-4b34-b4fe-9ea18b9daf92 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:27.639773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 43/79] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:39:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:27.640442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1752050-f797-4b34-b4fe-9ea18b9daf92 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:27.702295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a6912-27f3-4660-9756-1cfd917ca5d6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:27.739910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc3190-ebc3-488d-918a-6bc19632089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:27.740577 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc3190-ebc3-488d-918a-6bc19632089b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.740858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc3190-ebc3-488d-918a-6bc19632089b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.741137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc3190-ebc3-488d-918a-6bc19632089b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.742287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc3190-ebc3-488d-918a-6bc19632089b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:27.743031 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1752050-f797-4b34-b4fe-9ea18b9daf92 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:27.744452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc3190-ebc3-488d-918a-6bc19632089b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:27.746043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 37/80] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:27.748054 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc3190-ebc3-488d-918a-6bc19632089b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:27.757924 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:27.781232 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dce7f-3ad1-480e-9795-81b5533201f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:27.781857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dce7f-3ad1-480e-9795-81b5533201f1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.782144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dce7f-3ad1-480e-9795-81b5533201f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.782428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dce7f-3ad1-480e-9795-81b5533201f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.827293 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:27.852340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dce7f-3ad1-480e-9795-81b5533201f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:27.854348 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dce7f-3ad1-480e-9795-81b5533201f1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:27.855232 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc3190-ebc3-488d-918a-6bc19632089b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:27.890435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b95f4-bff1-42ac-8eeb-11cf5144348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:27.891083 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b95f4-bff1-42ac-8eeb-11cf5144348e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:27.891366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b95f4-bff1-42ac-8eeb-11cf5144348e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:27.891643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b95f4-bff1-42ac-8eeb-11cf5144348e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:27.904055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b95f4-bff1-42ac-8eeb-11cf5144348e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-602b95f4-bff1-42ac-8eeb-11cf5144348e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:27.913788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:27.914712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:27.915986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:27.915986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:27.915986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:27.915986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:27.915986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:27.915986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:27.915986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:27.915986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:27.915986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:27.915986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:27.915986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:27.915986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:27.916998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 38/81] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:27.917461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b95f4-bff1-42ac-8eeb-11cf5144348e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:27.971648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 44/82] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:27.977718 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dce7f-3ad1-480e-9795-81b5533201f1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:27.995502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:28.027534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b95f4-bff1-42ac-8eeb-11cf5144348e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:28.062721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf203d1-298e-4e53-a906-12f2268e9fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:28.063343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf203d1-298e-4e53-a906-12f2268e9fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:28.063624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf203d1-298e-4e53-a906-12f2268e9fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:28.063899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf203d1-298e-4e53-a906-12f2268e9fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:28.066700 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:28.082680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dce7f-3ad1-480e-9795-81b5533201f1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:28.117760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07ee31-0614-482d-a044-0e7cce7b27bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:28.118336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07ee31-0614-482d-a044-0e7cce7b27bc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:28.118676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07ee31-0614-482d-a044-0e7cce7b27bc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:28.118980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07ee31-0614-482d-a044-0e7cce7b27bc None admin] PATH_INFO: `/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:28.120299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07ee31-0614-482d-a044-0e7cce7b27bc None admin] RBAC: Authorizing `identity:get_user(user_id=6ac1f63a2d744ed6af882ae350d0cdfd)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:28.121884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07ee31-0614-482d-a044-0e7cce7b27bc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:28.123606 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 45/83] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:27 2022] GET /identity/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:28.124433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07ee31-0614-482d-a044-0e7cce7b27bc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:28.137702 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf203d1-298e-4e53-a906-12f2268e9fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:28.139540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf203d1-298e-4e53-a906-12f2268e9fb6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:28.205362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:28.224766 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07ee31-0614-482d-a044-0e7cce7b27bc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:28.243348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 39/84] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:28.244250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf203d1-298e-4e53-a906-12f2268e9fb6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:28.265264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c09264-10b7-49c1-b736-7880154ea10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:28.265899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c09264-10b7-49c1-b736-7880154ea10a None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:28.266181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c09264-10b7-49c1-b736-7880154ea10a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:28.266468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c09264-10b7-49c1-b736-7880154ea10a None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:28.267154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c09264-10b7-49c1-b736-7880154ea10a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:28.268713 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c09264-10b7-49c1-b736-7880154ea10a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:28.276845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:28.291861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 46/85] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:39:28 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:39:28.292777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c09264-10b7-49c1-b736-7880154ea10a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:28.361822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf203d1-298e-4e53-a906-12f2268e9fb6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:28.405416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b43b9a-bf83-461f-a443-3331366b2761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:28.405987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b43b9a-bf83-461f-a443-3331366b2761 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:28.406274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b43b9a-bf83-461f-a443-3331366b2761 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:28.406554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b43b9a-bf83-461f-a443-3331366b2761 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:28.407291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b43b9a-bf83-461f-a443-3331366b2761 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:28.407607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b43b9a-bf83-461f-a443-3331366b2761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:28.409094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b43b9a-bf83-461f-a443-3331366b2761 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:28.418372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 40/86] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:28.419260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b43b9a-bf83-461f-a443-3331366b2761 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:28.420687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c09264-10b7-49c1-b736-7880154ea10a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:28.462846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cf069-bfa6-44f4-8a45-62ac1b239e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:28.466415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cf069-bfa6-44f4-8a45-62ac1b239e52 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:28.466415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cf069-bfa6-44f4-8a45-62ac1b239e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:28.466415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cf069-bfa6-44f4-8a45-62ac1b239e52 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:28.467745 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cf069-bfa6-44f4-8a45-62ac1b239e52 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:28.470276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cf069-bfa6-44f4-8a45-62ac1b239e52 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:28.473215 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 47/87] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:28 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:28.474481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cf069-bfa6-44f4-8a45-62ac1b239e52 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:28.487650 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:28.552105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:28.562160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b43b9a-bf83-461f-a443-3331366b2761 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:28.604296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52f47b-7cf1-4d2a-8bb4-f2a2d510e127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:28.605676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52f47b-7cf1-4d2a-8bb4-f2a2d510e127 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:28.605676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52f47b-7cf1-4d2a-8bb4-f2a2d510e127 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:28.605676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52f47b-7cf1-4d2a-8bb4-f2a2d510e127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:28.613729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cf069-bfa6-44f4-8a45-62ac1b239e52 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:28.656882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128bec3-c2b7-4a37-8710-8ac581f6a3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:28.658261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128bec3-c2b7-4a37-8710-8ac581f6a3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:28.658261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128bec3-c2b7-4a37-8710-8ac581f6a3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:28.658261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128bec3-c2b7-4a37-8710-8ac581f6a3e1 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:28.659360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128bec3-c2b7-4a37-8710-8ac581f6a3e1 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:28.660891 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128bec3-c2b7-4a37-8710-8ac581f6a3e1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:28.662823 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 48/88] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:28 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:28.663407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128bec3-c2b7-4a37-8710-8ac581f6a3e1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:28.685591 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52f47b-7cf1-4d2a-8bb4-f2a2d510e127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:28.687255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52f47b-7cf1-4d2a-8bb4-f2a2d510e127 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:28.792083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:28.810153 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:28.819163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 41/89] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:28.825426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52f47b-7cf1-4d2a-8bb4-f2a2d510e127 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:28.835734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128bec3-c2b7-4a37-8710-8ac581f6a3e1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:28.872020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ff64c-3b77-4bc5-83ce-71920b1b9887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:28.872854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ff64c-3b77-4bc5-83ce-71920b1b9887 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:28.873211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ff64c-3b77-4bc5-83ce-71920b1b9887 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:28.873559 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ff64c-3b77-4bc5-83ce-71920b1b9887 None admin] PATH_INFO: `/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:28.874912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ff64c-3b77-4bc5-83ce-71920b1b9887 None admin] RBAC: Authorizing `identity:get_user(user_id=6ac1f63a2d744ed6af882ae350d0cdfd)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:28.876498 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ff64c-3b77-4bc5-83ce-71920b1b9887 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:28.878380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 49/90] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:28 2022] GET /identity/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:28.879106 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ff64c-3b77-4bc5-83ce-71920b1b9887 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:28.935592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52f47b-7cf1-4d2a-8bb4-f2a2d510e127 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:28.971225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c10fb-0ec0-48af-a1d4-323bb7289b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:28.972239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c10fb-0ec0-48af-a1d4-323bb7289b7f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:28.972666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c10fb-0ec0-48af-a1d4-323bb7289b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:28.973133 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c10fb-0ec0-48af-a1d4-323bb7289b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:28.974188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c10fb-0ec0-48af-a1d4-323bb7289b7f None admin] RBAC: Adding query filter params (role.id=ad3a96ed9c2944be914156fa1c4613af, scope.project.id=d7240a923ed848ce82516c291da74aea, user.id=6ac1f63a2d744ed6af882ae350d0cdfd) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:28.974761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c10fb-0ec0-48af-a1d4-323bb7289b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:28.976435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c10fb-0ec0-48af-a1d4-323bb7289b7f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:28.986472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 42/91] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:28 2022] GET /identity/v3/role_assignments?user.id=6ac1f63a2d744ed6af882ae350d0cdfd&scope.project.id=d7240a923ed848ce82516c291da74aea&role.id=ad3a96ed9c2944be914156fa1c4613af => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:28.987634 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c10fb-0ec0-48af-a1d4-323bb7289b7f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:29.001156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ff64c-3b77-4bc5-83ce-71920b1b9887 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:29.079830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fae0b7-9afa-4d7e-a412-a9719e162326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:29.080573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fae0b7-9afa-4d7e-a412-a9719e162326 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:29.080860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fae0b7-9afa-4d7e-a412-a9719e162326 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:29.081188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fae0b7-9afa-4d7e-a412-a9719e162326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:29.082006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fae0b7-9afa-4d7e-a412-a9719e162326 None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=d7240a923ed848ce82516c291da74aea, user.id=5c37b28fc7d64a6c86abaeae5a87cc16) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:29.082382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fae0b7-9afa-4d7e-a412-a9719e162326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:29.084223 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fae0b7-9afa-4d7e-a412-a9719e162326 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:29.096382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 50/92] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:28 2022] GET /identity/v3/role_assignments?user.id=5c37b28fc7d64a6c86abaeae5a87cc16&scope.project.id=d7240a923ed848ce82516c291da74aea&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:29.098102 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fae0b7-9afa-4d7e-a412-a9719e162326 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:29.127612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:29.146974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:29.278498 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c10fb-0ec0-48af-a1d4-323bb7289b7f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:29.296194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fae0b7-9afa-4d7e-a412-a9719e162326 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:29.333269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43a374-5ee6-4a59-bc8a-825b87d5aa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:29.334163 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43a374-5ee6-4a59-bc8a-825b87d5aa05 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:29.334452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43a374-5ee6-4a59-bc8a-825b87d5aa05 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:29.334737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43a374-5ee6-4a59-bc8a-825b87d5aa05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:29.352230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a81bc-ef1d-4909-abb9-6c0da8f90bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:29.353341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a81bc-ef1d-4909-abb9-6c0da8f90bed None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:29.353824 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a81bc-ef1d-4909-abb9-6c0da8f90bed None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:29.354321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a81bc-ef1d-4909-abb9-6c0da8f90bed None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:29.355925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a81bc-ef1d-4909-abb9-6c0da8f90bed None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:29.357594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a81bc-ef1d-4909-abb9-6c0da8f90bed None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:29.359934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 43/93] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:28 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:29.366322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a81bc-ef1d-4909-abb9-6c0da8f90bed None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:29.409986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43a374-5ee6-4a59-bc8a-825b87d5aa05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:29.411473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43a374-5ee6-4a59-bc8a-825b87d5aa05 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:29.424545 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:29.520265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a81bc-ef1d-4909-abb9-6c0da8f90bed None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:29.577750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:29.596902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b5876-6384-45f2-9bf0-b73d8497fd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:29.597842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b5876-6384-45f2-9bf0-b73d8497fd45 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:29.598338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b5876-6384-45f2-9bf0-b73d8497fd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:29.598806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b5876-6384-45f2-9bf0-b73d8497fd45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:29.599810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b5876-6384-45f2-9bf0-b73d8497fd45 None admin] RBAC: Adding query filter params (role.id=da75e75c3ada4bf1b93ec17d36ff9a0d, scope.project.id=d7240a923ed848ce82516c291da74aea, user.id=6ac1f63a2d744ed6af882ae350d0cdfd) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:29.600337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b5876-6384-45f2-9bf0-b73d8497fd45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:29.602002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b5876-6384-45f2-9bf0-b73d8497fd45 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:29.616008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 44/94] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:29 2022] GET /identity/v3/role_assignments?user.id=6ac1f63a2d744ed6af882ae350d0cdfd&scope.project.id=d7240a923ed848ce82516c291da74aea&role.id=da75e75c3ada4bf1b93ec17d36ff9a0d => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:29.628942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 51/95] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:29.637359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b5876-6384-45f2-9bf0-b73d8497fd45 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:29.780495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b5876-6384-45f2-9bf0-b73d8497fd45 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:29.826421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f9116-2c2c-4797-81d7-ec93a3af8920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:29.827334 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f9116-2c2c-4797-81d7-ec93a3af8920 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:29.827621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f9116-2c2c-4797-81d7-ec93a3af8920 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:29.827955 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f9116-2c2c-4797-81d7-ec93a3af8920 None admin] PATH_INFO: `/v3/projects/00f6d7a2c71b4e838a28f584cf15ed13` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:29.832933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f9116-2c2c-4797-81d7-ec93a3af8920 None admin] RBAC: Authorizing `identity:get_project(project_id=00f6d7a2c71b4e838a28f584cf15ed13)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:29.834691 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f9116-2c2c-4797-81d7-ec93a3af8920 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:29.836434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 45/96] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:29 2022] GET /identity/v3/projects/00f6d7a2c71b4e838a28f584cf15ed13 => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:29.843055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43a374-5ee6-4a59-bc8a-825b87d5aa05 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:29.960184 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43a374-5ee6-4a59-bc8a-825b87d5aa05 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:29.972433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:30.007989 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7c5d9-9d83-4579-a365-b55f4022851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:30.008641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7c5d9-9d83-4579-a365-b55f4022851e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:30.008925 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7c5d9-9d83-4579-a365-b55f4022851e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:30.009430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7c5d9-9d83-4579-a365-b55f4022851e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:30.010238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7c5d9-9d83-4579-a365-b55f4022851e None admin] RBAC: Adding query filter params (role.id=ad3a96ed9c2944be914156fa1c4613af, scope.project.id=00f6d7a2c71b4e838a28f584cf15ed13, user.id=6ac1f63a2d744ed6af882ae350d0cdfd) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:30.010550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7c5d9-9d83-4579-a365-b55f4022851e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:30.012000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7c5d9-9d83-4579-a365-b55f4022851e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:30.017988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 52/97] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:29 2022] GET /identity/v3/role_assignments?user.id=6ac1f63a2d744ed6af882ae350d0cdfd&scope.project.id=00f6d7a2c71b4e838a28f584cf15ed13&role.id=ad3a96ed9c2944be914156fa1c4613af => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:31.383242 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eace2-6890-45ba-a0a8-921b635d7dfe None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:31.383936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eace2-6890-45ba-a0a8-921b635d7dfe None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:31.383936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eace2-6890-45ba-a0a8-921b635d7dfe None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:31.385788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 46/98] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:31.391095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c238d-a687-436d-bd53-0ff95cfb6b53 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:31.391673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c238d-a687-436d-bd53-0ff95cfb6b53 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:31.391673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c238d-a687-436d-bd53-0ff95cfb6b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:31.417408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-832c238d-a687-436d-bd53-0ff95cfb6b53 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:31.418727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-832c238d-a687-436d-bd53-0ff95cfb6b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:31.452833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c514741-17ee-46c1-be3a-81f2dfe7ca86 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:31.453455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c514741-17ee-46c1-be3a-81f2dfe7ca86 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:31.453936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c514741-17ee-46c1-be3a-81f2dfe7ca86 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:31.455494 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 47/99] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:39:31.461455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8343db-c97e-4bf3-bdf1-6f2d8acccae0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:31.462023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8343db-c97e-4bf3-bdf1-6f2d8acccae0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:31.462548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8343db-c97e-4bf3-bdf1-6f2d8acccae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:31.505378 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9c8343db-c97e-4bf3-bdf1-6f2d8acccae0 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:31.507006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9c8343db-c97e-4bf3-bdf1-6f2d8acccae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:31.512150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 53/100] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:31.551688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c238d-a687-436d-bd53-0ff95cfb6b53 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:31.621130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:31.658065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 48/101] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:31.696231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8343db-c97e-4bf3-bdf1-6f2d8acccae0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:31.788327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:31.792972 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c238d-a687-436d-bd53-0ff95cfb6b53 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:31.870565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ebf39-1b88-4e0c-9fc6-cb496965bccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:31.871562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ebf39-1b88-4e0c-9fc6-cb496965bccd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:31.872025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ebf39-1b88-4e0c-9fc6-cb496965bccd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:31.872500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ebf39-1b88-4e0c-9fc6-cb496965bccd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:31.874864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ebf39-1b88-4e0c-9fc6-cb496965bccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:31.877286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ebf39-1b88-4e0c-9fc6-cb496965bccd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:31.880272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 54/102] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:31.887343 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ebf39-1b88-4e0c-9fc6-cb496965bccd None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:31.970422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8343db-c97e-4bf3-bdf1-6f2d8acccae0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:32.057255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ebf39-1b88-4e0c-9fc6-cb496965bccd None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:32.059636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0832d-c629-4faf-9d6b-b5f430216239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:32.060988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0832d-c629-4faf-9d6b-b5f430216239 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:32.060988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0832d-c629-4faf-9d6b-b5f430216239 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:32.060988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0832d-c629-4faf-9d6b-b5f430216239 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:32.079770 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0832d-c629-4faf-9d6b-b5f430216239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-30b0832d-c629-4faf-9d6b-b5f430216239 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:32.089620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:32.090560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:32.091337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:32.091337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:32.091337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:32.091337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:32.091337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:32.091337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:32.091337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:32.091337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:32.091337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:32.091337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:32.091337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:39:32.091337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:32.096491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 49/103] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:32.100505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0832d-c629-4faf-9d6b-b5f430216239 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:32.106060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927dac7-513d-447e-9ee5-f555c7603f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:32.107035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927dac7-513d-447e-9ee5-f555c7603f15 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:32.107662 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927dac7-513d-447e-9ee5-f555c7603f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:32.108490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927dac7-513d-447e-9ee5-f555c7603f15 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:32.109429 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927dac7-513d-447e-9ee5-f555c7603f15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:32.111301 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927dac7-513d-447e-9ee5-f555c7603f15 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:32.154972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:32.167970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 55/104] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:39:31 2022] POST /identity/v3/projects => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:39:32.214768 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0832d-c629-4faf-9d6b-b5f430216239 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:32.253178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5183f9-3a92-459d-94fa-798b06bd0fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:32.253735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5183f9-3a92-459d-94fa-798b06bd0fcf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:32.254022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5183f9-3a92-459d-94fa-798b06bd0fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:32.254349 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5183f9-3a92-459d-94fa-798b06bd0fcf None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:32.255093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5183f9-3a92-459d-94fa-798b06bd0fcf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:32.255408 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5183f9-3a92-459d-94fa-798b06bd0fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:32.256852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5183f9-3a92-459d-94fa-798b06bd0fcf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:32.267040 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 50/105] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:32.273012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927dac7-513d-447e-9ee5-f555c7603f15 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:32.303512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:32.419294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927dac7-513d-447e-9ee5-f555c7603f15 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:32.461509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4cb93-1c6d-48aa-9cfe-583844eba53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:32.462722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4cb93-1c6d-48aa-9cfe-583844eba53a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:32.463017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4cb93-1c6d-48aa-9cfe-583844eba53a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:32.463292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4cb93-1c6d-48aa-9cfe-583844eba53a None admin] PATH_INFO: `/v3/users/6076e862d82e4f6b92bc84116995df88` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:32.477787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4cb93-1c6d-48aa-9cfe-583844eba53a None admin] RBAC: Authorizing `identity:get_user(user_id=6076e862d82e4f6b92bc84116995df88)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:32.479326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4cb93-1c6d-48aa-9cfe-583844eba53a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:32.481078 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 56/106] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:32 2022] GET /identity/v3/users/6076e862d82e4f6b92bc84116995df88 => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:32.489366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5183f9-3a92-459d-94fa-798b06bd0fcf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:32.598277 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5183f9-3a92-459d-94fa-798b06bd0fcf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:32.616499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:32.635598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b47938-f47f-4fda-9879-3beba9b4e58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:32.636269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b47938-f47f-4fda-9879-3beba9b4e58a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:32.636559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b47938-f47f-4fda-9879-3beba9b4e58a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:32.636841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b47938-f47f-4fda-9879-3beba9b4e58a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:32.717303 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b47938-f47f-4fda-9879-3beba9b4e58a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:32.718991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b47938-f47f-4fda-9879-3beba9b4e58a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:32.834779 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 51/107] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:32.854194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4cb93-1c6d-48aa-9cfe-583844eba53a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:32.958485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:32.983462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4cb93-1c6d-48aa-9cfe-583844eba53a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:33.023237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d37f3c-8cdd-4779-b863-992646a10519 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:33.023668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d37f3c-8cdd-4779-b863-992646a10519 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:33.024080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d37f3c-8cdd-4779-b863-992646a10519 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:33.026339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 52/108] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:33.033541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ecbc-b44c-47ce-9e95-78d478837ce4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:33.033971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ecbc-b44c-47ce-9e95-78d478837ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:33.034454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ecbc-b44c-47ce-9e95-78d478837ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:33.062198 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ccc96-b69c-4e95-b0dd-117db1e288f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:33.062877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ccc96-b69c-4e95-b0dd-117db1e288f7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:33.063165 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ccc96-b69c-4e95-b0dd-117db1e288f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:33.063449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ccc96-b69c-4e95-b0dd-117db1e288f7 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:33.068956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ccc96-b69c-4e95-b0dd-117db1e288f7 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:33.073768 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ccc96-b69c-4e95-b0dd-117db1e288f7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:33.081456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 57/109] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:32 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:33.082527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3471ecbc-b44c-47ce-9e95-78d478837ce4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:33.084839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ccc96-b69c-4e95-b0dd-117db1e288f7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:33.085771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3471ecbc-b44c-47ce-9e95-78d478837ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:33.103861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:33.243470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 53/110] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:33.244787 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b64a-d844-485a-b5d5-12bff73c2c95 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:33.245021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b64a-d844-485a-b5d5-12bff73c2c95 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:33.245307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b64a-d844-485a-b5d5-12bff73c2c95 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:33.246694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 54/111] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:33.250433 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8974ba-51f5-45fc-978f-e99ccbe84321 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:33.250730 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8974ba-51f5-45fc-978f-e99ccbe84321 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:33.251012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8974ba-51f5-45fc-978f-e99ccbe84321 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:33.252291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 55/112] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:39:33.257266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c53b0d-ead8-4e45-bee4-e1ae23809242 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:33.257562 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c53b0d-ead8-4e45-bee4-e1ae23809242 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:33.257927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c53b0d-ead8-4e45-bee4-e1ae23809242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:33.294631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ccc96-b69c-4e95-b0dd-117db1e288f7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:33.297973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-01c53b0d-ead8-4e45-bee4-e1ae23809242 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:33.300019 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-01c53b0d-ead8-4e45-bee4-e1ae23809242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:33.332026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b70218-59be-4bb5-b301-ed2eaf670838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:33.332794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b70218-59be-4bb5-b301-ed2eaf670838 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:33.333148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b70218-59be-4bb5-b301-ed2eaf670838 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:33.333439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b70218-59be-4bb5-b301-ed2eaf670838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:33.334600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b70218-59be-4bb5-b301-ed2eaf670838 None admin] RBAC: Adding query filter params (role.id=6082d88564724bd586ad069364cb597b, scope.project.id=d7240a923ed848ce82516c291da74aea, user.id=6076e862d82e4f6b92bc84116995df88) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:33.334921 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b70218-59be-4bb5-b301-ed2eaf670838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:33.336400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b70218-59be-4bb5-b301-ed2eaf670838 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:33.342566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 58/113] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:33 2022] GET /identity/v3/role_assignments?user.id=6076e862d82e4f6b92bc84116995df88&scope.project.id=d7240a923ed848ce82516c291da74aea&role.id=6082d88564724bd586ad069364cb597b => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:33.343808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6f553-b024-4265-be74-85e727c95bee None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:33.344101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6f553-b024-4265-be74-85e727c95bee None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:33.344414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6f553-b024-4265-be74-85e727c95bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:33.364591 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-17e6f553-b024-4265-be74-85e727c95bee None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:33.366609 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-17e6f553-b024-4265-be74-85e727c95bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:33.370827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:33.468785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 56/114] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:33.470384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c53b0d-ead8-4e45-bee4-e1ae23809242 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:33.529780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 59/115] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:33.533707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6f553-b024-4265-be74-85e727c95bee None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:33.658016 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:33.690716 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c53b0d-ead8-4e45-bee4-e1ae23809242 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:33.700302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6f553-b024-4265-be74-85e727c95bee None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:33.740747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c6e96-ab21-4751-8b74-9d02600e3d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:33.741823 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c6e96-ab21-4751-8b74-9d02600e3d77 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:33.742460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c6e96-ab21-4751-8b74-9d02600e3d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:33.742947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c6e96-ab21-4751-8b74-9d02600e3d77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:33.757183 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d3ae0-5b04-4809-aedc-f2546bfc389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:33.758320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d3ae0-5b04-4809-aedc-f2546bfc389c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:33.758865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d3ae0-5b04-4809-aedc-f2546bfc389c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:33.759861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d3ae0-5b04-4809-aedc-f2546bfc389c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:33.762311 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c6e96-ab21-4751-8b74-9d02600e3d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:33.768832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:33.772671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d3ae0-5b04-4809-aedc-f2546bfc389c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f18c6e96-ab21-4751-8b74-9d02600e3d77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:33.773697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:33.774532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:33.775857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:33.775857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:33.775857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:33.775857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:33.775857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:33.775857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:33.775857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:33.775857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:33.775857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:33.775857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:33.775857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:33.775857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:33.776478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 57/116] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:33.782467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c6e96-ab21-4751-8b74-9d02600e3d77 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-191d3ae0-5b04-4809-aedc-f2546bfc389c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:33.788189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:33.789056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:33.789912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:33.789912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:33.789912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:33.789912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:33.789912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:33.789912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:33.789912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:33.789912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:33.789912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:33.789912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:33.789912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:39:33.789912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:33.790519 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 60/117] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:39:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:33.796162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab670d55-abec-4354-892a-3702b2e99503 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:33.796162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab670d55-abec-4354-892a-3702b2e99503 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:33.796162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab670d55-abec-4354-892a-3702b2e99503 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:33.802362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 61/118] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:33.803791 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab670d55-abec-4354-892a-3702b2e99503 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:33.928792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c6e96-ab21-4751-8b74-9d02600e3d77 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:33.964931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:33.970746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acc6b2-1630-4aad-9265-2de32e2a3768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:33.971718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acc6b2-1630-4aad-9265-2de32e2a3768 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:33.972246 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acc6b2-1630-4aad-9265-2de32e2a3768 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:33.972738 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acc6b2-1630-4aad-9265-2de32e2a3768 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:33.984689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acc6b2-1630-4aad-9265-2de32e2a3768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d4acc6b2-1630-4aad-9265-2de32e2a3768 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:33.990091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:33.991013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:33.991789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:33.991789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:33.991789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:33.991789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:33.991789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:33.991789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:33.991789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:33.991789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:33.991789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:33.991789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:33.991789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:33.991789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:33.994203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 58/119] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:33.995287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acc6b2-1630-4aad-9265-2de32e2a3768 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:34.032952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab670d55-abec-4354-892a-3702b2e99503 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:34.101718 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca74a2-1eb8-4851-a814-692fb50caf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:34.103402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca74a2-1eb8-4851-a814-692fb50caf51 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:34.103521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca74a2-1eb8-4851-a814-692fb50caf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:34.104077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca74a2-1eb8-4851-a814-692fb50caf51 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:34.105590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca74a2-1eb8-4851-a814-692fb50caf51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:34.106113 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca74a2-1eb8-4851-a814-692fb50caf51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:34.108842 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca74a2-1eb8-4851-a814-692fb50caf51 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:34.123336 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acc6b2-1630-4aad-9265-2de32e2a3768 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:34.126773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 62/120] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:34.128826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc97c0-dbeb-4505-a6b4-163c1099c9f2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:34.129442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc97c0-dbeb-4505-a6b4-163c1099c9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:34.129934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc97c0-dbeb-4505-a6b4-163c1099c9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:34.161694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58350bb-f444-4724-8b2e-6d3242ca6c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:34.162378 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7ebc97c0-dbeb-4505-a6b4-163c1099c9f2 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:34.162916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58350bb-f444-4724-8b2e-6d3242ca6c4f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:34.163404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58350bb-f444-4724-8b2e-6d3242ca6c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:34.163893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58350bb-f444-4724-8b2e-6d3242ca6c4f None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:34.164543 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7ebc97c0-dbeb-4505-a6b4-163c1099c9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:34.165088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58350bb-f444-4724-8b2e-6d3242ca6c4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:34.165644 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58350bb-f444-4724-8b2e-6d3242ca6c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:34.167243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58350bb-f444-4724-8b2e-6d3242ca6c4f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:34.177099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 59/121] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:39:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:34.178231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58350bb-f444-4724-8b2e-6d3242ca6c4f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:34.240092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:34.270319 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:34.292384 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 63/122] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:34.294086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc97c0-dbeb-4505-a6b4-163c1099c9f2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:34.340533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58350bb-f444-4724-8b2e-6d3242ca6c4f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:34.411197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbb289-0c75-4a7e-b697-835e3fb7ef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:34.412198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbb289-0c75-4a7e-b697-835e3fb7ef70 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:34.413060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbb289-0c75-4a7e-b697-835e3fb7ef70 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:34.413229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbb289-0c75-4a7e-b697-835e3fb7ef70 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:34.414392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbb289-0c75-4a7e-b697-835e3fb7ef70 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:34.415015 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbb289-0c75-4a7e-b697-835e3fb7ef70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:34.418117 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbb289-0c75-4a7e-b697-835e3fb7ef70 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:34.433703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 60/123] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:34.435008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbb289-0c75-4a7e-b697-835e3fb7ef70 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:34.503519 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc97c0-dbeb-4505-a6b4-163c1099c9f2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:34.566436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27db5-842d-43e5-b4d2-7f2bc533e92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:34.567397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27db5-842d-43e5-b4d2-7f2bc533e92b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:34.567827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27db5-842d-43e5-b4d2-7f2bc533e92b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:34.568349 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27db5-842d-43e5-b4d2-7f2bc533e92b None admin] PATH_INFO: `/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:34.570311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa27db5-842d-43e5-b4d2-7f2bc533e92b None admin] RBAC: Authorizing `identity:get_user(user_id=5c37b28fc7d64a6c86abaeae5a87cc16)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:34.572988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa27db5-842d-43e5-b4d2-7f2bc533e92b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:34.575746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 64/124] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:34 2022] GET /identity/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16 => generated 247 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:34.577133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27db5-842d-43e5-b4d2-7f2bc533e92b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:34.625198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbb289-0c75-4a7e-b697-835e3fb7ef70 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:34.658742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:34.676658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:34.700829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c9726-2caa-4e73-ae5e-cc2e80c3f659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:34.702386 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c9726-2caa-4e73-ae5e-cc2e80c3f659 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:34.703059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c9726-2caa-4e73-ae5e-cc2e80c3f659 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:34.703703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c9726-2caa-4e73-ae5e-cc2e80c3f659 None admin] PATH_INFO: `/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:34.705879 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c9726-2caa-4e73-ae5e-cc2e80c3f659 None admin] RBAC: Authorizing `identity:get_user(user_id=6ac1f63a2d744ed6af882ae350d0cdfd)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:34.709568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c9726-2caa-4e73-ae5e-cc2e80c3f659 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:34.713546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 61/125] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:34 2022] GET /identity/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:34.715137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c9726-2caa-4e73-ae5e-cc2e80c3f659 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:34.761720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27db5-842d-43e5-b4d2-7f2bc533e92b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:34.832630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75ae85-c1d7-4d97-8870-a6c5cd9b138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:34.834129 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75ae85-c1d7-4d97-8870-a6c5cd9b138e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:34.834607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75ae85-c1d7-4d97-8870-a6c5cd9b138e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:34.835081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75ae85-c1d7-4d97-8870-a6c5cd9b138e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:34.858668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75ae85-c1d7-4d97-8870-a6c5cd9b138e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-8e75ae85-c1d7-4d97-8870-a6c5cd9b138e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:34.869760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:34.870710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:34.871485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:34.871485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:34.871485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:34.871485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:34.871485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:34.871485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:34.871485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:34.871485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:34.871485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:34.871485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:34.871485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:34.871485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:34.872830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 65/126] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:34.876178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75ae85-c1d7-4d97-8870-a6c5cd9b138e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:34.918483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c9726-2caa-4e73-ae5e-cc2e80c3f659 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:34.992955 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717dbb8-b226-4720-aa53-faf2307c5656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:34.994743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717dbb8-b226-4720-aa53-faf2307c5656 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:34.995280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717dbb8-b226-4720-aa53-faf2307c5656 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:34.995835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717dbb8-b226-4720-aa53-faf2307c5656 None admin] PATH_INFO: `/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:34.998147 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717dbb8-b226-4720-aa53-faf2307c5656 None admin] RBAC: Authorizing `identity:get_user(user_id=6ac1f63a2d744ed6af882ae350d0cdfd)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:35.001984 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717dbb8-b226-4720-aa53-faf2307c5656 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:35.004793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 62/127] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:34 2022] GET /identity/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:35.006149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717dbb8-b226-4720-aa53-faf2307c5656 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:35.049938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75ae85-c1d7-4d97-8870-a6c5cd9b138e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:35.083408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:35.093559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:35.106589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49824586-51cc-4bd2-b476-85ed44aa7ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:35.107611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49824586-51cc-4bd2-b476-85ed44aa7ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:35.108306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49824586-51cc-4bd2-b476-85ed44aa7ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:35.108773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49824586-51cc-4bd2-b476-85ed44aa7ee2 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:35.110632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49824586-51cc-4bd2-b476-85ed44aa7ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:35.113187 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49824586-51cc-4bd2-b476-85ed44aa7ee2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:35.116052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 66/128] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:34 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:35.117241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49824586-51cc-4bd2-b476-85ed44aa7ee2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:35.174640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717dbb8-b226-4720-aa53-faf2307c5656 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:35.231320 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d786fb-df3e-4ca9-956c-349317954998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:35.232421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d786fb-df3e-4ca9-956c-349317954998 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:35.232880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d786fb-df3e-4ca9-956c-349317954998 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:35.233392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d786fb-df3e-4ca9-956c-349317954998 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:35.235675 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d786fb-df3e-4ca9-956c-349317954998 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:35.238663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d786fb-df3e-4ca9-956c-349317954998 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:35.242360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 63/129] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:35 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:35.244849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d786fb-df3e-4ca9-956c-349317954998 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:35.270931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49824586-51cc-4bd2-b476-85ed44aa7ee2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:35.314515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14171247-a922-4efc-a871-b7acb0aad0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:35.315462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14171247-a922-4efc-a871-b7acb0aad0de None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:35.315870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14171247-a922-4efc-a871-b7acb0aad0de None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:35.316310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14171247-a922-4efc-a871-b7acb0aad0de None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:35.317281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14171247-a922-4efc-a871-b7acb0aad0de None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:35.317814 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14171247-a922-4efc-a871-b7acb0aad0de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:35.319652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14171247-a922-4efc-a871-b7acb0aad0de None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:35.331272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 67/130] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:35.336041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9674966-498f-4663-9418-d07d4999b337 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:35.337488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9674966-498f-4663-9418-d07d4999b337 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:35.338483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9674966-498f-4663-9418-d07d4999b337 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:35.340346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 68/131] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:35.342141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9674966-498f-4663-9418-d07d4999b337 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:35.360461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d786fb-df3e-4ca9-956c-349317954998 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:35.381842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:35.403709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db49e7-da5f-4834-b913-ce31d2a579ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:35.404447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db49e7-da5f-4834-b913-ce31d2a579ac None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:35.404743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db49e7-da5f-4834-b913-ce31d2a579ac None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:35.405023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db49e7-da5f-4834-b913-ce31d2a579ac None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:35.406192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db49e7-da5f-4834-b913-ce31d2a579ac None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:35.407773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db49e7-da5f-4834-b913-ce31d2a579ac None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:35.409632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 64/132] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:35 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:35.410451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db49e7-da5f-4834-b913-ce31d2a579ac None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:35.430320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:35.498132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9674966-498f-4663-9418-d07d4999b337 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:35.535083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ab30a-5679-4a3e-9e56-66cfbd839325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:35.535766 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ab30a-5679-4a3e-9e56-66cfbd839325 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:35.536050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ab30a-5679-4a3e-9e56-66cfbd839325 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:35.536377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ab30a-5679-4a3e-9e56-66cfbd839325 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea/users/5c37b28fc7d64a6c86abaeae5a87cc16/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:35.538334 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ab30a-5679-4a3e-9e56-66cfbd839325 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7240a923ed848ce82516c291da74aea, user_id=5c37b28fc7d64a6c86abaeae5a87cc16, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:35.539794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ab30a-5679-4a3e-9e56-66cfbd839325 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:35.552834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 69/133] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:39:35 2022] PUT /identity/v3/projects/d7240a923ed848ce82516c291da74aea/users/5c37b28fc7d64a6c86abaeae5a87cc16/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:39:35.560440 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ab30a-5679-4a3e-9e56-66cfbd839325 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:35.572752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db49e7-da5f-4834-b913-ce31d2a579ac None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:35.638894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60e3dc-fd1b-418c-8f19-04fe17235bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:35.640272 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60e3dc-fd1b-418c-8f19-04fe17235bf5 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:35.640737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60e3dc-fd1b-418c-8f19-04fe17235bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:35.641263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60e3dc-fd1b-418c-8f19-04fe17235bf5 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea/users/6ac1f63a2d744ed6af882ae350d0cdfd/roles/da75e75c3ada4bf1b93ec17d36ff9a0d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:35.645026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60e3dc-fd1b-418c-8f19-04fe17235bf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7240a923ed848ce82516c291da74aea, user_id=6ac1f63a2d744ed6af882ae350d0cdfd, role_id=da75e75c3ada4bf1b93ec17d36ff9a0d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:35.647466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60e3dc-fd1b-418c-8f19-04fe17235bf5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:35.691659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 65/134] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:39:35 2022] PUT /identity/v3/projects/d7240a923ed848ce82516c291da74aea/users/6ac1f63a2d744ed6af882ae350d0cdfd/roles/da75e75c3ada4bf1b93ec17d36ff9a0d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:39:35.698547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220f16c-79e6-43a9-a85c-f0aeabb63840 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:35.699010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220f16c-79e6-43a9-a85c-f0aeabb63840 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:35.699463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220f16c-79e6-43a9-a85c-f0aeabb63840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:35.751656 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9220f16c-79e6-43a9-a85c-f0aeabb63840 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:35.753241 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9220f16c-79e6-43a9-a85c-f0aeabb63840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:35.863185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:35.919414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ab30a-5679-4a3e-9e56-66cfbd839325 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:35.934079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 66/135] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:35.935435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220f16c-79e6-43a9-a85c-f0aeabb63840 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:35.967558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:36.061417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dead35f-ebb6-42b9-bc31-2a36208c0df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:36.062525 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dead35f-ebb6-42b9-bc31-2a36208c0df8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:36.063105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dead35f-ebb6-42b9-bc31-2a36208c0df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:36.064651 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dead35f-ebb6-42b9-bc31-2a36208c0df8 None admin] PATH_INFO: `/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:36.072153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dead35f-ebb6-42b9-bc31-2a36208c0df8 None admin] RBAC: Authorizing `identity:get_user(user_id=6ac1f63a2d744ed6af882ae350d0cdfd)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:36.072153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dead35f-ebb6-42b9-bc31-2a36208c0df8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:36.074059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 70/136] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:35 2022] GET /identity/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd => generated 275 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:36.075384 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dead35f-ebb6-42b9-bc31-2a36208c0df8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:36.141608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220f16c-79e6-43a9-a85c-f0aeabb63840 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:36.231982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5eef0-9970-4091-aa0f-cf6cc129599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:36.233290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5eef0-9970-4091-aa0f-cf6cc129599e None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:36.233789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5eef0-9970-4091-aa0f-cf6cc129599e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:36.234281 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5eef0-9970-4091-aa0f-cf6cc129599e None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea/users/6ac1f63a2d744ed6af882ae350d0cdfd/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:36.244152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5eef0-9970-4091-aa0f-cf6cc129599e None admin] RBAC: Authorizing `identity:create_grant(project_id=d7240a923ed848ce82516c291da74aea, user_id=6ac1f63a2d744ed6af882ae350d0cdfd, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:36.253210 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5eef0-9970-4091-aa0f-cf6cc129599e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:36.261064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dead35f-ebb6-42b9-bc31-2a36208c0df8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:36.301658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c4341-1c24-4968-b622-007d68862c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:36.302319 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c4341-1c24-4968-b622-007d68862c0d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:36.302667 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c4341-1c24-4968-b622-007d68862c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:36.308144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c4341-1c24-4968-b622-007d68862c0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:36.308144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c4341-1c24-4968-b622-007d68862c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:36.308144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c4341-1c24-4968-b622-007d68862c0d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:36.316208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 71/138] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:36.316208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199bca9-7736-40fe-9947-70f5a8a284e4 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:36.316208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199bca9-7736-40fe-9947-70f5a8a284e4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:36.316208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199bca9-7736-40fe-9947-70f5a8a284e4 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:36.316208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 72/139] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:36.316636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 67/139] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:39:35 2022] PUT /identity/v3/projects/d7240a923ed848ce82516c291da74aea/users/6ac1f63a2d744ed6af882ae350d0cdfd/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:39:36.320145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199bca9-7736-40fe-9947-70f5a8a284e4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:36.326752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5eef0-9970-4091-aa0f-cf6cc129599e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:36.408149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:36.432277 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:36.495211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199bca9-7736-40fe-9947-70f5a8a284e4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:36.533713 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531a7b1-30f9-4635-84d6-d6fca481aa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:36.534375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531a7b1-30f9-4635-84d6-d6fca481aa4f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:36.534663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531a7b1-30f9-4635-84d6-d6fca481aa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:36.534941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531a7b1-30f9-4635-84d6-d6fca481aa4f None admin] PATH_INFO: `/v3/projects/00f6d7a2c71b4e838a28f584cf15ed13` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:36.536270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531a7b1-30f9-4635-84d6-d6fca481aa4f None admin] RBAC: Authorizing `identity:get_project(project_id=00f6d7a2c71b4e838a28f584cf15ed13)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:36.537890 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531a7b1-30f9-4635-84d6-d6fca481aa4f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:36.540024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 73/140] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:36 2022] GET /identity/v3/projects/00f6d7a2c71b4e838a28f584cf15ed13 => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:36.541889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5f2dc-5cbf-42c6-a4f7-84a4bcc7be47 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:36.547333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5f2dc-5cbf-42c6-a4f7-84a4bcc7be47 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:36.547619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5f2dc-5cbf-42c6-a4f7-84a4bcc7be47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:36.568568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f3b5f2dc-5cbf-42c6-a4f7-84a4bcc7be47 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:36.569856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f3b5f2dc-5cbf-42c6-a4f7-84a4bcc7be47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:36.635292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5eef0-9970-4091-aa0f-cf6cc129599e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:36.661090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 74/141] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:36.661953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5f2dc-5cbf-42c6-a4f7-84a4bcc7be47 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:36.700718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e9f49-2693-4e4a-8426-f2b5b9bdcc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:36.701770 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e9f49-2693-4e4a-8426-f2b5b9bdcc38 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:36.702497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e9f49-2693-4e4a-8426-f2b5b9bdcc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:36.702975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e9f49-2693-4e4a-8426-f2b5b9bdcc38 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:36.704252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e9f49-2693-4e4a-8426-f2b5b9bdcc38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:36.706842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e9f49-2693-4e4a-8426-f2b5b9bdcc38 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:36.716710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:36.769893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 68/142] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:39:36 2022] POST /identity/v3/users => generated 283 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:39:36.775187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e9f49-2693-4e4a-8426-f2b5b9bdcc38 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:36.783217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5f2dc-5cbf-42c6-a4f7-84a4bcc7be47 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:36.872988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf671c-186b-4824-a0a6-74c5b496b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:36.874158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf671c-186b-4824-a0a6-74c5b496b337 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:36.874685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf671c-186b-4824-a0a6-74c5b496b337 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:36.875180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf671c-186b-4824-a0a6-74c5b496b337 None admin] PATH_INFO: `/v3/projects/00f6d7a2c71b4e838a28f584cf15ed13/users/6ac1f63a2d744ed6af882ae350d0cdfd/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:36.887001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf671c-186b-4824-a0a6-74c5b496b337 None admin] RBAC: Authorizing `identity:create_grant(project_id=00f6d7a2c71b4e838a28f584cf15ed13, user_id=6ac1f63a2d744ed6af882ae350d0cdfd, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:36.889759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf671c-186b-4824-a0a6-74c5b496b337 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:36.939211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 75/143] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:39:36 2022] PUT /identity/v3/projects/00f6d7a2c71b4e838a28f584cf15ed13/users/6ac1f63a2d744ed6af882ae350d0cdfd/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:39:37.043660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:37.057119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e9f49-2693-4e4a-8426-f2b5b9bdcc38 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:37.125276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11e471-df4b-44db-9a0c-244afda60ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:37.126351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11e471-df4b-44db-9a0c-244afda60ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:37.126834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11e471-df4b-44db-9a0c-244afda60ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:37.127319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11e471-df4b-44db-9a0c-244afda60ec4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:37.148092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11e471-df4b-44db-9a0c-244afda60ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-ce11e471-df4b-44db-9a0c-244afda60ec4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:37.159563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:37.160535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:37.161289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:37.161289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:37.161289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:37.161289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:37.161289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:37.161289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:37.161289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:37.161289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:37.161289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:37.161289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:37.161289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:39:37.161289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:37.161874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 69/144] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:37.169832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf671c-186b-4824-a0a6-74c5b496b337 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:37.343868 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf671c-186b-4824-a0a6-74c5b496b337 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:37.348151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:37.423024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ef19e-d5cf-4abe-b73b-e7d265fb91fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:37.424056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ef19e-d5cf-4abe-b73b-e7d265fb91fb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:37.424568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ef19e-d5cf-4abe-b73b-e7d265fb91fb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:37.425041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ef19e-d5cf-4abe-b73b-e7d265fb91fb None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:37.426319 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ef19e-d5cf-4abe-b73b-e7d265fb91fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:37.426858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ef19e-d5cf-4abe-b73b-e7d265fb91fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:37.429428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ef19e-d5cf-4abe-b73b-e7d265fb91fb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:37.450231 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 76/145] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:37.458103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11e471-df4b-44db-9a0c-244afda60ec4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:37.703982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11e471-df4b-44db-9a0c-244afda60ec4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:37.778732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c48233-eb95-44e7-84e7-f532cf70a2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:37.779833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c48233-eb95-44e7-84e7-f532cf70a2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:37.780359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c48233-eb95-44e7-84e7-f532cf70a2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:37.780861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c48233-eb95-44e7-84e7-f532cf70a2f6 None admin] PATH_INFO: `/v3/users/6076e862d82e4f6b92bc84116995df88` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:37.782965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c48233-eb95-44e7-84e7-f532cf70a2f6 None admin] RBAC: Authorizing `identity:get_user(user_id=6076e862d82e4f6b92bc84116995df88)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:37.785663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c48233-eb95-44e7-84e7-f532cf70a2f6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:37.788585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 70/146] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:37 2022] GET /identity/v3/users/6076e862d82e4f6b92bc84116995df88 => generated 289 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:37.797831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ef19e-d5cf-4abe-b73b-e7d265fb91fb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:38.046200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ef19e-d5cf-4abe-b73b-e7d265fb91fb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:38.121854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4476663-279b-4531-9643-1a4453ac5e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:38.122945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4476663-279b-4531-9643-1a4453ac5e84 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:38.123446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4476663-279b-4531-9643-1a4453ac5e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:38.123945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4476663-279b-4531-9643-1a4453ac5e84 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:38.129342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4476663-279b-4531-9643-1a4453ac5e84 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:38.132088 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4476663-279b-4531-9643-1a4453ac5e84 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:38.135830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 77/147] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:37 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:38.142062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c48233-eb95-44e7-84e7-f532cf70a2f6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:38.220485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:38.386279 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c48233-eb95-44e7-84e7-f532cf70a2f6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:38.456226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8134d6-f235-4080-a260-1800639e596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:38.457490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8134d6-f235-4080-a260-1800639e596d None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:38.458091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8134d6-f235-4080-a260-1800639e596d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:38.458578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8134d6-f235-4080-a260-1800639e596d None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea/users/6076e862d82e4f6b92bc84116995df88/roles/6082d88564724bd586ad069364cb597b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:38.462299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8134d6-f235-4080-a260-1800639e596d None admin] RBAC: Authorizing `identity:create_grant(project_id=d7240a923ed848ce82516c291da74aea, user_id=6076e862d82e4f6b92bc84116995df88, role_id=6082d88564724bd586ad069364cb597b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:38.465011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8134d6-f235-4080-a260-1800639e596d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:38.500451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 71/148] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:39:38 2022] PUT /identity/v3/projects/d7240a923ed848ce82516c291da74aea/users/6076e862d82e4f6b92bc84116995df88/roles/6082d88564724bd586ad069364cb597b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:39:39.456113 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b1ad6-5c8a-4fe8-9a8a-cebd21b2b7ab None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:39.456679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b1ad6-5c8a-4fe8-9a8a-cebd21b2b7ab None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:39.457071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b1ad6-5c8a-4fe8-9a8a-cebd21b2b7ab None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:39.459769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 78/149] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:39.466846 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5b910-7d9f-4d14-8cd8-08a45a49609b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:39.467345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5b910-7d9f-4d14-8cd8-08a45a49609b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:39.467858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5b910-7d9f-4d14-8cd8-08a45a49609b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:39.505660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-55e5b910-7d9f-4d14-8cd8-08a45a49609b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:39.507687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-55e5b910-7d9f-4d14-8cd8-08a45a49609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:39.668002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 72/150] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:39.705871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b1ad6-5c8a-4fe8-9a8a-cebd21b2b7ab None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:39.781443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:39.903958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b1ad6-5c8a-4fe8-9a8a-cebd21b2b7ab None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:39.949882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23cce5-f949-4ff7-b416-98f6abc9cd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:39.950587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23cce5-f949-4ff7-b416-98f6abc9cd6c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:39.950876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23cce5-f949-4ff7-b416-98f6abc9cd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:39.951163 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23cce5-f949-4ff7-b416-98f6abc9cd6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:39.966165 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23cce5-f949-4ff7-b416-98f6abc9cd6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-0d23cce5-f949-4ff7-b416-98f6abc9cd6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:39.971858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:39.972749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:39.973509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 79/151] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:39.981927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5b910-7d9f-4d14-8cd8-08a45a49609b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:40.032621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:40.238619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5b910-7d9f-4d14-8cd8-08a45a49609b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:40.313100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef9fc2-4c1d-4768-95e0-dd10c4be4a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:40.314147 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef9fc2-4c1d-4768-95e0-dd10c4be4a6b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:40.314638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef9fc2-4c1d-4768-95e0-dd10c4be4a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:40.315088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef9fc2-4c1d-4768-95e0-dd10c4be4a6b None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:40.316346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef9fc2-4c1d-4768-95e0-dd10c4be4a6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:40.316817 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef9fc2-4c1d-4768-95e0-dd10c4be4a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:40.319068 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef9fc2-4c1d-4768-95e0-dd10c4be4a6b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:40.337485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 73/152] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:40.343457 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23cce5-f949-4ff7-b416-98f6abc9cd6c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:40.505084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:40.513757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23cce5-f949-4ff7-b416-98f6abc9cd6c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:40.534082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37721da-902e-495b-a452-489344dfa48c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:40.535468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37721da-902e-495b-a452-489344dfa48c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:40.540451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37721da-902e-495b-a452-489344dfa48c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:40.543503 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 74/153] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:39:40.552080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3199b3-42b9-4169-8fdc-a4b0b2458b70 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:40.552932 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3199b3-42b9-4169-8fdc-a4b0b2458b70 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:40.553610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3199b3-42b9-4169-8fdc-a4b0b2458b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:40.557733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757fec6-292a-4ab4-a79a-14908a4fe02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:40.558734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757fec6-292a-4ab4-a79a-14908a4fe02b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:40.559154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757fec6-292a-4ab4-a79a-14908a4fe02b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:40.559568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757fec6-292a-4ab4-a79a-14908a4fe02b None admin] PATH_INFO: `/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:40.560947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757fec6-292a-4ab4-a79a-14908a4fe02b None admin] RBAC: Authorizing `identity:get_user(user_id=5c37b28fc7d64a6c86abaeae5a87cc16)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:40.562600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757fec6-292a-4ab4-a79a-14908a4fe02b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:40.564878 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 80/154] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:40 2022] GET /identity/v3/users/5c37b28fc7d64a6c86abaeae5a87cc16 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:40.573754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757fec6-292a-4ab4-a79a-14908a4fe02b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:40.613991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1e3199b3-42b9-4169-8fdc-a4b0b2458b70 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:40.616723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1e3199b3-42b9-4169-8fdc-a4b0b2458b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:40.790246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757fec6-292a-4ab4-a79a-14908a4fe02b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:40.842980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 75/155] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:40.844423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4c6a5-4463-4bcc-8827-ef7d3558d58b None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:40.844714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4c6a5-4463-4bcc-8827-ef7d3558d58b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:40.845169 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4c6a5-4463-4bcc-8827-ef7d3558d58b None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:40.846825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 76/156] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:40.852686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2af75-6513-49dd-be15-e215fe28047f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:40.853190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2af75-6513-49dd-be15-e215fe28047f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:40.853412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0380c1-9b14-467f-b48d-25a20bf6e98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:40.853929 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2af75-6513-49dd-be15-e215fe28047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:40.854154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0380c1-9b14-467f-b48d-25a20bf6e98d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:40.854431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0380c1-9b14-467f-b48d-25a20bf6e98d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:40.854704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0380c1-9b14-467f-b48d-25a20bf6e98d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:40.872670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:40.881014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c1e2af75-6513-49dd-be15-e215fe28047f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:40.888150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c1e2af75-6513-49dd-be15-e215fe28047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:40.907052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:41.014290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0380c1-9b14-467f-b48d-25a20bf6e98d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:41.015794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0380c1-9b14-467f-b48d-25a20bf6e98d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:41.074485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 77/157] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:41.075801 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2af75-6513-49dd-be15-e215fe28047f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:41.263959 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 81/158] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:41.264799 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0380c1-9b14-467f-b48d-25a20bf6e98d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:41.277871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2af75-6513-49dd-be15-e215fe28047f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:41.362563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6532761-48e0-45b0-bd76-83f848af1386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:41.363229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532761-48e0-45b0-bd76-83f848af1386 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:41.363511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532761-48e0-45b0-bd76-83f848af1386 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:41.363785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532761-48e0-45b0-bd76-83f848af1386 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:41.370755 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:41.389564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6532761-48e0-45b0-bd76-83f848af1386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b6532761-48e0-45b0-bd76-83f848af1386 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:41.400215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:41.401224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:41.401967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 78/159] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:39:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:41.404527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20375a-3695-4708-938e-c4e168a8bfd6 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:41.404527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20375a-3695-4708-938e-c4e168a8bfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:41.405239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20375a-3695-4708-938e-c4e168a8bfd6 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:41.406608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 79/160] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:41.407367 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20375a-3695-4708-938e-c4e168a8bfd6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:41.443527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:41.566217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0380c1-9b14-467f-b48d-25a20bf6e98d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:41.652907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625003ca-bf96-4eb3-9c7a-382c329f9579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:41.653589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625003ca-bf96-4eb3-9c7a-382c329f9579 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:41.653875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625003ca-bf96-4eb3-9c7a-382c329f9579 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:41.654151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625003ca-bf96-4eb3-9c7a-382c329f9579 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:41.684871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625003ca-bf96-4eb3-9c7a-382c329f9579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-625003ca-bf96-4eb3-9c7a-382c329f9579 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:41.690339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:41.691292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:41.692063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:41.692063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:41.692063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:41.692063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:41.692063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:41.692063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:41.692063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:41.692063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:41.692063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:41.692063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:41.692063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:41.692063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:41.694578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 82/161] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:41.695632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625003ca-bf96-4eb3-9c7a-382c329f9579 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:41.700880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20375a-3695-4708-938e-c4e168a8bfd6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:41.762001 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0e72a-da2e-4d9f-8aa4-bde5fae628d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:41.763152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0e72a-da2e-4d9f-8aa4-bde5fae628d8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:41.763618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0e72a-da2e-4d9f-8aa4-bde5fae628d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:41.764107 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0e72a-da2e-4d9f-8aa4-bde5fae628d8 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:41.765913 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0e72a-da2e-4d9f-8aa4-bde5fae628d8 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:41.768232 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0e72a-da2e-4d9f-8aa4-bde5fae628d8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:41.775194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 80/162] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:41 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:41.777282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa300cbe-b7c7-47a1-ba08-fa17f42baf5e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:41.777740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa300cbe-b7c7-47a1-ba08-fa17f42baf5e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:41.778179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa300cbe-b7c7-47a1-ba08-fa17f42baf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:41.815315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fa300cbe-b7c7-47a1-ba08-fa17f42baf5e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:41.817123 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fa300cbe-b7c7-47a1-ba08-fa17f42baf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:41.916507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:41.928663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 81/163] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:41.929943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa300cbe-b7c7-47a1-ba08-fa17f42baf5e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:41.962582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625003ca-bf96-4eb3-9c7a-382c329f9579 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:42.005818 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:42.016148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e20c63-1c2d-4aa1-a096-2200574a53de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:42.017478 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e20c63-1c2d-4aa1-a096-2200574a53de None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:42.018241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e20c63-1c2d-4aa1-a096-2200574a53de None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:42.019044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e20c63-1c2d-4aa1-a096-2200574a53de None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:42.020251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e20c63-1c2d-4aa1-a096-2200574a53de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:42.020889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e20c63-1c2d-4aa1-a096-2200574a53de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:42.023326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e20c63-1c2d-4aa1-a096-2200574a53de None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:42.039093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 83/164] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:39:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:42.041899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e20c63-1c2d-4aa1-a096-2200574a53de None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:42.113470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa300cbe-b7c7-47a1-ba08-fa17f42baf5e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:42.150954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86cb05-118a-4447-a686-20d911ea4d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:42.151818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86cb05-118a-4447-a686-20d911ea4d06 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:42.152285 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86cb05-118a-4447-a686-20d911ea4d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:42.152721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86cb05-118a-4447-a686-20d911ea4d06 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:42.153582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86cb05-118a-4447-a686-20d911ea4d06 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:42.154081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86cb05-118a-4447-a686-20d911ea4d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:42.155837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86cb05-118a-4447-a686-20d911ea4d06 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:42.164806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 82/165] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:42.166764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb11089-2e7d-4b28-bed8-c66b212a1eaf None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:42.167431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb11089-2e7d-4b28-bed8-c66b212a1eaf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:42.167914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb11089-2e7d-4b28-bed8-c66b212a1eaf None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:42.169547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 83/166] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:42.170566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb11089-2e7d-4b28-bed8-c66b212a1eaf None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:42.172104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e20c63-1c2d-4aa1-a096-2200574a53de None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:42.229064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1bb4d-f3e5-4ef3-a15a-e0499ccc862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:42.229986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1bb4d-f3e5-4ef3-a15a-e0499ccc862b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:42.230283 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1bb4d-f3e5-4ef3-a15a-e0499ccc862b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:42.230569 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1bb4d-f3e5-4ef3-a15a-e0499ccc862b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:42.231388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1bb4d-f3e5-4ef3-a15a-e0499ccc862b None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=d7240a923ed848ce82516c291da74aea, user.id=5c37b28fc7d64a6c86abaeae5a87cc16) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:42.231707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1bb4d-f3e5-4ef3-a15a-e0499ccc862b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:42.233695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1bb4d-f3e5-4ef3-a15a-e0499ccc862b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:42.242091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 84/167] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:42 2022] GET /identity/v3/role_assignments?user.id=5c37b28fc7d64a6c86abaeae5a87cc16&scope.project.id=d7240a923ed848ce82516c291da74aea&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:42.243081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1bb4d-f3e5-4ef3-a15a-e0499ccc862b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:42.254499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:42.362200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:42.382373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb11089-2e7d-4b28-bed8-c66b212a1eaf None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:42.462090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b17f44-62ad-4213-bbac-5cc9bf4de505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:42.463291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b17f44-62ad-4213-bbac-5cc9bf4de505 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:42.464950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b17f44-62ad-4213-bbac-5cc9bf4de505 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:42.465489 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b17f44-62ad-4213-bbac-5cc9bf4de505 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:42.485501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1bb4d-f3e5-4ef3-a15a-e0499ccc862b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:42.486037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b17f44-62ad-4213-bbac-5cc9bf4de505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d5b17f44-62ad-4213-bbac-5cc9bf4de505 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:42.492392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:42.493830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:42.494608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:42.494608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:42.494608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:42.494608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:42.494608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:42.494608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:42.494608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:42.494608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:42.494608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:42.494608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:42.494608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:42.494608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:42.497144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 84/168] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:42.498981 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b56e-2d78-43fd-8b4f-e4d084156215 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:42.499484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b56e-2d78-43fd-8b4f-e4d084156215 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:42.499982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b56e-2d78-43fd-8b4f-e4d084156215 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:42.501780 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 85/169] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:42.505568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b56e-2d78-43fd-8b4f-e4d084156215 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:42.529181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba8560-11b0-4503-92ae-90eeb72c66d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:42.529899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba8560-11b0-4503-92ae-90eeb72c66d9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:42.530201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba8560-11b0-4503-92ae-90eeb72c66d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:42.530646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba8560-11b0-4503-92ae-90eeb72c66d9 None admin] PATH_INFO: `/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:42.531744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba8560-11b0-4503-92ae-90eeb72c66d9 None admin] RBAC: Authorizing `identity:get_user(user_id=6ac1f63a2d744ed6af882ae350d0cdfd)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:42.534365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba8560-11b0-4503-92ae-90eeb72c66d9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:42.537025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 85/170] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:42 2022] GET /identity/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:42.539082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dec18f-ec35-4236-ac32-f044369a0255 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:42.539619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dec18f-ec35-4236-ac32-f044369a0255 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:42.540190 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dec18f-ec35-4236-ac32-f044369a0255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:42.570220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-50dec18f-ec35-4236-ac32-f044369a0255 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:42.572821 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-50dec18f-ec35-4236-ac32-f044369a0255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:42.628399 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b56e-2d78-43fd-8b4f-e4d084156215 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:42.645911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:42.673294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba663843-91cb-4e97-a91a-78676e94a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:42.674442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba663843-91cb-4e97-a91a-78676e94a603 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:42.675018 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba663843-91cb-4e97-a91a-78676e94a603 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:42.675520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba663843-91cb-4e97-a91a-78676e94a603 None admin] PATH_INFO: `/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:42.677052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba663843-91cb-4e97-a91a-78676e94a603 None admin] RBAC: Authorizing `identity:get_user(user_id=6ac1f63a2d744ed6af882ae350d0cdfd)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:42.678773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba663843-91cb-4e97-a91a-78676e94a603 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:42.679670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 86/171] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:42.680449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dec18f-ec35-4236-ac32-f044369a0255 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:42.682064 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 86/172] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:42 2022] GET /identity/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:42.683595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59273ae-bbd0-4492-9ce7-55d27ed17ea2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:42.684096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59273ae-bbd0-4492-9ce7-55d27ed17ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:42.684601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59273ae-bbd0-4492-9ce7-55d27ed17ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:42.718650 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a59273ae-bbd0-4492-9ce7-55d27ed17ea2 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:42.720848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a59273ae-bbd0-4492-9ce7-55d27ed17ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:42.765516 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:42.832451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 87/173] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:42.840301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59273ae-bbd0-4492-9ce7-55d27ed17ea2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:42.844386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dec18f-ec35-4236-ac32-f044369a0255 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:42.890428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aee73f-95c1-4022-80ec-d10efeeab782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:42.891771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aee73f-95c1-4022-80ec-d10efeeab782 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:42.891881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aee73f-95c1-4022-80ec-d10efeeab782 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:42.892408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aee73f-95c1-4022-80ec-d10efeeab782 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:42.893729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aee73f-95c1-4022-80ec-d10efeeab782 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:42.894180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aee73f-95c1-4022-80ec-d10efeeab782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:42.896751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aee73f-95c1-4022-80ec-d10efeeab782 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:42.917444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 87/174] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:42.917444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aee73f-95c1-4022-80ec-d10efeeab782 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:42.966238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59273ae-bbd0-4492-9ce7-55d27ed17ea2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:42.981363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:43.004239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6be91-5e3b-4fb9-98d9-16cdcf66ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:43.004865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6be91-5e3b-4fb9-98d9-16cdcf66ee6f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:43.005148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6be91-5e3b-4fb9-98d9-16cdcf66ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:43.005424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6be91-5e3b-4fb9-98d9-16cdcf66ee6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:43.034023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aee73f-95c1-4022-80ec-d10efeeab782 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:43.042876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:43.073777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974321c7-5053-4dbd-9bb7-f3c05bb462e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:43.074415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974321c7-5053-4dbd-9bb7-f3c05bb462e2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:43.074695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974321c7-5053-4dbd-9bb7-f3c05bb462e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:43.074976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974321c7-5053-4dbd-9bb7-f3c05bb462e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:43.079838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6be91-5e3b-4fb9-98d9-16cdcf66ee6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:43.081520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6be91-5e3b-4fb9-98d9-16cdcf66ee6f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:43.150664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974321c7-5053-4dbd-9bb7-f3c05bb462e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:43.152196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974321c7-5053-4dbd-9bb7-f3c05bb462e2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:43.191481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 88/175] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:43.192163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6be91-5e3b-4fb9-98d9-16cdcf66ee6f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:43.212339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:43.284991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 88/176] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:43.286291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32664d-d64a-427c-b8cc-8dcbc0f7485e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:43.286583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32664d-d64a-427c-b8cc-8dcbc0f7485e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:43.286861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32664d-d64a-427c-b8cc-8dcbc0f7485e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:43.288329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 89/177] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:43.288866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32664d-d64a-427c-b8cc-8dcbc0f7485e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:43.299934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:43.310257 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6be91-5e3b-4fb9-98d9-16cdcf66ee6f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:43.353992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a647c-410e-4221-bfbb-650ae68604a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:43.354974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a647c-410e-4221-bfbb-650ae68604a2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:43.355477 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a647c-410e-4221-bfbb-650ae68604a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:43.355976 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a647c-410e-4221-bfbb-650ae68604a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:43.373070 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a647c-410e-4221-bfbb-650ae68604a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-eb7a647c-410e-4221-bfbb-650ae68604a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:43.378735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:43.379633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:43.380695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 89/178] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:39:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:43.381325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571f9d0-7fe2-4b16-8015-64f8329e3538 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:43.381540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571f9d0-7fe2-4b16-8015-64f8329e3538 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:43.381734 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571f9d0-7fe2-4b16-8015-64f8329e3538 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:43.382985 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 90/179] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:43.383684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571f9d0-7fe2-4b16-8015-64f8329e3538 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:43.412096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32664d-d64a-427c-b8cc-8dcbc0f7485e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:43.455775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6bf92-8de0-4349-a7cd-ab6f154ce924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:43.456725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6bf92-8de0-4349-a7cd-ab6f154ce924 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:43.457085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6bf92-8de0-4349-a7cd-ab6f154ce924 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:43.457414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6bf92-8de0-4349-a7cd-ab6f154ce924 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:43.462526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:43.470149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6bf92-8de0-4349-a7cd-ab6f154ce924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-eca6bf92-8de0-4349-a7cd-ab6f154ce924 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:43.475140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:43.476266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:43.477058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 90/180] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:39:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:43.478222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6bf92-8de0-4349-a7cd-ab6f154ce924 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:43.501838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571f9d0-7fe2-4b16-8015-64f8329e3538 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:43.537518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735662b1-b144-4e96-9ba9-6e97be8a0229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:43.538209 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735662b1-b144-4e96-9ba9-6e97be8a0229 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:43.538451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735662b1-b144-4e96-9ba9-6e97be8a0229 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:43.538729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735662b1-b144-4e96-9ba9-6e97be8a0229 None admin] PATH_INFO: `/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:43.540554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735662b1-b144-4e96-9ba9-6e97be8a0229 None admin] RBAC: Authorizing `identity:get_user(user_id=6ac1f63a2d744ed6af882ae350d0cdfd)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:43.542024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735662b1-b144-4e96-9ba9-6e97be8a0229 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:43.543649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 91/181] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:43 2022] GET /identity/v3/users/6ac1f63a2d744ed6af882ae350d0cdfd => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:43.549398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735662b1-b144-4e96-9ba9-6e97be8a0229 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:43.580572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:43.617747 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6bf92-8de0-4349-a7cd-ab6f154ce924 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:43.663826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b346a88-02c6-4111-a1a3-96e318863fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:43.664410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b346a88-02c6-4111-a1a3-96e318863fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:43.664693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b346a88-02c6-4111-a1a3-96e318863fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:43.664971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b346a88-02c6-4111-a1a3-96e318863fc3 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:43.666242 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735662b1-b144-4e96-9ba9-6e97be8a0229 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:43.666620 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b346a88-02c6-4111-a1a3-96e318863fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:43.668105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b346a88-02c6-4111-a1a3-96e318863fc3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:43.669814 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 91/182] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:43 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:43.671096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e732c-c5d1-4dfd-9cd1-8d5166dd1752 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:43.671262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e732c-c5d1-4dfd-9cd1-8d5166dd1752 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:43.671540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e732c-c5d1-4dfd-9cd1-8d5166dd1752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:43.692246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7c2e732c-c5d1-4dfd-9cd1-8d5166dd1752 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:43.693459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7c2e732c-c5d1-4dfd-9cd1-8d5166dd1752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:43.705031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e5b93-7c6a-48bc-894b-aa4f5e5dce90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:43.705647 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5b93-7c6a-48bc-894b-aa4f5e5dce90 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:43.705921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5b93-7c6a-48bc-894b-aa4f5e5dce90 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:43.706192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5b93-7c6a-48bc-894b-aa4f5e5dce90 None admin] PATH_INFO: `/v3/projects/00f6d7a2c71b4e838a28f584cf15ed13` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:43.707339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e5b93-7c6a-48bc-894b-aa4f5e5dce90 None admin] RBAC: Authorizing `identity:get_project(project_id=00f6d7a2c71b4e838a28f584cf15ed13)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:43.709146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e5b93-7c6a-48bc-894b-aa4f5e5dce90 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:43.710741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 92/183] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:43 2022] GET /identity/v3/projects/00f6d7a2c71b4e838a28f584cf15ed13 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:43.711514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e5b93-7c6a-48bc-894b-aa4f5e5dce90 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:43.727455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:43.769751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 92/184] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:43.777954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519caf8-5e04-4494-ab63-0f2e13855041 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:43.778269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519caf8-5e04-4494-ab63-0f2e13855041 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:43.778562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519caf8-5e04-4494-ab63-0f2e13855041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:43.801176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0519caf8-5e04-4494-ab63-0f2e13855041 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:43.802373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0519caf8-5e04-4494-ab63-0f2e13855041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:43.846840 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e5b93-7c6a-48bc-894b-aa4f5e5dce90 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:43.879277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:43.885471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59dbd1-6669-4d0e-a109-f90cafdb8e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:43.886465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59dbd1-6669-4d0e-a109-f90cafdb8e9f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:43.886925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59dbd1-6669-4d0e-a109-f90cafdb8e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:43.887348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59dbd1-6669-4d0e-a109-f90cafdb8e9f None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:43.887572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 93/185] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:43.888769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59dbd1-6669-4d0e-a109-f90cafdb8e9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:43.889242 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59dbd1-6669-4d0e-a109-f90cafdb8e9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:43.889394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519caf8-5e04-4494-ab63-0f2e13855041 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:43.891513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59dbd1-6669-4d0e-a109-f90cafdb8e9f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:43.903794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 93/186] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:43.905039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59dbd1-6669-4d0e-a109-f90cafdb8e9f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:43.980113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:44.013971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59dbd1-6669-4d0e-a109-f90cafdb8e9f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:44.017941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519caf8-5e04-4494-ab63-0f2e13855041 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:44.052816 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75e7cd-f0cf-4c7c-9052-4362b144b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:44.053469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75e7cd-f0cf-4c7c-9052-4362b144b75d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:44.053753 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75e7cd-f0cf-4c7c-9052-4362b144b75d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:44.054025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75e7cd-f0cf-4c7c-9052-4362b144b75d None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:44.054748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75e7cd-f0cf-4c7c-9052-4362b144b75d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:44.055065 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75e7cd-f0cf-4c7c-9052-4362b144b75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:44.056507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75e7cd-f0cf-4c7c-9052-4362b144b75d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:44.063826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5f8e-459b-41b5-a107-812b517792e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:44.064495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5f8e-459b-41b5-a107-812b517792e5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:44.064782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5f8e-459b-41b5-a107-812b517792e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:44.065050 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5f8e-459b-41b5-a107-812b517792e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:44.067534 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 94/187] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:39:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:44.068743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75e7cd-f0cf-4c7c-9052-4362b144b75d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:44.138804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:44.142126 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f5f8e-459b-41b5-a107-812b517792e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:44.143608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f5f8e-459b-41b5-a107-812b517792e5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:44.180994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75e7cd-f0cf-4c7c-9052-4362b144b75d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:44.215109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:44.218725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52641d09-0679-4f30-af78-6548b1a39801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:44.219355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641d09-0679-4f30-af78-6548b1a39801 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:44.219640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641d09-0679-4f30-af78-6548b1a39801 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:44.219918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641d09-0679-4f30-af78-6548b1a39801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:44.220767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52641d09-0679-4f30-af78-6548b1a39801 None admin] RBAC: Adding query filter params (role.id=da75e75c3ada4bf1b93ec17d36ff9a0d, scope.project.id=d7240a923ed848ce82516c291da74aea, user.id=6ac1f63a2d744ed6af882ae350d0cdfd) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:44.221081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52641d09-0679-4f30-af78-6548b1a39801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:44.222535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52641d09-0679-4f30-af78-6548b1a39801 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:44.238086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 95/188] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:44 2022] GET /identity/v3/role_assignments?user.id=6ac1f63a2d744ed6af882ae350d0cdfd&scope.project.id=d7240a923ed848ce82516c291da74aea&role.id=da75e75c3ada4bf1b93ec17d36ff9a0d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:44.238086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52641d09-0679-4f30-af78-6548b1a39801 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:44.262623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 94/189] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:44.269245 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5f8e-459b-41b5-a107-812b517792e5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:44.358280 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52641d09-0679-4f30-af78-6548b1a39801 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:44.393764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:44.409713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5f8e-459b-41b5-a107-812b517792e5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:44.422578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e9de5-8be2-4a20-b3db-dcd8e5479759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:44.423339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e9de5-8be2-4a20-b3db-dcd8e5479759 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:44.423693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e9de5-8be2-4a20-b3db-dcd8e5479759 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:44.424042 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e9de5-8be2-4a20-b3db-dcd8e5479759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:44.425014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e9de5-8be2-4a20-b3db-dcd8e5479759 None admin] RBAC: Adding query filter params (role.id=ad3a96ed9c2944be914156fa1c4613af, scope.project.id=00f6d7a2c71b4e838a28f584cf15ed13, user.id=6ac1f63a2d744ed6af882ae350d0cdfd) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:44.425855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e9de5-8be2-4a20-b3db-dcd8e5479759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:44.426888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e9de5-8be2-4a20-b3db-dcd8e5479759 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:44.433492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 96/190] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:44 2022] GET /identity/v3/role_assignments?user.id=6ac1f63a2d744ed6af882ae350d0cdfd&scope.project.id=00f6d7a2c71b4e838a28f584cf15ed13&role.id=ad3a96ed9c2944be914156fa1c4613af => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:44.434792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e9de5-8be2-4a20-b3db-dcd8e5479759 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:44.452619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ce6a8-7023-4729-8849-bbdf3ec8ccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:44.453321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ce6a8-7023-4729-8849-bbdf3ec8ccd7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:44.453604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ce6a8-7023-4729-8849-bbdf3ec8ccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:44.453884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ce6a8-7023-4729-8849-bbdf3ec8ccd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:44.455157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ce6a8-7023-4729-8849-bbdf3ec8ccd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:44.456715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ce6a8-7023-4729-8849-bbdf3ec8ccd7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:44.458683 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 95/191] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:44.464266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ce6a8-7023-4729-8849-bbdf3ec8ccd7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:44.522535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:44.590963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e9de5-8be2-4a20-b3db-dcd8e5479759 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:44.599421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ce6a8-7023-4729-8849-bbdf3ec8ccd7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:44.639558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00c265-1d46-4685-bb64-68c2dd2ac065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:44.640285 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c265-1d46-4685-bb64-68c2dd2ac065 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:44.640572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c265-1d46-4685-bb64-68c2dd2ac065 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:44.640855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c265-1d46-4685-bb64-68c2dd2ac065 None admin] PATH_INFO: `/v3/users/9bb0a88278f8432f9b7a5235b76ab422` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:44.644963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb31c7-4d16-494d-bb0e-e1f081c4c7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:44.645623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb31c7-4d16-494d-bb0e-e1f081c4c7ee None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:44.645905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb31c7-4d16-494d-bb0e-e1f081c4c7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:44.646180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb31c7-4d16-494d-bb0e-e1f081c4c7ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:44.659349 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00c265-1d46-4685-bb64-68c2dd2ac065 None admin] RBAC: Authorizing `identity:get_user(user_id=9bb0a88278f8432f9b7a5235b76ab422)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:44.659809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb31c7-4d16-494d-bb0e-e1f081c4c7ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:44.661109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00c265-1d46-4685-bb64-68c2dd2ac065 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:44.663041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 97/192] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:44 2022] GET /identity/v3/users/9bb0a88278f8432f9b7a5235b76ab422 => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:44.663654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00c265-1d46-4685-bb64-68c2dd2ac065 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9dbb31c7-4d16-494d-bb0e-e1f081c4c7ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:44.665065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:44.665924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:44.666698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 96/193] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:44.667351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb31c7-4d16-494d-bb0e-e1f081c4c7ee None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:44.726464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:44.782089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:44.783985 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00c265-1d46-4685-bb64-68c2dd2ac065 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:44.787189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb31c7-4d16-494d-bb0e-e1f081c4c7ee None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:44.823645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1559d00-4a8b-4d79-a170-0e10c802a2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:44.824327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1559d00-4a8b-4d79-a170-0e10c802a2ef None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:44.824610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1559d00-4a8b-4d79-a170-0e10c802a2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:44.824881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1559d00-4a8b-4d79-a170-0e10c802a2ef None admin] PATH_INFO: `/v3/users/9bb0a88278f8432f9b7a5235b76ab422` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:44.825292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158601b-cbdd-484d-b2d6-76a3559e102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:44.826114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158601b-cbdd-484d-b2d6-76a3559e102d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:44.826231 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1559d00-4a8b-4d79-a170-0e10c802a2ef None admin] RBAC: Authorizing `identity:get_user(user_id=9bb0a88278f8432f9b7a5235b76ab422)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:44.826411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158601b-cbdd-484d-b2d6-76a3559e102d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:44.826660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158601b-cbdd-484d-b2d6-76a3559e102d None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:44.827669 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1559d00-4a8b-4d79-a170-0e10c802a2ef None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:44.827819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158601b-cbdd-484d-b2d6-76a3559e102d None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:44.829331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158601b-cbdd-484d-b2d6-76a3559e102d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:44.829431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 98/194] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:44 2022] GET /identity/v3/users/9bb0a88278f8432f9b7a5235b76ab422 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:44.830133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1559d00-4a8b-4d79-a170-0e10c802a2ef None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:44.831002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 97/195] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:44 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:44.831804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158601b-cbdd-484d-b2d6-76a3559e102d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:44.943467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1559d00-4a8b-4d79-a170-0e10c802a2ef None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:44.959824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:44.965490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158601b-cbdd-484d-b2d6-76a3559e102d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:44.993984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78935-7047-4e30-b16e-18b96dc22952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:44.994963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78935-7047-4e30-b16e-18b96dc22952 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:44.995414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78935-7047-4e30-b16e-18b96dc22952 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:44.995851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78935-7047-4e30-b16e-18b96dc22952 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:44.997081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e78935-7047-4e30-b16e-18b96dc22952 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:44.999000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e78935-7047-4e30-b16e-18b96dc22952 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:45.009314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561dcab-0a13-44fe-bed7-92448cf95ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:45.009983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561dcab-0a13-44fe-bed7-92448cf95ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:45.010310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561dcab-0a13-44fe-bed7-92448cf95ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:45.010720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561dcab-0a13-44fe-bed7-92448cf95ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:45.011539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561dcab-0a13-44fe-bed7-92448cf95ab4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:45.011922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561dcab-0a13-44fe-bed7-92448cf95ab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:45.013621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561dcab-0a13-44fe-bed7-92448cf95ab4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:45.020663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 99/196] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:39:44 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:39:45.021509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78935-7047-4e30-b16e-18b96dc22952 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:45.027138 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 98/197] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:45.029077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561dcab-0a13-44fe-bed7-92448cf95ab4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:45.074148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:45.159010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561dcab-0a13-44fe-bed7-92448cf95ab4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:45.161467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78935-7047-4e30-b16e-18b96dc22952 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:45.198598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62899a-e4db-432e-9d73-7a37843cf5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:45.198838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62899a-e4db-432e-9d73-7a37843cf5ab None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:45.199128 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62899a-e4db-432e-9d73-7a37843cf5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:45.200357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62899a-e4db-432e-9d73-7a37843cf5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:45.207833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ea334-a1e8-4577-9f06-0e9a582a570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:45.208988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ea334-a1e8-4577-9f06-0e9a582a570b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:45.209279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ea334-a1e8-4577-9f06-0e9a582a570b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:45.209561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ea334-a1e8-4577-9f06-0e9a582a570b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:45.249678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:45.305064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ea334-a1e8-4577-9f06-0e9a582a570b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:45.309158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ea334-a1e8-4577-9f06-0e9a582a570b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:45.313379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62899a-e4db-432e-9d73-7a37843cf5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:45.315800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62899a-e4db-432e-9d73-7a37843cf5ab None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:45.350517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:45.442022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 99/198] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:45.443005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62899a-e4db-432e-9d73-7a37843cf5ab None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:45.448991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 100/199] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:45.450185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ea334-a1e8-4577-9f06-0e9a582a570b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:45.552418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:45.557725 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62899a-e4db-432e-9d73-7a37843cf5ab None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:45.598195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:45.606150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ea334-a1e8-4577-9f06-0e9a582a570b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:45.614579 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef824-3787-4f10-8495-126353970f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:45.615693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef824-3787-4f10-8495-126353970f7f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:45.616264 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef824-3787-4f10-8495-126353970f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:45.617411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef824-3787-4f10-8495-126353970f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:45.618820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ef824-3787-4f10-8495-126353970f7f None admin] RBAC: Adding query filter params (role.id=ad3a96ed9c2944be914156fa1c4613af, scope.project.id=d7240a923ed848ce82516c291da74aea, user.id=6ac1f63a2d744ed6af882ae350d0cdfd) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:45.619412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ef824-3787-4f10-8495-126353970f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:45.623093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ef824-3787-4f10-8495-126353970f7f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:45.641899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 100/200] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:45 2022] GET /identity/v3/role_assignments?user.id=6ac1f63a2d744ed6af882ae350d0cdfd&scope.project.id=d7240a923ed848ce82516c291da74aea&role.id=ad3a96ed9c2944be914156fa1c4613af => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:45.641899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef824-3787-4f10-8495-126353970f7f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:45.675293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7815eeb-8f44-4ee0-bf62-67374777aac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:45.676052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7815eeb-8f44-4ee0-bf62-67374777aac9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:45.676402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7815eeb-8f44-4ee0-bf62-67374777aac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:45.676772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7815eeb-8f44-4ee0-bf62-67374777aac9 None admin] PATH_INFO: `/v3/users/6076e862d82e4f6b92bc84116995df88` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:45.679141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7815eeb-8f44-4ee0-bf62-67374777aac9 None admin] RBAC: Authorizing `identity:get_user(user_id=6076e862d82e4f6b92bc84116995df88)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:45.680895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7815eeb-8f44-4ee0-bf62-67374777aac9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:45.685085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 101/201] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:45 2022] GET /identity/v3/users/6076e862d82e4f6b92bc84116995df88 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:45.685870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7815eeb-8f44-4ee0-bf62-67374777aac9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:45.854888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef824-3787-4f10-8495-126353970f7f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:45.888686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7815eeb-8f44-4ee0-bf62-67374777aac9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:45.896527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505cd48-2bbf-4c52-b7e1-5f10774ec785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:45.897190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505cd48-2bbf-4c52-b7e1-5f10774ec785 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:45.897477 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505cd48-2bbf-4c52-b7e1-5f10774ec785 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:45.897755 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505cd48-2bbf-4c52-b7e1-5f10774ec785 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:45.900213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505cd48-2bbf-4c52-b7e1-5f10774ec785 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:45.902224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505cd48-2bbf-4c52-b7e1-5f10774ec785 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:45.904815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 101/202] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:45 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:45.905659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505cd48-2bbf-4c52-b7e1-5f10774ec785 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:45.933666 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa613f2-006b-4a11-97a1-32f3377d95b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:45.934395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa613f2-006b-4a11-97a1-32f3377d95b7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:45.934676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa613f2-006b-4a11-97a1-32f3377d95b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:45.935068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa613f2-006b-4a11-97a1-32f3377d95b7 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:45.936499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa613f2-006b-4a11-97a1-32f3377d95b7 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:45.938704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa613f2-006b-4a11-97a1-32f3377d95b7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:45.940983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 102/203] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:45 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:45.941917 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa613f2-006b-4a11-97a1-32f3377d95b7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:45.945937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:45.980658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:46.029130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505cd48-2bbf-4c52-b7e1-5f10774ec785 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:46.067165 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa613f2-006b-4a11-97a1-32f3377d95b7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:46.069980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449126a2-8f11-468b-96a3-cc7c1b4661a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:46.070627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449126a2-8f11-468b-96a3-cc7c1b4661a5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:46.070914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449126a2-8f11-468b-96a3-cc7c1b4661a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:46.071229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449126a2-8f11-468b-96a3-cc7c1b4661a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:46.108003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45ece8-42fc-428d-a71e-8e73037cb00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:46.108670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45ece8-42fc-428d-a71e-8e73037cb00f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:46.108998 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45ece8-42fc-428d-a71e-8e73037cb00f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:46.109293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45ece8-42fc-428d-a71e-8e73037cb00f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:46.110186 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45ece8-42fc-428d-a71e-8e73037cb00f None admin] RBAC: Adding query filter params (role.id=da75e75c3ada4bf1b93ec17d36ff9a0d, scope.project.id=4912877de99b4c50ad5b9ce264b21ce2, user.id=9bb0a88278f8432f9b7a5235b76ab422) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:46.110513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45ece8-42fc-428d-a71e-8e73037cb00f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:46.112189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45ece8-42fc-428d-a71e-8e73037cb00f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:46.119110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 103/204] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:45 2022] GET /identity/v3/role_assignments?user.id=9bb0a88278f8432f9b7a5235b76ab422&scope.project.id=4912877de99b4c50ad5b9ce264b21ce2&role.id=da75e75c3ada4bf1b93ec17d36ff9a0d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:46.120148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45ece8-42fc-428d-a71e-8e73037cb00f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:46.150967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449126a2-8f11-468b-96a3-cc7c1b4661a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:46.152420 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449126a2-8f11-468b-96a3-cc7c1b4661a5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:46.201445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:46.223301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:46.247761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45ece8-42fc-428d-a71e-8e73037cb00f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:46.274909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 102/205] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:46.281704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449126a2-8f11-468b-96a3-cc7c1b4661a5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:46.292903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2bee5-000c-445a-9f83-1193aeca9dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:46.293573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2bee5-000c-445a-9f83-1193aeca9dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:46.293861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2bee5-000c-445a-9f83-1193aeca9dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:46.294143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2bee5-000c-445a-9f83-1193aeca9dc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:46.295095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2bee5-000c-445a-9f83-1193aeca9dc2 None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=4912877de99b4c50ad5b9ce264b21ce2, user.id=9bb0a88278f8432f9b7a5235b76ab422) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:46.295419 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2bee5-000c-445a-9f83-1193aeca9dc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:46.297102 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2bee5-000c-445a-9f83-1193aeca9dc2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:46.311074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 104/206] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:46 2022] GET /identity/v3/role_assignments?user.id=9bb0a88278f8432f9b7a5235b76ab422&scope.project.id=4912877de99b4c50ad5b9ce264b21ce2&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:46.403275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449126a2-8f11-468b-96a3-cc7c1b4661a5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:46.457003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e6227-dc8f-4070-acee-b63062fa309a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:46.457765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e6227-dc8f-4070-acee-b63062fa309a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:46.458141 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e6227-dc8f-4070-acee-b63062fa309a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:46.458431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e6227-dc8f-4070-acee-b63062fa309a None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:46.460038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e6227-dc8f-4070-acee-b63062fa309a None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:46.461634 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e6227-dc8f-4070-acee-b63062fa309a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:46.463683 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 103/207] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:46 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:46.469947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2bee5-000c-445a-9f83-1193aeca9dc2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:46.626301 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2bee5-000c-445a-9f83-1193aeca9dc2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:46.660774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:46.668236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db553f83-4d3b-428c-a10a-1d1627df6611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:46.668875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db553f83-4d3b-428c-a10a-1d1627df6611 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:46.669166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db553f83-4d3b-428c-a10a-1d1627df6611 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:46.669444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db553f83-4d3b-428c-a10a-1d1627df6611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:46.670261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db553f83-4d3b-428c-a10a-1d1627df6611 None admin] RBAC: Adding query filter params (role.id=6082d88564724bd586ad069364cb597b, scope.project.id=d7240a923ed848ce82516c291da74aea, user.id=6076e862d82e4f6b92bc84116995df88) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:46.670577 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db553f83-4d3b-428c-a10a-1d1627df6611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:46.672067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db553f83-4d3b-428c-a10a-1d1627df6611 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:46.686471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 105/208] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:46 2022] GET /identity/v3/role_assignments?user.id=6076e862d82e4f6b92bc84116995df88&scope.project.id=d7240a923ed848ce82516c291da74aea&role.id=6082d88564724bd586ad069364cb597b => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:47.609385 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c8822-5d92-4dbb-a305-e980aaa50aaa None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:47.609962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c8822-5d92-4dbb-a305-e980aaa50aaa None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:47.609962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c8822-5d92-4dbb-a305-e980aaa50aaa None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:47.611302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 104/209] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:47.616481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270cbe8-82b4-41fa-be09-1f43d65de6e8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:47.616779 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270cbe8-82b4-41fa-be09-1f43d65de6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:47.617061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270cbe8-82b4-41fa-be09-1f43d65de6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:47.635997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b270cbe8-82b4-41fa-be09-1f43d65de6e8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:47.637222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b270cbe8-82b4-41fa-be09-1f43d65de6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:47.721078 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 106/210] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:47.744793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c8822-5d92-4dbb-a305-e980aaa50aaa None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:47.776458 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:47.862120 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c8822-5d92-4dbb-a305-e980aaa50aaa None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:47.869303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e538b73-0740-40b0-aba6-147aa5b3f6f9 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:47.869650 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e538b73-0740-40b0-aba6-147aa5b3f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:47.870001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e538b73-0740-40b0-aba6-147aa5b3f6f9 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:47.871888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 107/211] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:39:47.877618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0130a9-7cfc-482d-9d8b-d047f4fbbe6e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:47.877914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0130a9-7cfc-482d-9d8b-d047f4fbbe6e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:47.878254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0130a9-7cfc-482d-9d8b-d047f4fbbe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:47.898001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5f0130a9-7cfc-482d-9d8b-d047f4fbbe6e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:47.899205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5f0130a9-7cfc-482d-9d8b-d047f4fbbe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:47.900043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096f6bc-ecdc-4654-ad01-2b435f698c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:47.900737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096f6bc-ecdc-4654-ad01-2b435f698c61 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:47.901022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096f6bc-ecdc-4654-ad01-2b435f698c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:47.901303 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096f6bc-ecdc-4654-ad01-2b435f698c61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:47.912289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096f6bc-ecdc-4654-ad01-2b435f698c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-4096f6bc-ecdc-4654-ad01-2b435f698c61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:47.917896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:47.918797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:47.919569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 105/212] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:39:47.926650 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096f6bc-ecdc-4654-ad01-2b435f698c61 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:47.971730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 108/213] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:47.997003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0130a9-7cfc-482d-9d8b-d047f4fbbe6e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:48.038752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:48.050071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096f6bc-ecdc-4654-ad01-2b435f698c61 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:48.062741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:48.107130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0130a9-7cfc-482d-9d8b-d047f4fbbe6e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:48.107472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfb0ad-1dc5-4340-b776-236012034e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:48.108879 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfb0ad-1dc5-4340-b776-236012034e54 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:48.109388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfb0ad-1dc5-4340-b776-236012034e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:48.110992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfb0ad-1dc5-4340-b776-236012034e54 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:48.112331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfb0ad-1dc5-4340-b776-236012034e54 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:48.112825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfb0ad-1dc5-4340-b776-236012034e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:48.115206 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfb0ad-1dc5-4340-b776-236012034e54 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:48.135396 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 106/214] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:48.141107 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfb0ad-1dc5-4340-b776-236012034e54 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:48.151500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cee293-ac4b-4702-9f92-3b1aa702b8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:48.152281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cee293-ac4b-4702-9f92-3b1aa702b8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:48.152635 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cee293-ac4b-4702-9f92-3b1aa702b8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:48.152998 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cee293-ac4b-4702-9f92-3b1aa702b8f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:48.154310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cee293-ac4b-4702-9f92-3b1aa702b8f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:48.155906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cee293-ac4b-4702-9f92-3b1aa702b8f0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:48.162527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 109/215] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:48.163552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cee293-ac4b-4702-9f92-3b1aa702b8f0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:48.275776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cee293-ac4b-4702-9f92-3b1aa702b8f0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:48.288827 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfb0ad-1dc5-4340-b776-236012034e54 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:48.308333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:48.326555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42444cc-ba41-4266-91ad-8b7242421f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:48.327721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42444cc-ba41-4266-91ad-8b7242421f76 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:48.328463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42444cc-ba41-4266-91ad-8b7242421f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:48.329005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42444cc-ba41-4266-91ad-8b7242421f76 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:48.330161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42444cc-ba41-4266-91ad-8b7242421f76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:48.332228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42444cc-ba41-4266-91ad-8b7242421f76 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:48.332462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d1bb2-ff92-4036-a62c-ef67d474754b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:48.333113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d1bb2-ff92-4036-a62c-ef67d474754b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:48.333399 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d1bb2-ff92-4036-a62c-ef67d474754b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:48.333935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d1bb2-ff92-4036-a62c-ef67d474754b None admin] PATH_INFO: `/v3/users/b7a1cbe3e2a8459abd864621b38b5aca` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:48.352021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d1bb2-ff92-4036-a62c-ef67d474754b None admin] RBAC: Authorizing `identity:get_user(user_id=b7a1cbe3e2a8459abd864621b38b5aca)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:48.353685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d1bb2-ff92-4036-a62c-ef67d474754b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:48.360074 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 107/216] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:48 2022] GET /identity/v3/users/b7a1cbe3e2a8459abd864621b38b5aca => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:48.361664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d1bb2-ff92-4036-a62c-ef67d474754b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:48.366957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 110/217] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:39:48 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:39:48.375808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:48.486276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a7bea-dedc-4a33-bd40-0037f093593b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:48.486611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a7bea-dedc-4a33-bd40-0037f093593b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:48.486842 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a7bea-dedc-4a33-bd40-0037f093593b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:48.488858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 111/218] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:39:48.494897 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346ea9b-094f-44c4-8651-5e171c44fc65 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:48.495229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346ea9b-094f-44c4-8651-5e171c44fc65 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:48.495455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346ea9b-094f-44c4-8651-5e171c44fc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:48.520142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d1bb2-ff92-4036-a62c-ef67d474754b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:48.533451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c346ea9b-094f-44c4-8651-5e171c44fc65 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:48.536089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c346ea9b-094f-44c4-8651-5e171c44fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:48.574286 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48071051-1ad8-4e82-bea0-f5ee73841539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:48.574993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48071051-1ad8-4e82-bea0-f5ee73841539 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:48.575585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48071051-1ad8-4e82-bea0-f5ee73841539 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:48.575860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48071051-1ad8-4e82-bea0-f5ee73841539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:48.628325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 112/219] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:48.651668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346ea9b-094f-44c4-8651-5e171c44fc65 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:48.677976 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48071051-1ad8-4e82-bea0-f5ee73841539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:48.680088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48071051-1ad8-4e82-bea0-f5ee73841539 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:48.701053 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:48.796647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346ea9b-094f-44c4-8651-5e171c44fc65 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:48.812075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 108/220] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:48.812075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bb964-9bfd-4ab4-b2c2-9e3fc2482e74 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:48.812075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bb964-9bfd-4ab4-b2c2-9e3fc2482e74 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:48.812075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bb964-9bfd-4ab4-b2c2-9e3fc2482e74 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:48.813354 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:48.814066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 109/221] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:48.819163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bb964-9bfd-4ab4-b2c2-9e3fc2482e74 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:48.865890 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48378633-fc0b-4b5a-9542-54aa40f76ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:48.866576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378633-fc0b-4b5a-9542-54aa40f76ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:48.866860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378633-fc0b-4b5a-9542-54aa40f76ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:48.867139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378633-fc0b-4b5a-9542-54aa40f76ad5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:48.885119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48378633-fc0b-4b5a-9542-54aa40f76ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-48378633-fc0b-4b5a-9542-54aa40f76ad5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:48.892754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:48.893692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:48.894474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:48.894474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:48.894474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:48.894474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:48.894474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:48.894474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:48.894474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:48.894474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:48.894474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:48.894474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:48.894474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:39:48.894474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:48.897331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 113/222] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:39:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:39:48.899355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cf0b8-e512-47db-85f5-6d4b522e2e2c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:48.899802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cf0b8-e512-47db-85f5-6d4b522e2e2c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:48.900253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cf0b8-e512-47db-85f5-6d4b522e2e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:48.924576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c12cf0b8-e512-47db-85f5-6d4b522e2e2c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:48.926638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c12cf0b8-e512-47db-85f5-6d4b522e2e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:48.970299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bb964-9bfd-4ab4-b2c2-9e3fc2482e74 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:48.982330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:49.018049 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f86c96-74a4-410d-a402-4630356a4462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:49.019263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f86c96-74a4-410d-a402-4630356a4462 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:49.019857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f86c96-74a4-410d-a402-4630356a4462 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:49.020495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f86c96-74a4-410d-a402-4630356a4462 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:49.022757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f86c96-74a4-410d-a402-4630356a4462 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:49.026136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f86c96-74a4-410d-a402-4630356a4462 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:49.028813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 110/223] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:48 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:49.029729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f86c96-74a4-410d-a402-4630356a4462 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:49.040935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 114/224] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:49.042648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cf0b8-e512-47db-85f5-6d4b522e2e2c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:49.193849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f86c96-74a4-410d-a402-4630356a4462 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:49.194369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:49.202142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cf0b8-e512-47db-85f5-6d4b522e2e2c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:49.246859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff46d5-c8e6-4614-9f6c-1362f6fc0931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:49.247853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff46d5-c8e6-4614-9f6c-1362f6fc0931 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:49.248406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff46d5-c8e6-4614-9f6c-1362f6fc0931 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:49.249025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff46d5-c8e6-4614-9f6c-1362f6fc0931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:49.250394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff46d5-c8e6-4614-9f6c-1362f6fc0931 None admin] RBAC: Adding query filter params (role.id=ad3a96ed9c2944be914156fa1c4613af, scope.project.id=4912877de99b4c50ad5b9ce264b21ce2, user.id=b7a1cbe3e2a8459abd864621b38b5aca) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:49.251008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff46d5-c8e6-4614-9f6c-1362f6fc0931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:49.252931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70721335-b474-4891-9859-3b178dd03a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:49.253307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff46d5-c8e6-4614-9f6c-1362f6fc0931 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:49.253558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70721335-b474-4891-9859-3b178dd03a94 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:49.253887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70721335-b474-4891-9859-3b178dd03a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:49.254164 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70721335-b474-4891-9859-3b178dd03a94 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:49.254886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70721335-b474-4891-9859-3b178dd03a94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:49.255190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70721335-b474-4891-9859-3b178dd03a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:49.256917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70721335-b474-4891-9859-3b178dd03a94 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:49.261561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 115/225] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:49 2022] GET /identity/v3/role_assignments?user.id=b7a1cbe3e2a8459abd864621b38b5aca&scope.project.id=4912877de99b4c50ad5b9ce264b21ce2&role.id=ad3a96ed9c2944be914156fa1c4613af => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:49.262697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff46d5-c8e6-4614-9f6c-1362f6fc0931 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:49.268876 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 111/226] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:39:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:49.278131 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70721335-b474-4891-9859-3b178dd03a94 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:49.395267 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:49.469192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70721335-b474-4891-9859-3b178dd03a94 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:49.473541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff46d5-c8e6-4614-9f6c-1362f6fc0931 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:49.505880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92093be4-179c-4d31-a693-93060004704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:49.506542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92093be4-179c-4d31-a693-93060004704d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:49.506819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92093be4-179c-4d31-a693-93060004704d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:49.507099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92093be4-179c-4d31-a693-93060004704d None admin] PATH_INFO: `/v3/users/9bb0a88278f8432f9b7a5235b76ab422` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:49.508313 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92093be4-179c-4d31-a693-93060004704d None admin] RBAC: Authorizing `identity:get_user(user_id=9bb0a88278f8432f9b7a5235b76ab422)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:49.509856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f546a4-95d0-4fae-bdc2-81e39301f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:49.510297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92093be4-179c-4d31-a693-93060004704d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:49.510947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f546a4-95d0-4fae-bdc2-81e39301f8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:49.511449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f546a4-95d0-4fae-bdc2-81e39301f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:49.511928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 112/227] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:49 2022] GET /identity/v3/users/9bb0a88278f8432f9b7a5235b76ab422 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:49.512148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f546a4-95d0-4fae-bdc2-81e39301f8e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:49.518401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92093be4-179c-4d31-a693-93060004704d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:49.529359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f546a4-95d0-4fae-bdc2-81e39301f8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-18f546a4-95d0-4fae-bdc2-81e39301f8e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:49.535243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:49.536111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:49.536934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:49.536934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:49.536934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:49.536934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:49.536934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:49.536934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:49.536934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:49.536934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:49.536934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:49.536934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:49.536934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:49.536934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:49.539561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 116/228] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:49.549167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f546a4-95d0-4fae-bdc2-81e39301f8e5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:49.646482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92093be4-179c-4d31-a693-93060004704d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:49.656595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:49.662394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:49.688188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ec073-55bc-4ff2-b75f-db94cd4434cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:49.688903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ec073-55bc-4ff2-b75f-db94cd4434cb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:49.689198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ec073-55bc-4ff2-b75f-db94cd4434cb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:49.689476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ec073-55bc-4ff2-b75f-db94cd4434cb None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:49.690674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ec073-55bc-4ff2-b75f-db94cd4434cb None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:49.692365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ec073-55bc-4ff2-b75f-db94cd4434cb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:49.695039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 113/229] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:49 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:49.702276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ec073-55bc-4ff2-b75f-db94cd4434cb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:49.830572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ec073-55bc-4ff2-b75f-db94cd4434cb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:49.874717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87136eb-a9c1-4554-9e54-9d630a955436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:49.875468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87136eb-a9c1-4554-9e54-9d630a955436 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:49.875752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87136eb-a9c1-4554-9e54-9d630a955436 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:49.876029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87136eb-a9c1-4554-9e54-9d630a955436 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2/users/9bb0a88278f8432f9b7a5235b76ab422/roles/da75e75c3ada4bf1b93ec17d36ff9a0d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:49.878591 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87136eb-a9c1-4554-9e54-9d630a955436 None admin] RBAC: Authorizing `identity:create_grant(project_id=4912877de99b4c50ad5b9ce264b21ce2, user_id=9bb0a88278f8432f9b7a5235b76ab422, role_id=da75e75c3ada4bf1b93ec17d36ff9a0d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:49.880067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87136eb-a9c1-4554-9e54-9d630a955436 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:49.905732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 114/230] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:39:49 2022] PUT /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2/users/9bb0a88278f8432f9b7a5235b76ab422/roles/da75e75c3ada4bf1b93ec17d36ff9a0d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:39:49.920614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f546a4-95d0-4fae-bdc2-81e39301f8e5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:49.961633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afac27f-c5ce-48a2-9be3-905306b555f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:49.962840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afac27f-c5ce-48a2-9be3-905306b555f7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:49.963129 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afac27f-c5ce-48a2-9be3-905306b555f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:49.963408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afac27f-c5ce-48a2-9be3-905306b555f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:49.964176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afac27f-c5ce-48a2-9be3-905306b555f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:49.964490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afac27f-c5ce-48a2-9be3-905306b555f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:49.965897 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afac27f-c5ce-48a2-9be3-905306b555f7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:49.976767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 117/231] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:49.983156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87136eb-a9c1-4554-9e54-9d630a955436 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:50.025006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:50.103242 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87136eb-a9c1-4554-9e54-9d630a955436 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:50.143742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e8b06-80da-44f3-b6dc-f496517ce67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:50.144431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e8b06-80da-44f3-b6dc-f496517ce67c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:50.144712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e8b06-80da-44f3-b6dc-f496517ce67c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:50.144989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e8b06-80da-44f3-b6dc-f496517ce67c None admin] PATH_INFO: `/v3/users/9bb0a88278f8432f9b7a5235b76ab422` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:50.146250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e8b06-80da-44f3-b6dc-f496517ce67c None admin] RBAC: Authorizing `identity:get_user(user_id=9bb0a88278f8432f9b7a5235b76ab422)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:50.147787 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e8b06-80da-44f3-b6dc-f496517ce67c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:50.150573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 115/232] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:49 2022] GET /identity/v3/users/9bb0a88278f8432f9b7a5235b76ab422 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:50.156243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afac27f-c5ce-48a2-9be3-905306b555f7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:50.290749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:50.313250 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afac27f-c5ce-48a2-9be3-905306b555f7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:50.351997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099507a-5871-4278-b7e3-e76810c80db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:50.352732 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099507a-5871-4278-b7e3-e76810c80db4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:50.353015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099507a-5871-4278-b7e3-e76810c80db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:50.353347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099507a-5871-4278-b7e3-e76810c80db4 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:50.354481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099507a-5871-4278-b7e3-e76810c80db4 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:50.356038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099507a-5871-4278-b7e3-e76810c80db4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:50.358144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 118/233] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:50 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:50.365072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e8b06-80da-44f3-b6dc-f496517ce67c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:50.518070 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e8b06-80da-44f3-b6dc-f496517ce67c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:50.520798 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:50.572618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c99bc-fae5-4f07-90de-0f20ac520a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:50.573471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c99bc-fae5-4f07-90de-0f20ac520a7a None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:50.573754 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c99bc-fae5-4f07-90de-0f20ac520a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:50.574031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c99bc-fae5-4f07-90de-0f20ac520a7a None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2/users/9bb0a88278f8432f9b7a5235b76ab422/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:50.577570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c99bc-fae5-4f07-90de-0f20ac520a7a None admin] RBAC: Authorizing `identity:create_grant(project_id=4912877de99b4c50ad5b9ce264b21ce2, user_id=9bb0a88278f8432f9b7a5235b76ab422, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:50.579307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c99bc-fae5-4f07-90de-0f20ac520a7a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:50.604369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 116/234] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:39:50 2022] PUT /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2/users/9bb0a88278f8432f9b7a5235b76ab422/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:39:50.928379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0725a-c537-41d8-aaf4-3f27db061643 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:50.928868 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0725a-c537-41d8-aaf4-3f27db061643 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:50.928868 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0725a-c537-41d8-aaf4-3f27db061643 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:50.930215 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 119/235] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:50.937507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadfab6-499e-4e43-afc4-b3db65dc9a20 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:50.938331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadfab6-499e-4e43-afc4-b3db65dc9a20 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:50.938777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadfab6-499e-4e43-afc4-b3db65dc9a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:50.961103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4eadfab6-499e-4e43-afc4-b3db65dc9a20 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:50.962648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4eadfab6-499e-4e43-afc4-b3db65dc9a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:51.046696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 117/236] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:51.072565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0725a-c537-41d8-aaf4-3f27db061643 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:51.187472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8cee5-be09-40ae-be81-9cd347eb76f0 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:51.188019 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8cee5-be09-40ae-be81-9cd347eb76f0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:51.188511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8cee5-be09-40ae-be81-9cd347eb76f0 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:51.190046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 118/237] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:51.205651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bc21c-f55e-4d3d-b5e2-a318339f9818 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:51.206207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bc21c-f55e-4d3d-b5e2-a318339f9818 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:51.206655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bc21c-f55e-4d3d-b5e2-a318339f9818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:51.216638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0725a-c537-41d8-aaf4-3f27db061643 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:51.245745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0f2bc21c-f55e-4d3d-b5e2-a318339f9818 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:51.247143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0f2bc21c-f55e-4d3d-b5e2-a318339f9818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:51.252843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95687502-249b-457d-ac41-b7247ca1b030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:51.253736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95687502-249b-457d-ac41-b7247ca1b030 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:51.254226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95687502-249b-457d-ac41-b7247ca1b030 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:51.254687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95687502-249b-457d-ac41-b7247ca1b030 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:51.268395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95687502-249b-457d-ac41-b7247ca1b030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-95687502-249b-457d-ac41-b7247ca1b030 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:51.274000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:51.275445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:51.276268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:51.276268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:51.276268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:51.276268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:51.276268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:51.276268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:51.276268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:51.276268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:51.276268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:51.276268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:51.276268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:39:51.276268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:51.278221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 120/238] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:51.284046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95687502-249b-457d-ac41-b7247ca1b030 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:51.300645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:51.393211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95687502-249b-457d-ac41-b7247ca1b030 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:51.427125 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 119/239] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:51.433399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fa27-7728-48ea-8b6e-c8f655574df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:51.434202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fa27-7728-48ea-8b6e-c8f655574df9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:51.434635 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fa27-7728-48ea-8b6e-c8f655574df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:51.435059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fa27-7728-48ea-8b6e-c8f655574df9 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:51.435935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46fa27-7728-48ea-8b6e-c8f655574df9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:51.436477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46fa27-7728-48ea-8b6e-c8f655574df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:51.438086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46fa27-7728-48ea-8b6e-c8f655574df9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:51.454242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 121/240] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:51.460361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bc21c-f55e-4d3d-b5e2-a318339f9818 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:51.472801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fa27-7728-48ea-8b6e-c8f655574df9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:51.538676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:51.560450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:51.613128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fa27-7728-48ea-8b6e-c8f655574df9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:51.656097 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bc21c-f55e-4d3d-b5e2-a318339f9818 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:51.667101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06591e6c-7447-46e3-9fc8-31e9243fb78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:51.667885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06591e6c-7447-46e3-9fc8-31e9243fb78f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:51.668229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06591e6c-7447-46e3-9fc8-31e9243fb78f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:51.668515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06591e6c-7447-46e3-9fc8-31e9243fb78f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:51.669735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06591e6c-7447-46e3-9fc8-31e9243fb78f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:51.672175 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06591e6c-7447-46e3-9fc8-31e9243fb78f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:51.674160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 122/241] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:51.679847 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06591e6c-7447-46e3-9fc8-31e9243fb78f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:51.741205 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6603bc-3598-41f1-a6f7-3f47e2a2a79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:51.744630 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6603bc-3598-41f1-a6f7-3f47e2a2a79c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:51.745099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6603bc-3598-41f1-a6f7-3f47e2a2a79c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:51.745579 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6603bc-3598-41f1-a6f7-3f47e2a2a79c None admin] PATH_INFO: `/v3/users/d90e61ef282f4d52851d8d2c11ad3ff3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:51.773871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6603bc-3598-41f1-a6f7-3f47e2a2a79c None admin] RBAC: Authorizing `identity:get_user(user_id=d90e61ef282f4d52851d8d2c11ad3ff3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:51.776595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6603bc-3598-41f1-a6f7-3f47e2a2a79c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:51.778670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 120/242] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:51 2022] GET /identity/v3/users/d90e61ef282f4d52851d8d2c11ad3ff3 => generated 297 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:51.785059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6603bc-3598-41f1-a6f7-3f47e2a2a79c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:51.892163 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06591e6c-7447-46e3-9fc8-31e9243fb78f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:51.935478 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9736bb-3da6-4ebd-9946-95246b8b90f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:51.937343 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9736bb-3da6-4ebd-9946-95246b8b90f0 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:51.937636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9736bb-3da6-4ebd-9946-95246b8b90f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:51.937917 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9736bb-3da6-4ebd-9946-95246b8b90f0 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:51.938626 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9736bb-3da6-4ebd-9946-95246b8b90f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:51.940096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9736bb-3da6-4ebd-9946-95246b8b90f0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:51.948658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:51.966438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:51.980331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 123/243] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:39:51 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:39:51.982347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd7436-1013-434d-b1fb-fdb0fb95717b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:51.983097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd7436-1013-434d-b1fb-fdb0fb95717b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:51.983587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd7436-1013-434d-b1fb-fdb0fb95717b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:51.984724 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6603bc-3598-41f1-a6f7-3f47e2a2a79c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:51.985906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 124/244] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:51.996213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61988930-ca33-45a9-9db9-9cd75fd870eb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:51.996849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61988930-ca33-45a9-9db9-9cd75fd870eb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:51.997351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61988930-ca33-45a9-9db9-9cd75fd870eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:52.023887 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-61988930-ca33-45a9-9db9-9cd75fd870eb None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:52.027039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-61988930-ca33-45a9-9db9-9cd75fd870eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:52.093037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf85d2-01ff-4dad-958d-c4cdf785af0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:52.094119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf85d2-01ff-4dad-958d-c4cdf785af0a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:52.094412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf85d2-01ff-4dad-958d-c4cdf785af0a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:52.094688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf85d2-01ff-4dad-958d-c4cdf785af0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:52.124658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 125/245] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:52.147697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61988930-ca33-45a9-9db9-9cd75fd870eb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:52.245351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf85d2-01ff-4dad-958d-c4cdf785af0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:52.246934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf85d2-01ff-4dad-958d-c4cdf785af0a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:52.295978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61988930-ca33-45a9-9db9-9cd75fd870eb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:52.338862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:52.354763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0baf7-08f7-41d3-ba1f-1f836f649f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:52.355848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0baf7-08f7-41d3-ba1f-1f836f649f7f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:52.356063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0baf7-08f7-41d3-ba1f-1f836f649f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:52.356474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0baf7-08f7-41d3-ba1f-1f836f649f7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:52.364776 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:52.375697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0baf7-08f7-41d3-ba1f-1f836f649f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6fb0baf7-08f7-41d3-ba1f-1f836f649f7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:52.382983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:52.384462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:52.385245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:52.385245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:52.385245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:52.385245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:52.385245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:52.385245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:52.385245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:52.385245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:52.385245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:52.385245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:52.385245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:52.385245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:52.387718 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 126/246] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:52.394504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0baf7-08f7-41d3-ba1f-1f836f649f7f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:52.396049 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 121/247] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:52.400257 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf85d2-01ff-4dad-958d-c4cdf785af0a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:52.521207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0baf7-08f7-41d3-ba1f-1f836f649f7f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:52.529659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf85d2-01ff-4dad-958d-c4cdf785af0a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:52.574327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19672d9-42da-4c39-a920-e42a653e93e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:52.575093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19672d9-42da-4c39-a920-e42a653e93e5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:52.575385 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19672d9-42da-4c39-a920-e42a653e93e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:52.575662 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19672d9-42da-4c39-a920-e42a653e93e5 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:52.577312 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19672d9-42da-4c39-a920-e42a653e93e5 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:52.579514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19672d9-42da-4c39-a920-e42a653e93e5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:52.581131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5682b-0017-48d0-9a42-6a75a954b514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:52.581690 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 122/248] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:52 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:52.583970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5682b-0017-48d0-9a42-6a75a954b514 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:52.584807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5682b-0017-48d0-9a42-6a75a954b514 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:52.585559 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5682b-0017-48d0-9a42-6a75a954b514 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:52.588328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5682b-0017-48d0-9a42-6a75a954b514 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:52.588624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19672d9-42da-4c39-a920-e42a653e93e5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:52.589449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5682b-0017-48d0-9a42-6a75a954b514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:52.592101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5682b-0017-48d0-9a42-6a75a954b514 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:52.604328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 127/249] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:52.610473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5682b-0017-48d0-9a42-6a75a954b514 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:52.650842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:52.680066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:52.733434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19672d9-42da-4c39-a920-e42a653e93e5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:52.757027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5682b-0017-48d0-9a42-6a75a954b514 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:52.793246 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d974a-a247-444a-bba3-9ff66d40845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:52.794120 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d974a-a247-444a-bba3-9ff66d40845b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:52.794462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d974a-a247-444a-bba3-9ff66d40845b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:52.794851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d974a-a247-444a-bba3-9ff66d40845b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:52.796097 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d974a-a247-444a-bba3-9ff66d40845b None admin] RBAC: Adding query filter params (role.id=6082d88564724bd586ad069364cb597b, scope.project.id=4912877de99b4c50ad5b9ce264b21ce2, user.id=d90e61ef282f4d52851d8d2c11ad3ff3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:52.796597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d974a-a247-444a-bba3-9ff66d40845b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:52.800203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d974a-a247-444a-bba3-9ff66d40845b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:52.808922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 123/250] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:52 2022] GET /identity/v3/role_assignments?user.id=d90e61ef282f4d52851d8d2c11ad3ff3&scope.project.id=4912877de99b4c50ad5b9ce264b21ce2&role.id=6082d88564724bd586ad069364cb597b => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:52.810478 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8907b-6379-489a-a91f-bdc03976eb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:52.811417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8907b-6379-489a-a91f-bdc03976eb76 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:52.811927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8907b-6379-489a-a91f-bdc03976eb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:52.812509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8907b-6379-489a-a91f-bdc03976eb76 None admin] PATH_INFO: `/v3/users/b7a1cbe3e2a8459abd864621b38b5aca` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:52.814142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8907b-6379-489a-a91f-bdc03976eb76 None admin] RBAC: Authorizing `identity:get_user(user_id=b7a1cbe3e2a8459abd864621b38b5aca)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:52.814266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad858b-1512-43db-b0ed-96a6697cb3e2 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:52.814506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad858b-1512-43db-b0ed-96a6697cb3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:52.814828 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad858b-1512-43db-b0ed-96a6697cb3e2 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:52.817646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8907b-6379-489a-a91f-bdc03976eb76 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:52.819801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 128/252] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:52 2022] GET /identity/v3/users/b7a1cbe3e2a8459abd864621b38b5aca => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:52.820209 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 124/252] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:52.823994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a26df-ba18-4561-b0f8-0b4de3b48685 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:52.824606 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a26df-ba18-4561-b0f8-0b4de3b48685 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:52.825080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a26df-ba18-4561-b0f8-0b4de3b48685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:52.829340 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad858b-1512-43db-b0ed-96a6697cb3e2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:52.849743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-473a26df-ba18-4561-b0f8-0b4de3b48685 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:52.851883 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-473a26df-ba18-4561-b0f8-0b4de3b48685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:52.939622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 129/253] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:52.966186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad858b-1512-43db-b0ed-96a6697cb3e2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:52.969069 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a26df-ba18-4561-b0f8-0b4de3b48685 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:52.984908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:53.007192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83b375-6695-43c3-ab5e-073471dd0d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:53.008295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83b375-6695-43c3-ab5e-073471dd0d48 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:53.008831 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83b375-6695-43c3-ab5e-073471dd0d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:53.009343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83b375-6695-43c3-ab5e-073471dd0d48 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:53.010941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83b375-6695-43c3-ab5e-073471dd0d48 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:53.012707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83b375-6695-43c3-ab5e-073471dd0d48 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:53.015283 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 125/254] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:52 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:53.037838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83b375-6695-43c3-ab5e-073471dd0d48 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:53.045695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:53.115083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a26df-ba18-4561-b0f8-0b4de3b48685 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:53.167060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d920ab-fa7c-4986-b910-1999536e03a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:53.167806 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d920ab-fa7c-4986-b910-1999536e03a8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:53.168139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d920ab-fa7c-4986-b910-1999536e03a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:53.168494 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d920ab-fa7c-4986-b910-1999536e03a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:53.183501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d920ab-fa7c-4986-b910-1999536e03a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c2d920ab-fa7c-4986-b910-1999536e03a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:53.190361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:53.191458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:53.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:53.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:53.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:53.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:53.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:53.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:53.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:53.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:53.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:53.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:53.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:39:53.192578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:53.195234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 130/255] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:39:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:53.197949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed32ba-8006-491a-8a00-9937a5db9a9e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:53.198241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed32ba-8006-491a-8a00-9937a5db9a9e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:53.198517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed32ba-8006-491a-8a00-9937a5db9a9e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:53.202327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 131/256] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:53.203569 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed32ba-8006-491a-8a00-9937a5db9a9e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:53.226524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83b375-6695-43c3-ab5e-073471dd0d48 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:53.276467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cd361-8caf-4761-9e86-79f347bcc77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:53.277724 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd361-8caf-4761-9e86-79f347bcc77d None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:53.278254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd361-8caf-4761-9e86-79f347bcc77d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:53.278871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd361-8caf-4761-9e86-79f347bcc77d None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2/users/b7a1cbe3e2a8459abd864621b38b5aca/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:53.281449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cd361-8caf-4761-9e86-79f347bcc77d None admin] RBAC: Authorizing `identity:create_grant(project_id=4912877de99b4c50ad5b9ce264b21ce2, user_id=b7a1cbe3e2a8459abd864621b38b5aca, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:53.283355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cd361-8caf-4761-9e86-79f347bcc77d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:53.299231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 126/257] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:39:53 2022] PUT /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2/users/b7a1cbe3e2a8459abd864621b38b5aca/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:39:53.301091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ae230-2650-41eb-b201-363e6acd8c8c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:53.301672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ae230-2650-41eb-b201-363e6acd8c8c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:53.302156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ae230-2650-41eb-b201-363e6acd8c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:53.325322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a44ae230-2650-41eb-b201-363e6acd8c8c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:53.327366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a44ae230-2650-41eb-b201-363e6acd8c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:53.361940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed32ba-8006-491a-8a00-9937a5db9a9e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:53.371693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:53.386689 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:53.413910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 127/258] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:53.424515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633122b-b57f-4fc2-b834-ce05ed44bd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:53.425263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633122b-b57f-4fc2-b834-ce05ed44bd16 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:53.425549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633122b-b57f-4fc2-b834-ce05ed44bd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:53.425823 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633122b-b57f-4fc2-b834-ce05ed44bd16 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:53.426658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633122b-b57f-4fc2-b834-ce05ed44bd16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:53.426963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633122b-b57f-4fc2-b834-ce05ed44bd16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:53.428539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633122b-b57f-4fc2-b834-ce05ed44bd16 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:53.440734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 132/259] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:39:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:53.446705 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ae230-2650-41eb-b201-363e6acd8c8c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:53.452720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633122b-b57f-4fc2-b834-ce05ed44bd16 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:53.671469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633122b-b57f-4fc2-b834-ce05ed44bd16 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:53.692262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ae230-2650-41eb-b201-363e6acd8c8c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:53.744590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f38c1-8771-465e-a27e-5ec014344bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:53.745901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133fe54-b586-4948-a5d7-630dadd0ef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:53.746353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f38c1-8771-465e-a27e-5ec014344bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:53.746714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133fe54-b586-4948-a5d7-630dadd0ef92 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:53.747059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133fe54-b586-4948-a5d7-630dadd0ef92 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:53.747403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133fe54-b586-4948-a5d7-630dadd0ef92 None admin] PATH_INFO: `/v3/users/9bb0a88278f8432f9b7a5235b76ab422` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:53.747803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f38c1-8771-465e-a27e-5ec014344bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:53.748566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f38c1-8771-465e-a27e-5ec014344bf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:53.752541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133fe54-b586-4948-a5d7-630dadd0ef92 None admin] RBAC: Authorizing `identity:get_user(user_id=9bb0a88278f8432f9b7a5235b76ab422)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:53.754219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133fe54-b586-4948-a5d7-630dadd0ef92 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:53.756270 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 128/260] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:53 2022] GET /identity/v3/users/9bb0a88278f8432f9b7a5235b76ab422 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:53.762604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133fe54-b586-4948-a5d7-630dadd0ef92 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:53.770585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f38c1-8771-465e-a27e-5ec014344bf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ee8f38c1-8771-465e-a27e-5ec014344bf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:53.783135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:53.784833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:53.786387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:53.786387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:53.786387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:53.786387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:53.786387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:53.786387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:53.786387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:53.786387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:53.786387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:53.786387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:53.786387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:39:53.786387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:53.791168 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 133/261] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:39:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:53.800431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f38c1-8771-465e-a27e-5ec014344bf5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:53.831270 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:53.896689 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:53.944338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133fe54-b586-4948-a5d7-630dadd0ef92 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:54.005949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ea0b3-f918-48d5-9256-3486ab3cec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:54.008042 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ea0b3-f918-48d5-9256-3486ab3cec93 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:54.008868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ea0b3-f918-48d5-9256-3486ab3cec93 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:54.009501 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ea0b3-f918-48d5-9256-3486ab3cec93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:54.049222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f38c1-8771-465e-a27e-5ec014344bf5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:54.165642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb699c6b-d2c8-43be-9bfb-5c7752d56e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:54.169248 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb699c6b-d2c8-43be-9bfb-5c7752d56e7d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:54.169967 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb699c6b-d2c8-43be-9bfb-5c7752d56e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:54.170875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb699c6b-d2c8-43be-9bfb-5c7752d56e7d None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:54.173742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb699c6b-d2c8-43be-9bfb-5c7752d56e7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:54.176840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb699c6b-d2c8-43be-9bfb-5c7752d56e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:54.179606 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb699c6b-d2c8-43be-9bfb-5c7752d56e7d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:54.204254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 134/262] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:54.208307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ea0b3-f918-48d5-9256-3486ab3cec93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:54.211461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ea0b3-f918-48d5-9256-3486ab3cec93 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:54.216890 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb699c6b-d2c8-43be-9bfb-5c7752d56e7d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:54.288790 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:54.406671 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 129/263] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:39:54.412788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ea0b3-f918-48d5-9256-3486ab3cec93 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:54.447773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:54.473199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb699c6b-d2c8-43be-9bfb-5c7752d56e7d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:54.573276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933fbab-b9da-4216-b907-889b311b319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:54.574404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933fbab-b9da-4216-b907-889b311b319e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:54.574824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933fbab-b9da-4216-b907-889b311b319e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:54.575312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933fbab-b9da-4216-b907-889b311b319e None admin] PATH_INFO: `/v3/users/9bb0a88278f8432f9b7a5235b76ab422` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:54.581346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933fbab-b9da-4216-b907-889b311b319e None admin] RBAC: Authorizing `identity:get_user(user_id=9bb0a88278f8432f9b7a5235b76ab422)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:54.584291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933fbab-b9da-4216-b907-889b311b319e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:54.589311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 135/264] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:54 2022] GET /identity/v3/users/9bb0a88278f8432f9b7a5235b76ab422 => generated 283 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:54.597421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933fbab-b9da-4216-b907-889b311b319e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:54.701159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ea0b3-f918-48d5-9256-3486ab3cec93 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:54.774343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90591f33-dd4a-4cc9-8c1f-30ee19d58856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:54.774800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591f33-dd4a-4cc9-8c1f-30ee19d58856 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:54.774953 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591f33-dd4a-4cc9-8c1f-30ee19d58856 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:54.775193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591f33-dd4a-4cc9-8c1f-30ee19d58856 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:54.781437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90591f33-dd4a-4cc9-8c1f-30ee19d58856 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:54.783974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90591f33-dd4a-4cc9-8c1f-30ee19d58856 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:54.787269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 130/265] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:54 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:54.793368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90591f33-dd4a-4cc9-8c1f-30ee19d58856 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:54.822082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:54.943711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933fbab-b9da-4216-b907-889b311b319e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:55.067011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90591f33-dd4a-4cc9-8c1f-30ee19d58856 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:55.074727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c7a13-cf4c-4f6e-a82e-9d30ab7f7283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:55.079073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7a13-cf4c-4f6e-a82e-9d30ab7f7283 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:55.079682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7a13-cf4c-4f6e-a82e-9d30ab7f7283 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:55.080195 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7a13-cf4c-4f6e-a82e-9d30ab7f7283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:55.129305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b8521-d983-46db-b057-5dac8d84fcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:55.129947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b8521-d983-46db-b057-5dac8d84fcdb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:55.130225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b8521-d983-46db-b057-5dac8d84fcdb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:55.130483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b8521-d983-46db-b057-5dac8d84fcdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:55.131283 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b8521-d983-46db-b057-5dac8d84fcdb None admin] RBAC: Adding query filter params (role.id=da75e75c3ada4bf1b93ec17d36ff9a0d, scope.project.id=4912877de99b4c50ad5b9ce264b21ce2, user.id=9bb0a88278f8432f9b7a5235b76ab422) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:55.131596 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b8521-d983-46db-b057-5dac8d84fcdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:55.136149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b8521-d983-46db-b057-5dac8d84fcdb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:55.147894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 131/266] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:54 2022] GET /identity/v3/role_assignments?user.id=9bb0a88278f8432f9b7a5235b76ab422&scope.project.id=4912877de99b4c50ad5b9ce264b21ce2&role.id=da75e75c3ada4bf1b93ec17d36ff9a0d => generated 608 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:55.166458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:55.235819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c7a13-cf4c-4f6e-a82e-9d30ab7f7283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:55.237364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c7a13-cf4c-4f6e-a82e-9d30ab7f7283 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:55.387846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 136/267] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 792 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:39:55.394176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b8521-d983-46db-b057-5dac8d84fcdb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:55.527904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd298-6730-406e-a206-49d1533aab3e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:55.528380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:55.536283 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd298-6730-406e-a206-49d1533aab3e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:55.536698 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd298-6730-406e-a206-49d1533aab3e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:55.538166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 137/268] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:39:55.543508 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20053b94-dc7d-417b-aa3b-1bb61a8e0bca None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:55.543796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20053b94-dc7d-417b-aa3b-1bb61a8e0bca None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:55.544080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20053b94-dc7d-417b-aa3b-1bb61a8e0bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:55.573914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b8521-d983-46db-b057-5dac8d84fcdb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:55.577617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-20053b94-dc7d-417b-aa3b-1bb61a8e0bca None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:55.578813 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-20053b94-dc7d-417b-aa3b-1bb61a8e0bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:55.654921 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:55.662869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70159582-a84e-485a-a0dd-f072dd986b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:55.663810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70159582-a84e-485a-a0dd-f072dd986b07 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:55.664225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70159582-a84e-485a-a0dd-f072dd986b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:55.664597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70159582-a84e-485a-a0dd-f072dd986b07 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:55.669710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70159582-a84e-485a-a0dd-f072dd986b07 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:55.670951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 138/269] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:55.671936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70159582-a84e-485a-a0dd-f072dd986b07 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:55.679583 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 132/270] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:55 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:55.684745 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20053b94-dc7d-417b-aa3b-1bb61a8e0bca None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:55.698462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70159582-a84e-485a-a0dd-f072dd986b07 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:55.798954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20053b94-dc7d-417b-aa3b-1bb61a8e0bca None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:55.838929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a940ab-6167-4fc5-aabe-22bda39f9d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:55.839566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a940ab-6167-4fc5-aabe-22bda39f9d7b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:55.839851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a940ab-6167-4fc5-aabe-22bda39f9d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:55.840152 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a940ab-6167-4fc5-aabe-22bda39f9d7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:55.840963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a940ab-6167-4fc5-aabe-22bda39f9d7b None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=4912877de99b4c50ad5b9ce264b21ce2, user.id=9bb0a88278f8432f9b7a5235b76ab422) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:55.841282 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a940ab-6167-4fc5-aabe-22bda39f9d7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:55.842883 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a940ab-6167-4fc5-aabe-22bda39f9d7b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:55.850046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 139/271] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:55 2022] GET /identity/v3/role_assignments?user.id=9bb0a88278f8432f9b7a5235b76ab422&scope.project.id=4912877de99b4c50ad5b9ce264b21ce2&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:55.945864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70159582-a84e-485a-a0dd-f072dd986b07 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:55.997039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d042de4-26d8-4f05-9670-0a81e17bdd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:55.998080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d042de4-26d8-4f05-9670-0a81e17bdd86 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:55.998568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d042de4-26d8-4f05-9670-0a81e17bdd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:55.999084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d042de4-26d8-4f05-9670-0a81e17bdd86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:56.016160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:56.017191 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d042de4-26d8-4f05-9670-0a81e17bdd86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-2d042de4-26d8-4f05-9670-0a81e17bdd86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:56.029091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:56.030062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:56.030835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 133/272] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:56.038573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a940ab-6167-4fc5-aabe-22bda39f9d7b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:56.131797 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:56.183514 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a940ab-6167-4fc5-aabe-22bda39f9d7b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:56.222170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd56e9a-f93f-4132-a3dc-46690eb7dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:56.223194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd56e9a-f93f-4132-a3dc-46690eb7dcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:56.223732 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd56e9a-f93f-4132-a3dc-46690eb7dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:56.224234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd56e9a-f93f-4132-a3dc-46690eb7dcd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:56.225194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd56e9a-f93f-4132-a3dc-46690eb7dcd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:56.225707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd56e9a-f93f-4132-a3dc-46690eb7dcd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:56.228001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd56e9a-f93f-4132-a3dc-46690eb7dcd4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:56.238177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 140/273] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:56.244721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d042de4-26d8-4f05-9670-0a81e17bdd86 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:56.311250 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128efa3-9493-4a56-8585-1d3d7736de87 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:56.311991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128efa3-9493-4a56-8585-1d3d7736de87 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:56.312386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128efa3-9493-4a56-8585-1d3d7736de87 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:56.314033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 141/274] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:39:56.320469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628948f-307b-4f39-a923-cfcf0b0e7c32 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:56.320758 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628948f-307b-4f39-a923-cfcf0b0e7c32 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:56.321077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628948f-307b-4f39-a923-cfcf0b0e7c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:56.343586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2628948f-307b-4f39-a923-cfcf0b0e7c32 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:56.344826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2628948f-307b-4f39-a923-cfcf0b0e7c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:56.390235 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d042de4-26d8-4f05-9670-0a81e17bdd86 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:56.439215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed66d1e-07d2-4676-87b3-7f9496942e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:56.439854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed66d1e-07d2-4676-87b3-7f9496942e92 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:56.440165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed66d1e-07d2-4676-87b3-7f9496942e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:56.440449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed66d1e-07d2-4676-87b3-7f9496942e92 None admin] PATH_INFO: `/v3/users/3f61043a33a24b88af6ce117b9827465` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:56.445615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 142/275] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:56.455195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed66d1e-07d2-4676-87b3-7f9496942e92 None admin] RBAC: Authorizing `identity:get_user(user_id=3f61043a33a24b88af6ce117b9827465)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:56.456739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed66d1e-07d2-4676-87b3-7f9496942e92 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:56.459137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 134/276] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:56 2022] GET /identity/v3/users/3f61043a33a24b88af6ce117b9827465 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:56.464784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628948f-307b-4f39-a923-cfcf0b0e7c32 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:56.475497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed66d1e-07d2-4676-87b3-7f9496942e92 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:56.519480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:56.538582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:56.574416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628948f-307b-4f39-a923-cfcf0b0e7c32 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:56.589237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed66d1e-07d2-4676-87b3-7f9496942e92 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:56.614943 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c383ba9-5f88-436c-8091-d16367391a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:56.615891 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c383ba9-5f88-436c-8091-d16367391a84 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:56.616346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c383ba9-5f88-436c-8091-d16367391a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:56.616767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c383ba9-5f88-436c-8091-d16367391a84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:56.617969 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c383ba9-5f88-436c-8091-d16367391a84 None admin] RBAC: Adding query filter params (role.id=ad3a96ed9c2944be914156fa1c4613af, user.id=3f61043a33a24b88af6ce117b9827465, scope.system=all) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:56.618607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c383ba9-5f88-436c-8091-d16367391a84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:56.620565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c383ba9-5f88-436c-8091-d16367391a84 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:56.626384 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 143/277] 10.222.0.17 () {56 vars in 1308 bytes} [Tue Aug 2 08:39:56 2022] GET /identity/v3/role_assignments?user.id=3f61043a33a24b88af6ce117b9827465&scope.system=all&role.id=ad3a96ed9c2944be914156fa1c4613af => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:56.642265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fff80-b88e-42a3-862f-9ed4170ae4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:56.642819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5392d7-2b31-4fdd-b5b4-40b201cc3964 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:56.643167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fff80-b88e-42a3-862f-9ed4170ae4cd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:56.643304 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5392d7-2b31-4fdd-b5b4-40b201cc3964 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:56.643581 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5392d7-2b31-4fdd-b5b4-40b201cc3964 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:56.643722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fff80-b88e-42a3-862f-9ed4170ae4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:56.644048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fff80-b88e-42a3-862f-9ed4170ae4cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:56.645719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fff80-b88e-42a3-862f-9ed4170ae4cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:56.646210 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 144/278] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:39:56.647819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed57814-179d-46ae-809c-9926bc96e993 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:56.647975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fff80-b88e-42a3-862f-9ed4170ae4cd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:56.648291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed57814-179d-46ae-809c-9926bc96e993 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:56.648675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed57814-179d-46ae-809c-9926bc96e993 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:56.651460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 135/279] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:56.651763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 145/280] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:56.656319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c56cc3-3d29-47a2-b574-d86256eef987 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:56.656836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c56cc3-3d29-47a2-b574-d86256eef987 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:56.657547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c56cc3-3d29-47a2-b574-d86256eef987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:56.661355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed57814-179d-46ae-809c-9926bc96e993 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:56.686563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-42c56cc3-3d29-47a2-b574-d86256eef987 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:56.688620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-42c56cc3-3d29-47a2-b574-d86256eef987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:56.784303 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 136/281] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:56.785680 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e8578-325a-4fef-a4a8-453655bde5be None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:56.786068 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e8578-325a-4fef-a4a8-453655bde5be None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:56.786422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e8578-325a-4fef-a4a8-453655bde5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:56.818547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2a7e8578-325a-4fef-a4a8-453655bde5be None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:56.819760 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2a7e8578-325a-4fef-a4a8-453655bde5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:56.820768 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed57814-179d-46ae-809c-9926bc96e993 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:56.845157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:56.876938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:56.891680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cec68-745a-4c7a-9dbf-b43ae9567bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:56.892333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cec68-745a-4c7a-9dbf-b43ae9567bc3 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:56.892619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cec68-745a-4c7a-9dbf-b43ae9567bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:56.892901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cec68-745a-4c7a-9dbf-b43ae9567bc3 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:56.893594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cec68-745a-4c7a-9dbf-b43ae9567bc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:56.895046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cec68-745a-4c7a-9dbf-b43ae9567bc3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:56.906777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 137/282] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:56.906777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e8578-325a-4fef-a4a8-453655bde5be None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:56.936503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 146/283] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:39:56 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:39:56.936503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cec68-745a-4c7a-9dbf-b43ae9567bc3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:57.051231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e8578-325a-4fef-a4a8-453655bde5be None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:57.096893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32523-3147-4adb-9906-c645d9b7696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:57.098814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32523-3147-4adb-9906-c645d9b7696f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:57.099726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32523-3147-4adb-9906-c645d9b7696f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:57.100452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32523-3147-4adb-9906-c645d9b7696f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:57.119593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e32523-3147-4adb-9906-c645d9b7696f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:57.129044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cec68-745a-4c7a-9dbf-b43ae9567bc3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-71e32523-3147-4adb-9906-c645d9b7696f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:57.129845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:57.130820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:57.131609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 138/284] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:57.139086 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32523-3147-4adb-9906-c645d9b7696f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:57.179597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a9c0e-b7fd-49e9-b840-f98d2d91a249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:57.180706 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a9c0e-b7fd-49e9-b840-f98d2d91a249 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:57.183044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a9c0e-b7fd-49e9-b840-f98d2d91a249 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:57.183044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a9c0e-b7fd-49e9-b840-f98d2d91a249 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:57.205393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a9c0e-b7fd-49e9-b840-f98d2d91a249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:57.208495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b09a9c0e-b7fd-49e9-b840-f98d2d91a249 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:57.214001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:57.215046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:57.215830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:57.215830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:57.215830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:57.215830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:57.215830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:57.215830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:57.215830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:57.215830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:57.215830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:57.215830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:57.215830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:57.215830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:39:57.217066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 147/285] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:57.225554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a9c0e-b7fd-49e9-b840-f98d2d91a249 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:57.275490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:57.287923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32523-3147-4adb-9906-c645d9b7696f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:57.342769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56453833-d872-412e-841e-f933bad124c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:57.343803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56453833-d872-412e-841e-f933bad124c8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:57.344441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56453833-d872-412e-841e-f933bad124c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:57.344823 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56453833-d872-412e-841e-f933bad124c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:57.345775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56453833-d872-412e-841e-f933bad124c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:57.346212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56453833-d872-412e-841e-f933bad124c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:57.347767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56453833-d872-412e-841e-f933bad124c8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:57.359412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 139/286] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:57.366357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56453833-d872-412e-841e-f933bad124c8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:57.392602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a9c0e-b7fd-49e9-b840-f98d2d91a249 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:57.445405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa807c-9659-49f6-acb8-fd0bec55913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:57.446667 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa807c-9659-49f6-acb8-fd0bec55913d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:57.446960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa807c-9659-49f6-acb8-fd0bec55913d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:57.447234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa807c-9659-49f6-acb8-fd0bec55913d None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:57.447959 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa807c-9659-49f6-acb8-fd0bec55913d None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:57.448360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa807c-9659-49f6-acb8-fd0bec55913d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:57.449935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa807c-9659-49f6-acb8-fd0bec55913d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:57.461321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 148/287] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:57.467266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa807c-9659-49f6-acb8-fd0bec55913d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:57.533712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56453833-d872-412e-841e-f933bad124c8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:57.543790 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:57.607230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be298e02-2b9e-4aa0-8383-daf4024e8318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:57.608392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be298e02-2b9e-4aa0-8383-daf4024e8318 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:57.608784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be298e02-2b9e-4aa0-8383-daf4024e8318 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:57.609170 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be298e02-2b9e-4aa0-8383-daf4024e8318 None admin] PATH_INFO: `/v3/users/d90e61ef282f4d52851d8d2c11ad3ff3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:57.609759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:57.610986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be298e02-2b9e-4aa0-8383-daf4024e8318 None admin] RBAC: Authorizing `identity:get_user(user_id=d90e61ef282f4d52851d8d2c11ad3ff3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:57.613368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be298e02-2b9e-4aa0-8383-daf4024e8318 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:57.615936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 140/288] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:57 2022] GET /identity/v3/users/d90e61ef282f4d52851d8d2c11ad3ff3 => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:39:57.624968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be298e02-2b9e-4aa0-8383-daf4024e8318 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:57.630430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa807c-9659-49f6-acb8-fd0bec55913d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:57.724013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06675cff-9e88-4b07-a944-f52c37312435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:57.725074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06675cff-9e88-4b07-a944-f52c37312435 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:57.725551 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06675cff-9e88-4b07-a944-f52c37312435 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:57.726020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06675cff-9e88-4b07-a944-f52c37312435 None admin] PATH_INFO: `/v3/users/b7a1cbe3e2a8459abd864621b38b5aca` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:57.730190 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06675cff-9e88-4b07-a944-f52c37312435 None admin] RBAC: Authorizing `identity:get_user(user_id=b7a1cbe3e2a8459abd864621b38b5aca)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:57.731942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06675cff-9e88-4b07-a944-f52c37312435 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:57.734291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 149/289] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:57 2022] GET /identity/v3/users/b7a1cbe3e2a8459abd864621b38b5aca => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:57.745792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06675cff-9e88-4b07-a944-f52c37312435 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:57.796908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be298e02-2b9e-4aa0-8383-daf4024e8318 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:57.845468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241debcb-a8d1-444d-91fd-29fb1594d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:57.846236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241debcb-a8d1-444d-91fd-29fb1594d077 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:57.846520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241debcb-a8d1-444d-91fd-29fb1594d077 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:57.846800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241debcb-a8d1-444d-91fd-29fb1594d077 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:57.853521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241debcb-a8d1-444d-91fd-29fb1594d077 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:57.855014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241debcb-a8d1-444d-91fd-29fb1594d077 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:57.857147 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 141/290] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:57 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:57.864105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241debcb-a8d1-444d-91fd-29fb1594d077 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:57.900296 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06675cff-9e88-4b07-a944-f52c37312435 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:57.942994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10d6b6-0e45-4e22-8fd2-878385612576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:57.943635 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10d6b6-0e45-4e22-8fd2-878385612576 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:57.943921 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10d6b6-0e45-4e22-8fd2-878385612576 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:57.944223 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10d6b6-0e45-4e22-8fd2-878385612576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:57.959799 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:58.008488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:58.082353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241debcb-a8d1-444d-91fd-29fb1594d077 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:58.085011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10d6b6-0e45-4e22-8fd2-878385612576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:58.087727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10d6b6-0e45-4e22-8fd2-878385612576 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:58.153589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f8bef-56cb-4002-b177-3e0d1e372de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:58.154249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8bef-56cb-4002-b177-3e0d1e372de3 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:58.154539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8bef-56cb-4002-b177-3e0d1e372de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:58.154823 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8bef-56cb-4002-b177-3e0d1e372de3 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2/users/d90e61ef282f4d52851d8d2c11ad3ff3/roles/6082d88564724bd586ad069364cb597b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:58.161465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f8bef-56cb-4002-b177-3e0d1e372de3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4912877de99b4c50ad5b9ce264b21ce2, user_id=d90e61ef282f4d52851d8d2c11ad3ff3, role_id=6082d88564724bd586ad069364cb597b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:58.162962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f8bef-56cb-4002-b177-3e0d1e372de3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:58.194152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 142/291] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:39:57 2022] PUT /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2/users/d90e61ef282f4d52851d8d2c11ad3ff3/roles/6082d88564724bd586ad069364cb597b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:39:58.241660 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 150/292] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:39:58.249318 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f8bef-56cb-4002-b177-3e0d1e372de3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:58.390416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f8bef-56cb-4002-b177-3e0d1e372de3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:58.392143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:58.432877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f8dfd-a43d-4311-a601-9712ec10376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:58.433458 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f8dfd-a43d-4311-a601-9712ec10376d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:58.433744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f8dfd-a43d-4311-a601-9712ec10376d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:58.434017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f8dfd-a43d-4311-a601-9712ec10376d None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:58.435243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f8dfd-a43d-4311-a601-9712ec10376d None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:58.436746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f8dfd-a43d-4311-a601-9712ec10376d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:58.438734 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 143/293] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:39:58 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:58.444379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10d6b6-0e45-4e22-8fd2-878385612576 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:58.515087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:58.561328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10d6b6-0e45-4e22-8fd2-878385612576 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:58.607109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf838ba7-4fb1-422d-9fe0-470d24e98f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:58.607858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf838ba7-4fb1-422d-9fe0-470d24e98f68 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:58.608227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf838ba7-4fb1-422d-9fe0-470d24e98f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:58.608509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf838ba7-4fb1-422d-9fe0-470d24e98f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:58.609355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf838ba7-4fb1-422d-9fe0-470d24e98f68 None admin] RBAC: Adding query filter params (role.id=ad3a96ed9c2944be914156fa1c4613af, scope.project.id=4912877de99b4c50ad5b9ce264b21ce2, user.id=b7a1cbe3e2a8459abd864621b38b5aca) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:58.609670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf838ba7-4fb1-422d-9fe0-470d24e98f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:58.611109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf838ba7-4fb1-422d-9fe0-470d24e98f68 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:58.617663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 151/294] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:39:58 2022] GET /identity/v3/role_assignments?user.id=b7a1cbe3e2a8459abd864621b38b5aca&scope.project.id=4912877de99b4c50ad5b9ce264b21ce2&role.id=ad3a96ed9c2944be914156fa1c4613af => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:58.997360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89587e7e-cb4c-4e8b-bb04-671200c8268d None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:58.997360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89587e7e-cb4c-4e8b-bb04-671200c8268d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:58.997360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89587e7e-cb4c-4e8b-bb04-671200c8268d None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:58.997360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 144/295] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:59.006392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f8e12-ea93-43d7-a947-cdf05f513f0a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:59.006392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f8e12-ea93-43d7-a947-cdf05f513f0a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:59.006392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f8e12-ea93-43d7-a947-cdf05f513f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:59.023601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c24f8e12-ea93-43d7-a947-cdf05f513f0a None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:59.025861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c24f8e12-ea93-43d7-a947-cdf05f513f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:59.098872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 152/296] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:59.125506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89587e7e-cb4c-4e8b-bb04-671200c8268d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:59.248535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89587e7e-cb4c-4e8b-bb04-671200c8268d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:59.286798 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb07a9-5da0-4b80-a2be-bf901e74d938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:59.287814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb07a9-5da0-4b80-a2be-bf901e74d938 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:59.288329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb07a9-5da0-4b80-a2be-bf901e74d938 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:59.288806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb07a9-5da0-4b80-a2be-bf901e74d938 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:59.300668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb07a9-5da0-4b80-a2be-bf901e74d938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-76fb07a9-5da0-4b80-a2be-bf901e74d938 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:59.306785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:39:59.307659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:39:59.308495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:39:59.308495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:39:59.308495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:39:59.308495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:39:59.308495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:39:59.308495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:39:59.308495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:39:59.308495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:39:59.308495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:39:59.308495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:39:59.308495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:39:59.308495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:39:59.311100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 145/297] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:39:59.317111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f8e12-ea93-43d7-a947-cdf05f513f0a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:59.387005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:59.445860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f8e12-ea93-43d7-a947-cdf05f513f0a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:59.481260 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efc0da-b74b-4a68-91e3-65cf8f38fdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:59.482286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efc0da-b74b-4a68-91e3-65cf8f38fdfe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:59.482884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efc0da-b74b-4a68-91e3-65cf8f38fdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:59.483360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efc0da-b74b-4a68-91e3-65cf8f38fdfe None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:59.484312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efc0da-b74b-4a68-91e3-65cf8f38fdfe None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:39:59.484852 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efc0da-b74b-4a68-91e3-65cf8f38fdfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:59.486423 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efc0da-b74b-4a68-91e3-65cf8f38fdfe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:59.495715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 153/298] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:39:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:59.501735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb07a9-5da0-4b80-a2be-bf901e74d938 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:59.535544 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:59.612112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb07a9-5da0-4b80-a2be-bf901e74d938 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:59.612342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bc52f-e08d-4163-a369-da95d2966b97 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:59.612425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bc52f-e08d-4163-a369-da95d2966b97 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:59.612682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bc52f-e08d-4163-a369-da95d2966b97 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:59.614259 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 154/299] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:59.619305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0de624-93e8-4a7f-b501-ac9b23b389ba None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:59.619587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0de624-93e8-4a7f-b501-ac9b23b389ba None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:59.619863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0de624-93e8-4a7f-b501-ac9b23b389ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:59.643675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-da0de624-93e8-4a7f-b501-ac9b23b389ba None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:59.645614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-da0de624-93e8-4a7f-b501-ac9b23b389ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:59.650552 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88812c-470b-43cf-b5be-072cefaa84bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:59.651225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88812c-470b-43cf-b5be-072cefaa84bf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:59.651504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88812c-470b-43cf-b5be-072cefaa84bf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:59.651777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88812c-470b-43cf-b5be-072cefaa84bf None admin] PATH_INFO: `/v3/users/3f61043a33a24b88af6ce117b9827465` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:59.653152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88812c-470b-43cf-b5be-072cefaa84bf None admin] RBAC: Authorizing `identity:get_user(user_id=3f61043a33a24b88af6ce117b9827465)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:59.655259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88812c-470b-43cf-b5be-072cefaa84bf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:59.657787 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 146/300] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:39:59 2022] GET /identity/v3/users/3f61043a33a24b88af6ce117b9827465 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:39:59.663554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88812c-470b-43cf-b5be-072cefaa84bf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:59.722344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 155/301] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:39:59.723494 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094b96f-7b88-4fc8-8016-9097287ae591 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:59.723790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094b96f-7b88-4fc8-8016-9097287ae591 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:59.724076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094b96f-7b88-4fc8-8016-9097287ae591 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:59.725494 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 156/302] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:39:59.731573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c286-333e-452c-b5f3-5676e1b10496 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:59.731573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c286-333e-452c-b5f3-5676e1b10496 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:59.731759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c286-333e-452c-b5f3-5676e1b10496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:59.750181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d7f3c286-333e-452c-b5f3-5676e1b10496 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:39:59.751395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d7f3c286-333e-452c-b5f3-5676e1b10496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:39:59.778334 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:59.782733 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88812c-470b-43cf-b5be-072cefaa84bf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:59.795025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:39:59.824240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 157/303] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:39:59.825095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c286-333e-452c-b5f3-5676e1b10496 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:59.834995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580c99-4a90-4212-aba1-ef964d5214a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:59.835918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580c99-4a90-4212-aba1-ef964d5214a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:59.836433 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580c99-4a90-4212-aba1-ef964d5214a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:59.836945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580c99-4a90-4212-aba1-ef964d5214a4 None admin] PATH_INFO: `/v3/system/users/3f61043a33a24b88af6ce117b9827465/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:59.838717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9580c99-4a90-4212-aba1-ef964d5214a4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3f61043a33a24b88af6ce117b9827465, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:39:59.840347 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9580c99-4a90-4212-aba1-ef964d5214a4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:39:59.851673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 147/304] 10.222.0.17 () {58 vars in 1334 bytes} [Tue Aug 2 08:39:59 2022] PUT /identity/v3/system/users/3f61043a33a24b88af6ce117b9827465/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:39:59.852894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580c99-4a90-4212-aba1-ef964d5214a4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:39:59.941647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c286-333e-452c-b5f3-5676e1b10496 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:59.974279 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580c99-4a90-4212-aba1-ef964d5214a4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:39:59.979297 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5bc93-2d20-40fb-a019-a24d1af280cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:39:59.979949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5bc93-2d20-40fb-a019-a24d1af280cb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:39:59.980277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5bc93-2d20-40fb-a019-a24d1af280cb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:39:59.980551 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5bc93-2d20-40fb-a019-a24d1af280cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:39:59.993517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5bc93-2d20-40fb-a019-a24d1af280cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c7c5bc93-2d20-40fb-a019-a24d1af280cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:39:59.999151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:00.000093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:00.000922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 158/305] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:39:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:00.007187 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5bc93-2d20-40fb-a019-a24d1af280cb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:00.014866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9733b-1b80-4488-ae74-d25b4c2997b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:00.015521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9733b-1b80-4488-ae74-d25b4c2997b0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:00.015807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9733b-1b80-4488-ae74-d25b4c2997b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:00.016087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9733b-1b80-4488-ae74-d25b4c2997b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:00.017315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9733b-1b80-4488-ae74-d25b4c2997b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:00.018853 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9733b-1b80-4488-ae74-d25b4c2997b0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:00.020534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 148/306] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:39:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:00.026099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9733b-1b80-4488-ae74-d25b4c2997b0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:00.045009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:00.064263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:00.139170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5bc93-2d20-40fb-a019-a24d1af280cb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:00.141540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9733b-1b80-4488-ae74-d25b4c2997b0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:00.180637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abbc52-68a3-4abd-8425-efe3fa1060c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:00.181272 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abbc52-68a3-4abd-8425-efe3fa1060c1 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:00.181560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abbc52-68a3-4abd-8425-efe3fa1060c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:00.181839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abbc52-68a3-4abd-8425-efe3fa1060c1 None admin] PATH_INFO: `/v3/groups` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:00.182505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abbc52-68a3-4abd-8425-efe3fa1060c1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:00.183953 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abbc52-68a3-4abd-8425-efe3fa1060c1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:00.184963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff777a-f2ca-4576-9665-21c2ad660774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:00.185593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff777a-f2ca-4576-9665-21c2ad660774 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:00.185958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff777a-f2ca-4576-9665-21c2ad660774 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:00.186233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff777a-f2ca-4576-9665-21c2ad660774 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:00.187107 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff777a-f2ca-4576-9665-21c2ad660774 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:00.187413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff777a-f2ca-4576-9665-21c2ad660774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:00.189178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff777a-f2ca-4576-9665-21c2ad660774 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:00.204329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 159/307] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:40:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:00.205564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff777a-f2ca-4576-9665-21c2ad660774 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:00.209673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 149/308] 10.222.0.17 () {60 vars in 1134 bytes} [Tue Aug 2 08:40:00 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:40:00.323611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:00.331497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff777a-f2ca-4576-9665-21c2ad660774 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:00.371067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3705eed-f926-4538-9cc1-525550599bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:00.372081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3705eed-f926-4538-9cc1-525550599bff None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:00.372388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3705eed-f926-4538-9cc1-525550599bff None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:00.372680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3705eed-f926-4538-9cc1-525550599bff None admin] PATH_INFO: `/v3/users/201d8d9f51bf4b78bbfe63251dd04a19` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:00.388648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3705eed-f926-4538-9cc1-525550599bff None admin] RBAC: Authorizing `identity:get_user(user_id=201d8d9f51bf4b78bbfe63251dd04a19)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:00.390474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3705eed-f926-4538-9cc1-525550599bff None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:00.392399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 160/309] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:40:00 2022] GET /identity/v3/users/201d8d9f51bf4b78bbfe63251dd04a19 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:00.398118 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abbc52-68a3-4abd-8425-efe3fa1060c1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:00.501735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:00.511593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abbc52-68a3-4abd-8425-efe3fa1060c1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:00.553117 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4219d-f1ef-43d7-8752-6e85a1b59cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:00.554113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4219d-f1ef-43d7-8752-6e85a1b59cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:00.554601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4219d-f1ef-43d7-8752-6e85a1b59cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:00.555079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4219d-f1ef-43d7-8752-6e85a1b59cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:00.556169 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4219d-f1ef-43d7-8752-6e85a1b59cf5 None admin] RBAC: Adding query filter params (role.id=6082d88564724bd586ad069364cb597b, user.id=201d8d9f51bf4b78bbfe63251dd04a19, scope.system=all) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:00.556745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4219d-f1ef-43d7-8752-6e85a1b59cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:00.558473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4219d-f1ef-43d7-8752-6e85a1b59cf5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:00.564415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 150/310] 10.222.0.17 () {56 vars in 1308 bytes} [Tue Aug 2 08:40:00 2022] GET /identity/v3/role_assignments?user.id=201d8d9f51bf4b78bbfe63251dd04a19&scope.system=all&role.id=6082d88564724bd586ad069364cb597b => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:00.598052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791698c-bc9d-45ee-bb06-d5e89de844f7 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:00.598718 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791698c-bc9d-45ee-bb06-d5e89de844f7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:00.599199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791698c-bc9d-45ee-bb06-d5e89de844f7 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:00.600963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 161/311] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:00.607570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dd61e-5f84-4b70-b8bf-d16620dfdad5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:00.608230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dd61e-5f84-4b70-b8bf-d16620dfdad5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:00.608717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dd61e-5f84-4b70-b8bf-d16620dfdad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:00.628850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8b0dd61e-5f84-4b70-b8bf-d16620dfdad5 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:00.630458 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8b0dd61e-5f84-4b70-b8bf-d16620dfdad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:00.706298 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 151/312] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:00.734117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791698c-bc9d-45ee-bb06-d5e89de844f7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:00.848489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791698c-bc9d-45ee-bb06-d5e89de844f7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:00.884425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4486a22-9eb8-4ed1-b52a-96889304252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:00.885076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4486a22-9eb8-4ed1-b52a-96889304252f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:00.885362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4486a22-9eb8-4ed1-b52a-96889304252f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:00.885702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4486a22-9eb8-4ed1-b52a-96889304252f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:00.897000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4486a22-9eb8-4ed1-b52a-96889304252f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f4486a22-9eb8-4ed1-b52a-96889304252f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:00.903467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:00.904381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:00.905307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 162/313] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:00.911736 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dd61e-5f84-4b70-b8bf-d16620dfdad5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:01.010543 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:01.028170 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dd61e-5f84-4b70-b8bf-d16620dfdad5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:01.069977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9d8c9-b510-41de-a7c6-6d547df31f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:01.070542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9d8c9-b510-41de-a7c6-6d547df31f6c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:01.070830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9d8c9-b510-41de-a7c6-6d547df31f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:01.071142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9d8c9-b510-41de-a7c6-6d547df31f6c None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:01.071882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9d8c9-b510-41de-a7c6-6d547df31f6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:01.072238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9d8c9-b510-41de-a7c6-6d547df31f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:01.073666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9d8c9-b510-41de-a7c6-6d547df31f6c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:01.083265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 152/314] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:40:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:01.089935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4486a22-9eb8-4ed1-b52a-96889304252f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:01.108040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:01.197258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4486a22-9eb8-4ed1-b52a-96889304252f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:01.233503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8f46a-b49a-4c2b-af0c-80da3dd4eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:01.234149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8f46a-b49a-4c2b-af0c-80da3dd4eeaa None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:01.234435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8f46a-b49a-4c2b-af0c-80da3dd4eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:01.234714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8f46a-b49a-4c2b-af0c-80da3dd4eeaa None admin] PATH_INFO: `/v3/users/d90e61ef282f4d52851d8d2c11ad3ff3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:01.235893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8f46a-b49a-4c2b-af0c-80da3dd4eeaa None admin] RBAC: Authorizing `identity:get_user(user_id=d90e61ef282f4d52851d8d2c11ad3ff3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:01.237491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8f46a-b49a-4c2b-af0c-80da3dd4eeaa None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:01.239267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 163/315] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:40:01 2022] GET /identity/v3/users/d90e61ef282f4d52851d8d2c11ad3ff3 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:01.244742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9d8c9-b510-41de-a7c6-6d547df31f6c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:01.351085 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9d8c9-b510-41de-a7c6-6d547df31f6c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:01.388150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420b3b6-650e-42a0-ac77-d7f776762bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:01.389262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420b3b6-650e-42a0-ac77-d7f776762bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:01.389746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420b3b6-650e-42a0-ac77-d7f776762bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:01.390217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420b3b6-650e-42a0-ac77-d7f776762bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:01.409253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:01.467014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420b3b6-650e-42a0-ac77-d7f776762bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:01.469043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420b3b6-650e-42a0-ac77-d7f776762bf2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:01.569228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 153/316] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:01.580242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8f46a-b49a-4c2b-af0c-80da3dd4eeaa None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:01.665616 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:01.685604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8f46a-b49a-4c2b-af0c-80da3dd4eeaa None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:01.722276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457408a-8ad0-4791-a434-736d74c020de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:01.722927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457408a-8ad0-4791-a434-736d74c020de None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:01.723211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457408a-8ad0-4791-a434-736d74c020de None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:01.723887 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457408a-8ad0-4791-a434-736d74c020de None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:01.725084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457408a-8ad0-4791-a434-736d74c020de None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:01.726550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457408a-8ad0-4791-a434-736d74c020de None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:01.728834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 164/317] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:01 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:01.735061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420b3b6-650e-42a0-ac77-d7f776762bf2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:01.785520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:01.842746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420b3b6-650e-42a0-ac77-d7f776762bf2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:01.881409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcdc6a-bd07-4086-86fe-ad2819de7550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:01.882380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcdc6a-bd07-4086-86fe-ad2819de7550 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:01.882849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcdc6a-bd07-4086-86fe-ad2819de7550 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:01.883305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcdc6a-bd07-4086-86fe-ad2819de7550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:01.884374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcdc6a-bd07-4086-86fe-ad2819de7550 None admin] RBAC: Adding query filter params (role.id=6082d88564724bd586ad069364cb597b, scope.project.id=4912877de99b4c50ad5b9ce264b21ce2, user.id=d90e61ef282f4d52851d8d2c11ad3ff3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:01.884869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcdc6a-bd07-4086-86fe-ad2819de7550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:01.886603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcdc6a-bd07-4086-86fe-ad2819de7550 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:01.893540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 154/318] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:01 2022] GET /identity/v3/role_assignments?user.id=d90e61ef282f4d52851d8d2c11ad3ff3&scope.project.id=4912877de99b4c50ad5b9ce264b21ce2&role.id=6082d88564724bd586ad069364cb597b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:02.119841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fbcc2-39b9-4270-b2b7-50d9b2242046 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:02.120578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fbcc2-39b9-4270-b2b7-50d9b2242046 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:02.121085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fbcc2-39b9-4270-b2b7-50d9b2242046 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:02.122908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 165/319] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:02.128489 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad09ad-a36e-4cf6-8285-b54801cfcac4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:02.128784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad09ad-a36e-4cf6-8285-b54801cfcac4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:02.129073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad09ad-a36e-4cf6-8285-b54801cfcac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:02.147322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-faad09ad-a36e-4cf6-8285-b54801cfcac4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:02.148552 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-faad09ad-a36e-4cf6-8285-b54801cfcac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:02.216784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 155/320] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:02.239288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fbcc2-39b9-4270-b2b7-50d9b2242046 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:02.337716 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980b42-9cd6-4709-b038-1f4c9219abbf None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:02.337994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980b42-9cd6-4709-b038-1f4c9219abbf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:02.338272 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980b42-9cd6-4709-b038-1f4c9219abbf None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:02.339749 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 156/321] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:40:02.344566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312c564-4d6e-4ca4-8b8a-14b798d87f64 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:02.344855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312c564-4d6e-4ca4-8b8a-14b798d87f64 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:02.345136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312c564-4d6e-4ca4-8b8a-14b798d87f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:02.346035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fbcc2-39b9-4270-b2b7-50d9b2242046 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:02.362637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1312c564-4d6e-4ca4-8b8a-14b798d87f64 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:02.363816 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1312c564-4d6e-4ca4-8b8a-14b798d87f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:02.380988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca31959-08f9-4dbb-9105-ef1c8560602c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:02.381565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca31959-08f9-4dbb-9105-ef1c8560602c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:02.381851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca31959-08f9-4dbb-9105-ef1c8560602c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:02.382164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca31959-08f9-4dbb-9105-ef1c8560602c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:02.393886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca31959-08f9-4dbb-9105-ef1c8560602c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-3ca31959-08f9-4dbb-9105-ef1c8560602c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:02.399981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:02.400849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:02.401647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 166/322] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:02.402722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:02.407023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca31959-08f9-4dbb-9105-ef1c8560602c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:02.420233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:02.442223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 157/323] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:40:02.466153 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312c564-4d6e-4ca4-8b8a-14b798d87f64 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:02.517946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca31959-08f9-4dbb-9105-ef1c8560602c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:02.558344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c841c-547e-4873-a775-5a4b8c998942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:02.558983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c841c-547e-4873-a775-5a4b8c998942 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:02.559264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c841c-547e-4873-a775-5a4b8c998942 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:02.559542 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c841c-547e-4873-a775-5a4b8c998942 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:02.560294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c841c-547e-4873-a775-5a4b8c998942 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:02.560629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c841c-547e-4873-a775-5a4b8c998942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:02.562075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c841c-547e-4873-a775-5a4b8c998942 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:02.570365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 167/324] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:40:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:02.571662 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312c564-4d6e-4ca4-8b8a-14b798d87f64 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:02.576574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c841c-547e-4873-a775-5a4b8c998942 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:02.608772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4fb9c-1125-4890-8f5f-08b6210ae517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:02.609429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4fb9c-1125-4890-8f5f-08b6210ae517 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:02.609705 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4fb9c-1125-4890-8f5f-08b6210ae517 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:02.609976 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4fb9c-1125-4890-8f5f-08b6210ae517 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:02.611107 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4fb9c-1125-4890-8f5f-08b6210ae517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:02.612599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4fb9c-1125-4890-8f5f-08b6210ae517 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:02.618941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 158/325] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:02.620365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4fb9c-1125-4890-8f5f-08b6210ae517 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:02.653195 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:02.663245 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:02.688269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c841c-547e-4873-a775-5a4b8c998942 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:02.724741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4fb9c-1125-4890-8f5f-08b6210ae517 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:02.725212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230507c1-dc2a-49e4-b15a-85116287f5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:02.726036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230507c1-dc2a-49e4-b15a-85116287f5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:02.726506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230507c1-dc2a-49e4-b15a-85116287f5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:02.727034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230507c1-dc2a-49e4-b15a-85116287f5c4 None admin] PATH_INFO: `/v3/users/3f61043a33a24b88af6ce117b9827465` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:02.728642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230507c1-dc2a-49e4-b15a-85116287f5c4 None admin] RBAC: Authorizing `identity:get_user(user_id=3f61043a33a24b88af6ce117b9827465)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:02.730088 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230507c1-dc2a-49e4-b15a-85116287f5c4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:02.731711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 168/326] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:40:02 2022] GET /identity/v3/users/3f61043a33a24b88af6ce117b9827465 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:02.733266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d797-d2c5-416f-99d2-10703575d3a9 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:02.733554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d797-d2c5-416f-99d2-10703575d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:02.733827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d797-d2c5-416f-99d2-10703575d3a9 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:02.735301 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 169/327] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:02.737777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1d797-d2c5-416f-99d2-10703575d3a9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:02.763019 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f84e37-3033-4bd3-8417-b20f0602ce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:02.763909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f84e37-3033-4bd3-8417-b20f0602ce13 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:02.764236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f84e37-3033-4bd3-8417-b20f0602ce13 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:02.764516 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f84e37-3033-4bd3-8417-b20f0602ce13 None admin] PATH_INFO: `/v3/groups` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:02.765379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f84e37-3033-4bd3-8417-b20f0602ce13 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:02.767357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f84e37-3033-4bd3-8417-b20f0602ce13 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:02.785526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 159/328] 10.222.0.17 () {60 vars in 1134 bytes} [Tue Aug 2 08:40:02 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:40:02.787435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879ba01-85d1-4805-a4ff-06cf1a55bf12 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:02.787899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879ba01-85d1-4805-a4ff-06cf1a55bf12 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:02.788357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879ba01-85d1-4805-a4ff-06cf1a55bf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:02.815878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8879ba01-85d1-4805-a4ff-06cf1a55bf12 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:02.817233 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8879ba01-85d1-4805-a4ff-06cf1a55bf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:02.869819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1d797-d2c5-416f-99d2-10703575d3a9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:02.897680 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 160/329] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:02.907043 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcd160-615b-4abe-8a54-fc95cb54359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:02.907607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcd160-615b-4abe-8a54-fc95cb54359c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:02.907886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcd160-615b-4abe-8a54-fc95cb54359c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:02.908187 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcd160-615b-4abe-8a54-fc95cb54359c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:02.909002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcd160-615b-4abe-8a54-fc95cb54359c None admin] RBAC: Adding query filter params (role.id=ad3a96ed9c2944be914156fa1c4613af, user.id=3f61043a33a24b88af6ce117b9827465, scope.system=all) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:02.909387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcd160-615b-4abe-8a54-fc95cb54359c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:02.910857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcd160-615b-4abe-8a54-fc95cb54359c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:02.918889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:02.919688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879ba01-85d1-4805-a4ff-06cf1a55bf12 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:02.936155 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 170/330] 10.222.0.17 () {56 vars in 1308 bytes} [Tue Aug 2 08:40:02 2022] GET /identity/v3/role_assignments?user.id=3f61043a33a24b88af6ce117b9827465&scope.system=all&role.id=ad3a96ed9c2944be914156fa1c4613af => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:02.952948 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:03.040810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879ba01-85d1-4805-a4ff-06cf1a55bf12 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:03.090395 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678aee-8d36-4f94-9126-4d5971e4e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:03.091317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678aee-8d36-4f94-9126-4d5971e4e501 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:03.091717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678aee-8d36-4f94-9126-4d5971e4e501 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:03.092193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678aee-8d36-4f94-9126-4d5971e4e501 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:03.111888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9678aee-8d36-4f94-9126-4d5971e4e501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c9678aee-8d36-4f94-9126-4d5971e4e501 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:03.120073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:03.121052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:03.121841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:03.121841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:03.121841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:03.121841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:03.121841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:03.121841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:03.121841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:03.121841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:03.121841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:03.121841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:03.121841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:40:03.121841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:03.122444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 161/331] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:40:03.131861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcd160-615b-4abe-8a54-fc95cb54359c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:03.265342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcd160-615b-4abe-8a54-fc95cb54359c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:03.303586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dd3b9-3d7a-476f-a9ad-ce01128b2eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:03.305058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dd3b9-3d7a-476f-a9ad-ce01128b2eea None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:03.305058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dd3b9-3d7a-476f-a9ad-ce01128b2eea None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:03.305058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dd3b9-3d7a-476f-a9ad-ce01128b2eea None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:03.306405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dd3b9-3d7a-476f-a9ad-ce01128b2eea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:03.306405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dd3b9-3d7a-476f-a9ad-ce01128b2eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:03.307800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dd3b9-3d7a-476f-a9ad-ce01128b2eea None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:03.317584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 171/332] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:40:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:03.324793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678aee-8d36-4f94-9126-4d5971e4e501 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:03.425826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:03.439710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678aee-8d36-4f94-9126-4d5971e4e501 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:03.479227 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fb71c-3eda-45d7-b595-355d5ae34e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:03.480010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb71c-3eda-45d7-b595-355d5ae34e93 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:03.480565 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb71c-3eda-45d7-b595-355d5ae34e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:03.480930 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb71c-3eda-45d7-b595-355d5ae34e93 None admin] PATH_INFO: `/v3/users/201d8d9f51bf4b78bbfe63251dd04a19` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:03.482137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fb71c-3eda-45d7-b595-355d5ae34e93 None admin] RBAC: Authorizing `identity:get_user(user_id=201d8d9f51bf4b78bbfe63251dd04a19)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:03.483655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fb71c-3eda-45d7-b595-355d5ae34e93 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:03.485255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 162/333] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:40:03 2022] GET /identity/v3/users/201d8d9f51bf4b78bbfe63251dd04a19 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:03.491085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dd3b9-3d7a-476f-a9ad-ce01128b2eea None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:03.563538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:03.609884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dd3b9-3d7a-476f-a9ad-ce01128b2eea None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:03.653714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2dcdc-07c1-4824-b5e5-03e93968c4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:03.654523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2dcdc-07c1-4824-b5e5-03e93968c4d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:03.654757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2dcdc-07c1-4824-b5e5-03e93968c4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:03.655035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2dcdc-07c1-4824-b5e5-03e93968c4d1 None admin] PATH_INFO: `/v3/system/users/201d8d9f51bf4b78bbfe63251dd04a19/roles/6082d88564724bd586ad069364cb597b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:03.656607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2dcdc-07c1-4824-b5e5-03e93968c4d1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=201d8d9f51bf4b78bbfe63251dd04a19, role_id=6082d88564724bd586ad069364cb597b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:03.658159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2dcdc-07c1-4824-b5e5-03e93968c4d1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:03.682481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 172/334] 10.222.0.17 () {58 vars in 1334 bytes} [Tue Aug 2 08:40:03 2022] PUT /identity/v3/system/users/201d8d9f51bf4b78bbfe63251dd04a19/roles/6082d88564724bd586ad069364cb597b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:40:05.198483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c0b40-1b52-4d6f-8b56-b2e63d26a73a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:05.199357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c0b40-1b52-4d6f-8b56-b2e63d26a73a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:05.199790 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c0b40-1b52-4d6f-8b56-b2e63d26a73a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:05.201604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 163/335] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:05.206920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf07603-49cf-47f5-903e-36cc41c30ebc None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:05.207410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf07603-49cf-47f5-903e-36cc41c30ebc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:05.207492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf07603-49cf-47f5-903e-36cc41c30ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:05.233339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0cf07603-49cf-47f5-903e-36cc41c30ebc None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:05.234567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0cf07603-49cf-47f5-903e-36cc41c30ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:05.320865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 173/336] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:05.349185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c0b40-1b52-4d6f-8b56-b2e63d26a73a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:05.477856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c0b40-1b52-4d6f-8b56-b2e63d26a73a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:05.521306 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd934ff-ef39-429b-a90d-b9b7d61e7850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:05.521952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd934ff-ef39-429b-a90d-b9b7d61e7850 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:05.522239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd934ff-ef39-429b-a90d-b9b7d61e7850 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:05.522521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd934ff-ef39-429b-a90d-b9b7d61e7850 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:05.539191 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd934ff-ef39-429b-a90d-b9b7d61e7850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8cd934ff-ef39-429b-a90d-b9b7d61e7850 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:05.544354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:05.545341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:05.547278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 164/337] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:05.553455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf07603-49cf-47f5-903e-36cc41c30ebc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:05.636712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:05.694937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf07603-49cf-47f5-903e-36cc41c30ebc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:05.739740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45b523-a73e-432a-a417-96247b074d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:05.740359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45b523-a73e-432a-a417-96247b074d5e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:05.740644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45b523-a73e-432a-a417-96247b074d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:05.740921 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45b523-a73e-432a-a417-96247b074d5e None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:05.741651 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45b523-a73e-432a-a417-96247b074d5e None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:05.741961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45b523-a73e-432a-a417-96247b074d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:05.743874 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45b523-a73e-432a-a417-96247b074d5e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:05.753096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 174/338] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:40:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:05.759300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd934ff-ef39-429b-a90d-b9b7d61e7850 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:05.802017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:05.918960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd934ff-ef39-429b-a90d-b9b7d61e7850 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:05.959444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e8cb-9c40-49ce-8119-641a112e2e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:05.960067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e8cb-9c40-49ce-8119-641a112e2e89 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:05.960386 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e8cb-9c40-49ce-8119-641a112e2e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:05.960663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e8cb-9c40-49ce-8119-641a112e2e89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:05.965416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bda531-1fa6-4c39-87d5-1a5f070925e9 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:05.965980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bda531-1fa6-4c39-87d5-1a5f070925e9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:05.966474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bda531-1fa6-4c39-87d5-1a5f070925e9 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:05.968357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 175/339] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:05.973225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6293f-d370-4af5-8b99-f0f0507b646c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:05.973749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6293f-d370-4af5-8b99-f0f0507b646c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:05.974224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6293f-d370-4af5-8b99-f0f0507b646c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:06.020637 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-acf6293f-d370-4af5-8b99-f0f0507b646c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:06.022178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-acf6293f-d370-4af5-8b99-f0f0507b646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:06.039322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8e8cb-9c40-49ce-8119-641a112e2e89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:06.041484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8e8cb-9c40-49ce-8119-641a112e2e89 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:06.092497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:06.177961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 176/340] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:06.178800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b5649-a57e-4982-b35c-57ca1549fd07 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:06.179165 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b5649-a57e-4982-b35c-57ca1549fd07 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:06.179453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b5649-a57e-4982-b35c-57ca1549fd07 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:06.182548 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 177/341] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:06.186568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ba147-98e5-4d67-bb26-d0c3356db995 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:06.186863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ba147-98e5-4d67-bb26-d0c3356db995 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:06.187162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ba147-98e5-4d67-bb26-d0c3356db995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:06.210594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 165/342] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:06.216962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e8cb-9c40-49ce-8119-641a112e2e89 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:06.218162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-901ba147-98e5-4d67-bb26-d0c3356db995 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:06.219364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-901ba147-98e5-4d67-bb26-d0c3356db995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:06.296480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:06.362421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 178/343] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:06.363381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ba147-98e5-4d67-bb26-d0c3356db995 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:06.435137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e8cb-9c40-49ce-8119-641a112e2e89 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:06.456224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:06.491119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ba147-98e5-4d67-bb26-d0c3356db995 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:06.496226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05924285-2368-49db-9aba-4b66aa7694d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:06.496893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05924285-2368-49db-9aba-4b66aa7694d8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:06.497179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05924285-2368-49db-9aba-4b66aa7694d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:06.497458 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05924285-2368-49db-9aba-4b66aa7694d8 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:06.499868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05924285-2368-49db-9aba-4b66aa7694d8 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:06.501416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05924285-2368-49db-9aba-4b66aa7694d8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:06.503551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 166/344] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:06 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:06.504432 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05924285-2368-49db-9aba-4b66aa7694d8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:06.543012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df122d-450a-49d2-8285-be483c21b800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:06.543668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df122d-450a-49d2-8285-be483c21b800 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:06.543949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df122d-450a-49d2-8285-be483c21b800 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:06.544252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df122d-450a-49d2-8285-be483c21b800 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:06.556575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df122d-450a-49d2-8285-be483c21b800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-89df122d-450a-49d2-8285-be483c21b800 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:06.562060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:06.562948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:06.563735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:06.563735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:06.563735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:06.563735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:06.563735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:06.563735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:06.563735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:06.563735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:06.563735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:06.563735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:06.563735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:06.563735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:06.565610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 179/345] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:40:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:06.566351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69973bbe-c9b2-4ee7-a99a-746def6f9046 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:06.566635 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69973bbe-c9b2-4ee7-a99a-746def6f9046 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:06.567003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69973bbe-c9b2-4ee7-a99a-746def6f9046 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:06.568440 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 180/346] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:06.573189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69973bbe-c9b2-4ee7-a99a-746def6f9046 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:06.616529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:06.623176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05924285-2368-49db-9aba-4b66aa7694d8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:06.661329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bac5f-febd-42b1-860d-fe2abe6dd130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:06.661990 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bac5f-febd-42b1-860d-fe2abe6dd130 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:06.662276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bac5f-febd-42b1-860d-fe2abe6dd130 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:06.662594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bac5f-febd-42b1-860d-fe2abe6dd130 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:06.674702 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bac5f-febd-42b1-860d-fe2abe6dd130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-037bac5f-febd-42b1-860d-fe2abe6dd130 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:06.679849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:06.682037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 167/347] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:06.684073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bac5f-febd-42b1-860d-fe2abe6dd130 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:06.692978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69973bbe-c9b2-4ee7-a99a-746def6f9046 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:06.733849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231f3e6-55b8-4c48-8bb2-73850e10447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:06.734524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231f3e6-55b8-4c48-8bb2-73850e10447e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:06.735033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:06.735580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231f3e6-55b8-4c48-8bb2-73850e10447e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:06.735860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231f3e6-55b8-4c48-8bb2-73850e10447e None admin] PATH_INFO: `/v3/groups/4cf27da541c94bae89bd81b0e37799d7` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:06.742467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231f3e6-55b8-4c48-8bb2-73850e10447e None admin] RBAC: Authorizing `identity:get_group(group_id=4cf27da541c94bae89bd81b0e37799d7)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:06.744916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231f3e6-55b8-4c48-8bb2-73850e10447e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:06.746857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 181/348] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:06 2022] GET /identity/v3/groups/4cf27da541c94bae89bd81b0e37799d7 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:06.752685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec1c2e-dd43-4b42-a13b-63bb66e2f105 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:06.752997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec1c2e-dd43-4b42-a13b-63bb66e2f105 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:06.753344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec1c2e-dd43-4b42-a13b-63bb66e2f105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:06.775323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-19ec1c2e-dd43-4b42-a13b-63bb66e2f105 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:06.777098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-19ec1c2e-dd43-4b42-a13b-63bb66e2f105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:06.795403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bac5f-febd-42b1-860d-fe2abe6dd130 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:06.834436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a138c-ace0-41fc-b768-8ca3c12ea449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:06.834991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a138c-ace0-41fc-b768-8ca3c12ea449 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:06.835369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a138c-ace0-41fc-b768-8ca3c12ea449 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:06.835652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a138c-ace0-41fc-b768-8ca3c12ea449 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:06.836527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a138c-ace0-41fc-b768-8ca3c12ea449 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:06.837368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a138c-ace0-41fc-b768-8ca3c12ea449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:06.838824 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a138c-ace0-41fc-b768-8ca3c12ea449 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:06.850433 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 168/349] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:06.851291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a138c-ace0-41fc-b768-8ca3c12ea449 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:06.852955 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 182/350] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:06.855954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec1c2e-dd43-4b42-a13b-63bb66e2f105 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:06.912672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:06.978069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a138c-ace0-41fc-b768-8ca3c12ea449 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:06.988102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:07.004885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec1c2e-dd43-4b42-a13b-63bb66e2f105 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:07.023688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6fe43-6fc2-4ae4-8ba9-fcc7001c557e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:07.027573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6fe43-6fc2-4ae4-8ba9-fcc7001c557e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:07.027573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6fe43-6fc2-4ae4-8ba9-fcc7001c557e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:07.027573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6fe43-6fc2-4ae4-8ba9-fcc7001c557e None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:07.027573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6fe43-6fc2-4ae4-8ba9-fcc7001c557e None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:07.027573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6fe43-6fc2-4ae4-8ba9-fcc7001c557e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:07.028212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6fe43-6fc2-4ae4-8ba9-fcc7001c557e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:07.038012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 169/351] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:40:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:07.038936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6fe43-6fc2-4ae4-8ba9-fcc7001c557e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:07.054363 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed71d71-9a05-4cc4-8411-3ad277103155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:07.054988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed71d71-9a05-4cc4-8411-3ad277103155 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:07.055755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed71d71-9a05-4cc4-8411-3ad277103155 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:07.056032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed71d71-9a05-4cc4-8411-3ad277103155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:07.056862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed71d71-9a05-4cc4-8411-3ad277103155 None admin] RBAC: Adding query filter params (group.id=4cf27da541c94bae89bd81b0e37799d7, role.id=ad3a96ed9c2944be914156fa1c4613af, scope.project.id=d7240a923ed848ce82516c291da74aea) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:07.057176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed71d71-9a05-4cc4-8411-3ad277103155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:07.058616 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed71d71-9a05-4cc4-8411-3ad277103155 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:07.066742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 183/352] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Aug 2 08:40:06 2022] GET /identity/v3/role_assignments?group.id=4cf27da541c94bae89bd81b0e37799d7&scope.project.id=d7240a923ed848ce82516c291da74aea&role.id=ad3a96ed9c2944be914156fa1c4613af => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:07.067598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed71d71-9a05-4cc4-8411-3ad277103155 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:07.162678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6fe43-6fc2-4ae4-8ba9-fcc7001c557e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:07.198053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:07.208392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed71d71-9a05-4cc4-8411-3ad277103155 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:07.210993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8effb9a-8376-4dbe-b717-e7a7ca251660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:07.213848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8effb9a-8376-4dbe-b717-e7a7ca251660 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:07.214339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8effb9a-8376-4dbe-b717-e7a7ca251660 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:07.214789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8effb9a-8376-4dbe-b717-e7a7ca251660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:07.260574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03252547-612c-4ccc-b9a2-761a000c77df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:07.262267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03252547-612c-4ccc-b9a2-761a000c77df None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:07.262647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03252547-612c-4ccc-b9a2-761a000c77df None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:07.263021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03252547-612c-4ccc-b9a2-761a000c77df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:07.268552 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:07.278307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03252547-612c-4ccc-b9a2-761a000c77df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-03252547-612c-4ccc-b9a2-761a000c77df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:07.284923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:07.285853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 184/353] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:40:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:07.288892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976d1d-21e2-4e17-93d9-b5f6b3a49a9d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:07.289621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976d1d-21e2-4e17-93d9-b5f6b3a49a9d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:07.289621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976d1d-21e2-4e17-93d9-b5f6b3a49a9d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:07.290684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 185/354] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:07.291290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60976d1d-21e2-4e17-93d9-b5f6b3a49a9d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:07.327810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8effb9a-8376-4dbe-b717-e7a7ca251660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:07.329514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8effb9a-8376-4dbe-b717-e7a7ca251660 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:07.422882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60976d1d-21e2-4e17-93d9-b5f6b3a49a9d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:07.458421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 170/355] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:07.459856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8effb9a-8376-4dbe-b717-e7a7ca251660 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:07.478178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca40d34-545c-4be3-aa09-d4e0e7c21154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:07.479593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca40d34-545c-4be3-aa09-d4e0e7c21154 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:07.480342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca40d34-545c-4be3-aa09-d4e0e7c21154 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:07.480832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca40d34-545c-4be3-aa09-d4e0e7c21154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:07.511468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:07.561551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:07.576539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca40d34-545c-4be3-aa09-d4e0e7c21154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:07.578355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca40d34-545c-4be3-aa09-d4e0e7c21154 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:07.606496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8effb9a-8376-4dbe-b717-e7a7ca251660 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:07.654101 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5f750-98c4-4b7b-a322-ba1f86b6455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:07.654977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5f750-98c4-4b7b-a322-ba1f86b6455f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:07.655260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5f750-98c4-4b7b-a322-ba1f86b6455f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:07.655843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5f750-98c4-4b7b-a322-ba1f86b6455f None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:07.657115 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5f750-98c4-4b7b-a322-ba1f86b6455f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:07.657438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5f750-98c4-4b7b-a322-ba1f86b6455f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:07.659038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5f750-98c4-4b7b-a322-ba1f86b6455f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:07.669002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 171/356] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:07.674729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2913-56a7-4736-b98b-3a41d90fc4f1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:07.674964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2913-56a7-4736-b98b-3a41d90fc4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:07.675243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2913-56a7-4736-b98b-3a41d90fc4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:07.698343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fc1e2913-56a7-4736-b98b-3a41d90fc4f1 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:07.700168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fc1e2913-56a7-4736-b98b-3a41d90fc4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:07.709389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 186/357] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:07.710446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca40d34-545c-4be3-aa09-d4e0e7c21154 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:07.780660 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:07.795852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 172/358] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:07.797341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e8bb4-6df5-4819-8eae-c998d849d104 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:07.797790 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e8bb4-6df5-4819-8eae-c998d849d104 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:07.798077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e8bb4-6df5-4819-8eae-c998d849d104 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:07.801311 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 173/359] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:07.801450 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e8bb4-6df5-4819-8eae-c998d849d104 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:07.854288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca40d34-545c-4be3-aa09-d4e0e7c21154 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:07.896219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:07.912453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673907ae-030b-4654-8471-9ea1540bada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:07.912780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673907ae-030b-4654-8471-9ea1540bada0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:07.912974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673907ae-030b-4654-8471-9ea1540bada0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:07.913325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673907ae-030b-4654-8471-9ea1540bada0 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:07.916541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673907ae-030b-4654-8471-9ea1540bada0 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:07.917994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673907ae-030b-4654-8471-9ea1540bada0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:07.919835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 187/360] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:07 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:07.920990 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673907ae-030b-4654-8471-9ea1540bada0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:07.960253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e8bb4-6df5-4819-8eae-c998d849d104 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:08.004163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75379ec3-f849-49ca-b5f3-c85db97cc08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:08.004794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75379ec3-f849-49ca-b5f3-c85db97cc08d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:08.005078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75379ec3-f849-49ca-b5f3-c85db97cc08d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:08.005357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75379ec3-f849-49ca-b5f3-c85db97cc08d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:08.062308 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673907ae-030b-4654-8471-9ea1540bada0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:08.084494 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75379ec3-f849-49ca-b5f3-c85db97cc08d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:08.085972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75379ec3-f849-49ca-b5f3-c85db97cc08d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:08.089359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:08.106488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede81e5-cf85-4e8c-971e-06bc71de2148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:08.107198 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede81e5-cf85-4e8c-971e-06bc71de2148 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:08.107623 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede81e5-cf85-4e8c-971e-06bc71de2148 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:08.107986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede81e5-cf85-4e8c-971e-06bc71de2148 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:08.111106 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede81e5-cf85-4e8c-971e-06bc71de2148 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:08.113657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede81e5-cf85-4e8c-971e-06bc71de2148 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:08.116438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 188/361] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:07 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:08.118486 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7d463-e580-4ace-8d18-33e480f70a90 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:08.119161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7d463-e580-4ace-8d18-33e480f70a90 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:08.119455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7d463-e580-4ace-8d18-33e480f70a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:08.142635 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a7c7d463-e580-4ace-8d18-33e480f70a90 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:08.143973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a7c7d463-e580-4ace-8d18-33e480f70a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:08.168746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:08.222961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 174/362] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:08.224722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75379ec3-f849-49ca-b5f3-c85db97cc08d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:08.249526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 189/363] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:08.250482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7d463-e580-4ace-8d18-33e480f70a90 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:08.362654 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75379ec3-f849-49ca-b5f3-c85db97cc08d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:08.374111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7d463-e580-4ace-8d18-33e480f70a90 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:08.408539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:08.417223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc60c19-e952-4951-a6ff-c8c0a04f2edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:08.418343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc60c19-e952-4951-a6ff-c8c0a04f2edf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:08.418850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc60c19-e952-4951-a6ff-c8c0a04f2edf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:08.419369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc60c19-e952-4951-a6ff-c8c0a04f2edf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:08.427093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2b5ea-f615-42b0-96d1-bf4aaa53ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:08.427908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b5ea-f615-42b0-96d1-bf4aaa53ba50 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:08.428404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b5ea-f615-42b0-96d1-bf4aaa53ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:08.428698 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b5ea-f615-42b0-96d1-bf4aaa53ba50 None admin] PATH_INFO: `/v3/groups/4cf27da541c94bae89bd81b0e37799d7` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:08.430021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2b5ea-f615-42b0-96d1-bf4aaa53ba50 None admin] RBAC: Authorizing `identity:get_group(group_id=4cf27da541c94bae89bd81b0e37799d7)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:08.431835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2b5ea-f615-42b0-96d1-bf4aaa53ba50 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:08.433137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc60c19-e952-4951-a6ff-c8c0a04f2edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:08.434091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 190/364] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:08 2022] GET /identity/v3/groups/4cf27da541c94bae89bd81b0e37799d7 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:08.434880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2b5ea-f615-42b0-96d1-bf4aaa53ba50 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-abc60c19-e952-4951-a6ff-c8c0a04f2edf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:08.439262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:08.440204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 175/365] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:08.441421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc60c19-e952-4951-a6ff-c8c0a04f2edf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:08.466768 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:08.573056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc60c19-e952-4951-a6ff-c8c0a04f2edf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:08.576378 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2b5ea-f615-42b0-96d1-bf4aaa53ba50 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:08.619798 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad3c04-c758-4103-b1bc-4a0d278fda49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:08.620786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad3c04-c758-4103-b1bc-4a0d278fda49 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:08.621073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad3c04-c758-4103-b1bc-4a0d278fda49 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:08.621349 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad3c04-c758-4103-b1bc-4a0d278fda49 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:08.622513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad3c04-c758-4103-b1bc-4a0d278fda49 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:08.623982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad3c04-c758-4103-b1bc-4a0d278fda49 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:08.625834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 176/366] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:08 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:08.626141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a48cd7-5faa-444d-a1c3-99d39f329332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:08.627028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a48cd7-5faa-444d-a1c3-99d39f329332 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:08.627515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a48cd7-5faa-444d-a1c3-99d39f329332 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:08.627625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad3c04-c758-4103-b1bc-4a0d278fda49 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:08.628098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a48cd7-5faa-444d-a1c3-99d39f329332 None admin] PATH_INFO: `/v3/groups/4cf27da541c94bae89bd81b0e37799d7` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:08.629556 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a48cd7-5faa-444d-a1c3-99d39f329332 None admin] RBAC: Authorizing `identity:get_group(group_id=4cf27da541c94bae89bd81b0e37799d7)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:08.632747 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a48cd7-5faa-444d-a1c3-99d39f329332 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:08.635201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 191/367] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:08 2022] GET /identity/v3/groups/4cf27da541c94bae89bd81b0e37799d7 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:08.636197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a48cd7-5faa-444d-a1c3-99d39f329332 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:08.713361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:08.755911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:08.767191 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a48cd7-5faa-444d-a1c3-99d39f329332 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:08.769137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad3c04-c758-4103-b1bc-4a0d278fda49 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:08.823210 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e38d8-2520-4bed-8caa-0ad9cf20444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:08.823624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202762d-0032-433a-936d-5a10c76d45d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:08.824320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202762d-0032-433a-936d-5a10c76d45d5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:08.824642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202762d-0032-433a-936d-5a10c76d45d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:08.824905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e38d8-2520-4bed-8caa-0ad9cf20444e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:08.825006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202762d-0032-433a-936d-5a10c76d45d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:08.825455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e38d8-2520-4bed-8caa-0ad9cf20444e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:08.825732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e38d8-2520-4bed-8caa-0ad9cf20444e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:08.825843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202762d-0032-433a-936d-5a10c76d45d5 None admin] RBAC: Adding query filter params (group.id=4cf27da541c94bae89bd81b0e37799d7, role.id=da75e75c3ada4bf1b93ec17d36ff9a0d, scope.project.id=d7240a923ed848ce82516c291da74aea) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:08.826107 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202762d-0032-433a-936d-5a10c76d45d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:08.828172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202762d-0032-433a-936d-5a10c76d45d5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:08.839098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 192/368] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Aug 2 08:40:08 2022] GET /identity/v3/role_assignments?group.id=4cf27da541c94bae89bd81b0e37799d7&scope.project.id=d7240a923ed848ce82516c291da74aea&role.id=da75e75c3ada4bf1b93ec17d36ff9a0d => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:08.840955 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202762d-0032-433a-936d-5a10c76d45d5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:08.848720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e38d8-2520-4bed-8caa-0ad9cf20444e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-078e38d8-2520-4bed-8caa-0ad9cf20444e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:08.856105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:08.857081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:08.857867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:08.857867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:08.857867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:08.857867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:08.857867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:08.857867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:08.857867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:08.857867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:08.857867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:08.857867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:08.857867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:08.857867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:08.860686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 177/369] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:08.861948 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e38d8-2520-4bed-8caa-0ad9cf20444e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:08.986203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202762d-0032-433a-936d-5a10c76d45d5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:08.999280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e38d8-2520-4bed-8caa-0ad9cf20444e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:09.019128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:09.034977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c059ad-2dd1-49d7-8d68-de46bc02cdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:09.035725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c059ad-2dd1-49d7-8d68-de46bc02cdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:09.036014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c059ad-2dd1-49d7-8d68-de46bc02cdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:09.037142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c059ad-2dd1-49d7-8d68-de46bc02cdc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:09.037784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c059ad-2dd1-49d7-8d68-de46bc02cdc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:09.038099 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c059ad-2dd1-49d7-8d68-de46bc02cdc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:09.040188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c059ad-2dd1-49d7-8d68-de46bc02cdc1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:09.053448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 193/370] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:40:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:09.058772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c059ad-2dd1-49d7-8d68-de46bc02cdc1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:09.059323 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884c88-2661-4dd3-a885-477cda3e0ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:09.060229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884c88-2661-4dd3-a885-477cda3e0ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:09.060806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884c88-2661-4dd3-a885-477cda3e0ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:09.061314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884c88-2661-4dd3-a885-477cda3e0ed7 None admin] PATH_INFO: `/v3/groups/4cf27da541c94bae89bd81b0e37799d7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:09.064006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c884c88-2661-4dd3-a885-477cda3e0ed7 None admin] RBAC: Authorizing `identity:get_group(group_id=4cf27da541c94bae89bd81b0e37799d7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:09.065705 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c884c88-2661-4dd3-a885-477cda3e0ed7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:09.068414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 178/371] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:08 2022] GET /identity/v3/groups/4cf27da541c94bae89bd81b0e37799d7 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:09.069400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884c88-2661-4dd3-a885-477cda3e0ed7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:09.095052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:09.193409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c059ad-2dd1-49d7-8d68-de46bc02cdc1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:09.201545 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884c88-2661-4dd3-a885-477cda3e0ed7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:09.238733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674bf0c-49f3-4126-b9d3-caedaa224bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:09.239401 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674bf0c-49f3-4126-b9d3-caedaa224bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:09.239910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674bf0c-49f3-4126-b9d3-caedaa224bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:09.240030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674bf0c-49f3-4126-b9d3-caedaa224bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:09.240894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674bf0c-49f3-4126-b9d3-caedaa224bf6 None admin] RBAC: Adding query filter params (group.id=4cf27da541c94bae89bd81b0e37799d7, role.id=ad3a96ed9c2944be914156fa1c4613af, scope.project.id=4912877de99b4c50ad5b9ce264b21ce2) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:09.241216 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674bf0c-49f3-4126-b9d3-caedaa224bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:09.243362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674bf0c-49f3-4126-b9d3-caedaa224bf6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:09.250090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96495bfb-34ee-4cbc-9850-fdaf42b5c469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:09.250614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 194/372] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Aug 2 08:40:09 2022] GET /identity/v3/role_assignments?group.id=4cf27da541c94bae89bd81b0e37799d7&scope.project.id=4912877de99b4c50ad5b9ce264b21ce2&role.id=ad3a96ed9c2944be914156fa1c4613af => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:09.251467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96495bfb-34ee-4cbc-9850-fdaf42b5c469 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:09.251573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674bf0c-49f3-4126-b9d3-caedaa224bf6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:09.252171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96495bfb-34ee-4cbc-9850-fdaf42b5c469 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:09.252703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96495bfb-34ee-4cbc-9850-fdaf42b5c469 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:09.253673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96495bfb-34ee-4cbc-9850-fdaf42b5c469 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:09.254561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96495bfb-34ee-4cbc-9850-fdaf42b5c469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:09.257333 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96495bfb-34ee-4cbc-9850-fdaf42b5c469 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:09.269959 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 179/373] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:09.271158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96495bfb-34ee-4cbc-9850-fdaf42b5c469 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:09.322004 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:09.369765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:09.394872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674bf0c-49f3-4126-b9d3-caedaa224bf6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:09.396593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96495bfb-34ee-4cbc-9850-fdaf42b5c469 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:09.434416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce9b33-c00d-4f3c-93ce-ee1e9e56d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:09.435079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce9b33-c00d-4f3c-93ce-ee1e9e56d83c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:09.435364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce9b33-c00d-4f3c-93ce-ee1e9e56d83c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:09.435752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce9b33-c00d-4f3c-93ce-ee1e9e56d83c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:09.436707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce9b33-c00d-4f3c-93ce-ee1e9e56d83c None admin] RBAC: Adding query filter params (group.id=4cf27da541c94bae89bd81b0e37799d7, role.id=da75e75c3ada4bf1b93ec17d36ff9a0d, scope.project.id=4912877de99b4c50ad5b9ce264b21ce2) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:09.437025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce9b33-c00d-4f3c-93ce-ee1e9e56d83c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:09.438179 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a3b03-b59a-4a8f-954b-9030b9ab4362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:09.438497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce9b33-c00d-4f3c-93ce-ee1e9e56d83c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:09.439290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a3b03-b59a-4a8f-954b-9030b9ab4362 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:09.439775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a3b03-b59a-4a8f-954b-9030b9ab4362 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:09.440315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a3b03-b59a-4a8f-954b-9030b9ab4362 None admin] PATH_INFO: `/v3/users/201d8d9f51bf4b78bbfe63251dd04a19` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:09.441925 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a3b03-b59a-4a8f-954b-9030b9ab4362 None admin] RBAC: Authorizing `identity:get_user(user_id=201d8d9f51bf4b78bbfe63251dd04a19)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:09.443578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a3b03-b59a-4a8f-954b-9030b9ab4362 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:09.445089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 180/374] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Aug 2 08:40:09 2022] GET /identity/v3/role_assignments?group.id=4cf27da541c94bae89bd81b0e37799d7&scope.project.id=4912877de99b4c50ad5b9ce264b21ce2&role.id=da75e75c3ada4bf1b93ec17d36ff9a0d => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:09.445708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 195/375] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:40:09 2022] GET /identity/v3/users/201d8d9f51bf4b78bbfe63251dd04a19 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:09.448243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce9b33-c00d-4f3c-93ce-ee1e9e56d83c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:09.451892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a3b03-b59a-4a8f-954b-9030b9ab4362 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:09.566922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce9b33-c00d-4f3c-93ce-ee1e9e56d83c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:09.588407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a3b03-b59a-4a8f-954b-9030b9ab4362 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:09.605835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:09.608104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009616e-72c6-4f31-af64-6af37a0c23dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:09.609198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009616e-72c6-4f31-af64-6af37a0c23dd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:09.609623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009616e-72c6-4f31-af64-6af37a0c23dd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:09.610119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009616e-72c6-4f31-af64-6af37a0c23dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:09.623969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:09.632603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc41b9f-3254-4a71-b68c-026f13f1a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:09.634055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc41b9f-3254-4a71-b68c-026f13f1a8dc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:09.634526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc41b9f-3254-4a71-b68c-026f13f1a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:09.634988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc41b9f-3254-4a71-b68c-026f13f1a8dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:09.635976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc41b9f-3254-4a71-b68c-026f13f1a8dc None admin] RBAC: Adding query filter params (role.id=6082d88564724bd586ad069364cb597b, user.id=201d8d9f51bf4b78bbfe63251dd04a19, scope.system=all) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:09.636495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc41b9f-3254-4a71-b68c-026f13f1a8dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:09.638161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc41b9f-3254-4a71-b68c-026f13f1a8dc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:09.652471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 196/376] 10.222.0.17 () {56 vars in 1308 bytes} [Tue Aug 2 08:40:09 2022] GET /identity/v3/role_assignments?user.id=201d8d9f51bf4b78bbfe63251dd04a19&scope.system=all&role.id=6082d88564724bd586ad069364cb597b => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:09.654051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6ba72-4b01-41fd-a629-740b9fe6099e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:09.654533 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6ba72-4b01-41fd-a629-740b9fe6099e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:09.655026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6ba72-4b01-41fd-a629-740b9fe6099e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:09.656977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 197/377] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:09.663092 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942e70a-c6c3-4c32-9b2f-f72bedfda8b3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:09.663684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942e70a-c6c3-4c32-9b2f-f72bedfda8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:09.664169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942e70a-c6c3-4c32-9b2f-f72bedfda8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:09.685347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3942e70a-c6c3-4c32-9b2f-f72bedfda8b3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:09.686998 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3942e70a-c6c3-4c32-9b2f-f72bedfda8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:09.689313 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009616e-72c6-4f31-af64-6af37a0c23dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:09.691472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009616e-72c6-4f31-af64-6af37a0c23dd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:09.777909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 198/378] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:40:09.818712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942e70a-c6c3-4c32-9b2f-f72bedfda8b3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:09.825727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 181/379] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:09.831554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009616e-72c6-4f31-af64-6af37a0c23dd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:09.912568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:09.970224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009616e-72c6-4f31-af64-6af37a0c23dd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:09.985231 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942e70a-c6c3-4c32-9b2f-f72bedfda8b3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:09.986258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:10.024571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687c119-c3a9-4be9-a6ce-66c108074b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:10.025576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687c119-c3a9-4be9-a6ce-66c108074b02 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:10.026082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687c119-c3a9-4be9-a6ce-66c108074b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:10.026557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cb33c-0f10-4f05-9cdd-74e526d9bfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:10.026824 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687c119-c3a9-4be9-a6ce-66c108074b02 None admin] PATH_INFO: `/v3/projects/373878c44f1d4227ba8ac54103602eff` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:10.027599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cb33c-0f10-4f05-9cdd-74e526d9bfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:10.027599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cb33c-0f10-4f05-9cdd-74e526d9bfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:10.027763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cb33c-0f10-4f05-9cdd-74e526d9bfc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:10.028996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687c119-c3a9-4be9-a6ce-66c108074b02 None admin] RBAC: Authorizing `identity:get_project(project_id=373878c44f1d4227ba8ac54103602eff)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:10.030786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687c119-c3a9-4be9-a6ce-66c108074b02 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:10.032747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 182/380] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:09 2022] GET /identity/v3/projects/373878c44f1d4227ba8ac54103602eff => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:10.039571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cb33c-0f10-4f05-9cdd-74e526d9bfc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:10.039798 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687c119-c3a9-4be9-a6ce-66c108074b02 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-262cb33c-0f10-4f05-9cdd-74e526d9bfc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:10.046146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:10.047044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:10.047803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:10.047803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:10.047803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:10.047803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:10.047803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:10.047803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:10.047803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:10.047803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:10.047803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:10.047803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:10.047803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:10.047803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:10.052365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 199/381] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:10.053046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cb33c-0f10-4f05-9cdd-74e526d9bfc2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:10.154090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687c119-c3a9-4be9-a6ce-66c108074b02 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:10.166928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:10.193652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4af9ca-81a3-41fb-9db2-aeff7f22637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:10.194375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4af9ca-81a3-41fb-9db2-aeff7f22637b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:10.194665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4af9ca-81a3-41fb-9db2-aeff7f22637b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:10.194961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4af9ca-81a3-41fb-9db2-aeff7f22637b None admin] PATH_INFO: `/v3/groups/65245891d9e746c5aafb9730a9bd9a51` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:10.204332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4af9ca-81a3-41fb-9db2-aeff7f22637b None admin] RBAC: Authorizing `identity:get_group(group_id=65245891d9e746c5aafb9730a9bd9a51)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:10.205808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4af9ca-81a3-41fb-9db2-aeff7f22637b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:10.207527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 183/382] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:10 2022] GET /identity/v3/groups/65245891d9e746c5aafb9730a9bd9a51 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:10.213686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4af9ca-81a3-41fb-9db2-aeff7f22637b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:10.298085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cb33c-0f10-4f05-9cdd-74e526d9bfc2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:10.319897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4af9ca-81a3-41fb-9db2-aeff7f22637b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:10.356915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36109d39-053e-439b-a188-e43dd0934984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:10.357601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36109d39-053e-439b-a188-e43dd0934984 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:10.358061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36109d39-053e-439b-a188-e43dd0934984 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:10.358351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36109d39-053e-439b-a188-e43dd0934984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:10.359215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36109d39-053e-439b-a188-e43dd0934984 None admin] RBAC: Adding query filter params (group.id=65245891d9e746c5aafb9730a9bd9a51, role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=373878c44f1d4227ba8ac54103602eff) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:10.359537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36109d39-053e-439b-a188-e43dd0934984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:10.361040 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36109d39-053e-439b-a188-e43dd0934984 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:10.367232 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 184/383] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Aug 2 08:40:10 2022] GET /identity/v3/role_assignments?group.id=65245891d9e746c5aafb9730a9bd9a51&scope.project.id=373878c44f1d4227ba8ac54103602eff&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:10.372994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9df720-56c0-4834-9093-2bcd462d6d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:10.374030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9df720-56c0-4834-9093-2bcd462d6d99 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:10.374550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9df720-56c0-4834-9093-2bcd462d6d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:10.375020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9df720-56c0-4834-9093-2bcd462d6d99 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:10.375977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9df720-56c0-4834-9093-2bcd462d6d99 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:10.376522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9df720-56c0-4834-9093-2bcd462d6d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:10.378278 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9df720-56c0-4834-9093-2bcd462d6d99 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:10.400262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 200/384] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:40:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:10.405878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36109d39-053e-439b-a188-e43dd0934984 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:10.464639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:10.544333 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36109d39-053e-439b-a188-e43dd0934984 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:10.603806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf33476-34a1-43a6-8c35-12b44ed0d5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:10.604510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf33476-34a1-43a6-8c35-12b44ed0d5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:10.604872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf33476-34a1-43a6-8c35-12b44ed0d5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:10.605158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf33476-34a1-43a6-8c35-12b44ed0d5d8 None admin] PATH_INFO: `/v3/groups/4cf27da541c94bae89bd81b0e37799d7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:10.606437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf33476-34a1-43a6-8c35-12b44ed0d5d8 None admin] RBAC: Authorizing `identity:get_group(group_id=4cf27da541c94bae89bd81b0e37799d7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:10.608008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf33476-34a1-43a6-8c35-12b44ed0d5d8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:10.610183 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 185/385] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:10 2022] GET /identity/v3/groups/4cf27da541c94bae89bd81b0e37799d7 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:10.615427 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9df720-56c0-4834-9093-2bcd462d6d99 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:10.662835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:10.756244 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9df720-56c0-4834-9093-2bcd462d6d99 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:10.804768 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a88762-b14b-4bb1-b757-c41641193182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:10.805555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a88762-b14b-4bb1-b757-c41641193182 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:10.805840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a88762-b14b-4bb1-b757-c41641193182 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:10.806114 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a88762-b14b-4bb1-b757-c41641193182 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:10.807271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a88762-b14b-4bb1-b757-c41641193182 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:10.811108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a88762-b14b-4bb1-b757-c41641193182 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:10.811108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 201/386] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:10 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:10.816943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf33476-34a1-43a6-8c35-12b44ed0d5d8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:10.959197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf33476-34a1-43a6-8c35-12b44ed0d5d8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:10.984680 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:11.003625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171e327-401e-44b9-ab82-cd34bca71049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:11.004361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171e327-401e-44b9-ab82-cd34bca71049 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:11.004649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171e327-401e-44b9-ab82-cd34bca71049 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:11.004932 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171e327-401e-44b9-ab82-cd34bca71049 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea/groups/4cf27da541c94bae89bd81b0e37799d7/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:11.009497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171e327-401e-44b9-ab82-cd34bca71049 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7240a923ed848ce82516c291da74aea, group_id=4cf27da541c94bae89bd81b0e37799d7, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:11.010894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171e327-401e-44b9-ab82-cd34bca71049 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:11.032275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 186/387] 10.222.0.17 () {58 vars in 1442 bytes} [Tue Aug 2 08:40:10 2022] PUT /identity/v3/projects/d7240a923ed848ce82516c291da74aea/groups/4cf27da541c94bae89bd81b0e37799d7/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:40:11.617959 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54133af-99b3-4d7e-8b1a-b43c4cf18fc7 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:11.618477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54133af-99b3-4d7e-8b1a-b43c4cf18fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:11.618553 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54133af-99b3-4d7e-8b1a-b43c4cf18fc7 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:11.620143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 202/388] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:11.625550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa484c8c-5945-480f-aa32-21116f2262c5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:11.626010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa484c8c-5945-480f-aa32-21116f2262c5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:11.626095 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa484c8c-5945-480f-aa32-21116f2262c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:11.653113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fa484c8c-5945-480f-aa32-21116f2262c5 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:11.654338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fa484c8c-5945-480f-aa32-21116f2262c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:11.758408 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 187/389] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:40:11.793143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54133af-99b3-4d7e-8b1a-b43c4cf18fc7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:11.897470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:11.902394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54133af-99b3-4d7e-8b1a-b43c4cf18fc7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:11.938770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4955b-1283-4e7f-b4ce-4d6fff37daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:11.939425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4955b-1283-4e7f-b4ce-4d6fff37daf1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:11.939710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4955b-1283-4e7f-b4ce-4d6fff37daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:11.939988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4955b-1283-4e7f-b4ce-4d6fff37daf1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:11.951432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4955b-1283-4e7f-b4ce-4d6fff37daf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-8ef4955b-1283-4e7f-b4ce-4d6fff37daf1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:11.957150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:11.958039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:11.959100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 203/390] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:40:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:11.964898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa484c8c-5945-480f-aa32-21116f2262c5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:12.114769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:12.116912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638f50c-8744-44fd-9f91-2bac86abc6bc None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:12.117272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638f50c-8744-44fd-9f91-2bac86abc6bc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:12.117564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638f50c-8744-44fd-9f91-2bac86abc6bc None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:12.118964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 204/391] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:12.124054 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa484c8c-5945-480f-aa32-21116f2262c5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:12.124322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffce11-9288-425c-96a8-3562335fdf51 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:12.124588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffce11-9288-425c-96a8-3562335fdf51 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:12.124871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffce11-9288-425c-96a8-3562335fdf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:12.143961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c6ffce11-9288-425c-96a8-3562335fdf51 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:12.145203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c6ffce11-9288-425c-96a8-3562335fdf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:12.175897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb06deb-0a42-45a0-af81-3d17af490d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:12.177028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb06deb-0a42-45a0-af81-3d17af490d50 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:12.177518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb06deb-0a42-45a0-af81-3d17af490d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:12.178018 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb06deb-0a42-45a0-af81-3d17af490d50 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:12.178937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb06deb-0a42-45a0-af81-3d17af490d50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:12.179515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb06deb-0a42-45a0-af81-3d17af490d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:12.181259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb06deb-0a42-45a0-af81-3d17af490d50 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:12.190310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 188/392] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:12.192016 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcee784-26ce-4135-bd84-ab8226cc848c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:12.192534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcee784-26ce-4135-bd84-ab8226cc848c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:12.193016 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcee784-26ce-4135-bd84-ab8226cc848c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:12.195207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 189/393] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:12.200682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcee784-26ce-4135-bd84-ab8226cc848c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:12.233269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 205/394] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:40:12.234319 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881dbdb-b820-4def-8048-1f7833e5bf07 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:12.234577 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881dbdb-b820-4def-8048-1f7833e5bf07 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:12.234856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881dbdb-b820-4def-8048-1f7833e5bf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:12.270665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e881dbdb-b820-4def-8048-1f7833e5bf07 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:12.271868 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e881dbdb-b820-4def-8048-1f7833e5bf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:12.331259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcee784-26ce-4135-bd84-ab8226cc848c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:12.343329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 206/395] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:12.344288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881dbdb-b820-4def-8048-1f7833e5bf07 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:12.359558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:12.373968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86f884-f0f8-4cd3-990d-d1c620865642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:12.375072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86f884-f0f8-4cd3-990d-d1c620865642 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:12.375559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86f884-f0f8-4cd3-990d-d1c620865642 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:12.376038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86f884-f0f8-4cd3-990d-d1c620865642 None admin] PATH_INFO: `/v3/groups/4cf27da541c94bae89bd81b0e37799d7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:12.377643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86f884-f0f8-4cd3-990d-d1c620865642 None admin] RBAC: Authorizing `identity:get_group(group_id=4cf27da541c94bae89bd81b0e37799d7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:12.379296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86f884-f0f8-4cd3-990d-d1c620865642 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:12.381657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 190/396] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:12 2022] GET /identity/v3/groups/4cf27da541c94bae89bd81b0e37799d7 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:12.389591 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86f884-f0f8-4cd3-990d-d1c620865642 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:12.425613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:12.473039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881dbdb-b820-4def-8048-1f7833e5bf07 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:12.508816 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe26aa2-b6e9-4872-9641-5060dcce6bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:12.509477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe26aa2-b6e9-4872-9641-5060dcce6bec None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:12.509764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe26aa2-b6e9-4872-9641-5060dcce6bec None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:12.510042 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe26aa2-b6e9-4872-9641-5060dcce6bec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:12.515411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86f884-f0f8-4cd3-990d-d1c620865642 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:12.520852 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe26aa2-b6e9-4872-9641-5060dcce6bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ebe26aa2-b6e9-4872-9641-5060dcce6bec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:12.526678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:12.527594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:12.528454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:12.528454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:12.528454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:12.528454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:12.528454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:12.528454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:12.528454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:12.528454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:12.528454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:12.528454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:12.528454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:12.528454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:12.533267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 207/397] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:12.534020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe26aa2-b6e9-4872-9641-5060dcce6bec None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:12.558926 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822d354-dccf-4067-ae83-d9d775094a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:12.559995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822d354-dccf-4067-ae83-d9d775094a5b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:12.560559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822d354-dccf-4067-ae83-d9d775094a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:12.561138 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822d354-dccf-4067-ae83-d9d775094a5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:12.573587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822d354-dccf-4067-ae83-d9d775094a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c822d354-dccf-4067-ae83-d9d775094a5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:12.579767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:12.580701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:12.581510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:12.581510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:12.581510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:12.581510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:12.581510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:12.581510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:12.581510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:12.581510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:12.581510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:12.581510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:12.581510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:12.581510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:12.584557 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 191/398] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:40:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:40:12.588189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822d354-dccf-4067-ae83-d9d775094a5b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:12.610852 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:12.643930 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe26aa2-b6e9-4872-9641-5060dcce6bec None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:12.681526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af6480-f0c3-4eaa-8fa0-3c14feecb4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:12.682491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6480-f0c3-4eaa-8fa0-3c14feecb4ab None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:12.682980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6480-f0c3-4eaa-8fa0-3c14feecb4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:12.683405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6480-f0c3-4eaa-8fa0-3c14feecb4ab None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:12.684771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af6480-f0c3-4eaa-8fa0-3c14feecb4ab None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:12.686237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:12.686973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af6480-f0c3-4eaa-8fa0-3c14feecb4ab None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:12.688903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 208/399] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:12 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:12.689876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af6480-f0c3-4eaa-8fa0-3c14feecb4ab None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:12.704048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822d354-dccf-4067-ae83-d9d775094a5b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:12.744726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb15cc-e33a-4cc5-bb78-fd566743d641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:12.745307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb15cc-e33a-4cc5-bb78-fd566743d641 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:12.745591 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb15cc-e33a-4cc5-bb78-fd566743d641 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:12.745866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb15cc-e33a-4cc5-bb78-fd566743d641 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:12.746698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb15cc-e33a-4cc5-bb78-fd566743d641 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:12.747015 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb15cc-e33a-4cc5-bb78-fd566743d641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:12.748567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb15cc-e33a-4cc5-bb78-fd566743d641 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:12.762824 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 192/400] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:40:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:12.762824 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb15cc-e33a-4cc5-bb78-fd566743d641 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:12.810526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af6480-f0c3-4eaa-8fa0-3c14feecb4ab None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:12.847642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cc6e6-c16c-4b59-9c33-501082c77c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:12.848707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cc6e6-c16c-4b59-9c33-501082c77c7f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:12.849224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cc6e6-c16c-4b59-9c33-501082c77c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:12.849735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cc6e6-c16c-4b59-9c33-501082c77c7f None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:12.850683 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64cc6e6-c16c-4b59-9c33-501082c77c7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:12.851188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64cc6e6-c16c-4b59-9c33-501082c77c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:12.853356 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64cc6e6-c16c-4b59-9c33-501082c77c7f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:12.862545 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 209/401] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:12.863597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cc6e6-c16c-4b59-9c33-501082c77c7f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:12.868992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:12.881789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb15cc-e33a-4cc5-bb78-fd566743d641 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:12.920806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfb065-f78e-4062-8186-34a1b383ddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:12.921623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfb065-f78e-4062-8186-34a1b383ddaf None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:12.922350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfb065-f78e-4062-8186-34a1b383ddaf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:12.922350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfb065-f78e-4062-8186-34a1b383ddaf None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea/groups/4cf27da541c94bae89bd81b0e37799d7/roles/da75e75c3ada4bf1b93ec17d36ff9a0d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:12.924544 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfb065-f78e-4062-8186-34a1b383ddaf None admin] RBAC: Authorizing `identity:create_grant(project_id=d7240a923ed848ce82516c291da74aea, group_id=4cf27da541c94bae89bd81b0e37799d7, role_id=da75e75c3ada4bf1b93ec17d36ff9a0d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:12.926365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfb065-f78e-4062-8186-34a1b383ddaf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:12.944158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 193/402] 10.222.0.17 () {58 vars in 1442 bytes} [Tue Aug 2 08:40:12 2022] PUT /identity/v3/projects/d7240a923ed848ce82516c291da74aea/groups/4cf27da541c94bae89bd81b0e37799d7/roles/da75e75c3ada4bf1b93ec17d36ff9a0d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:40:12.945038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfb065-f78e-4062-8186-34a1b383ddaf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:12.960352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:12.982143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cc6e6-c16c-4b59-9c33-501082c77c7f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:13.030713 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec3b21-93c0-4684-911c-98db698e36e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:13.031308 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec3b21-93c0-4684-911c-98db698e36e1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:13.031714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec3b21-93c0-4684-911c-98db698e36e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:13.032034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec3b21-93c0-4684-911c-98db698e36e1 None admin] PATH_INFO: `/v3/groups/4cf27da541c94bae89bd81b0e37799d7` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:13.034206 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec3b21-93c0-4684-911c-98db698e36e1 None admin] RBAC: Authorizing `identity:get_group(group_id=4cf27da541c94bae89bd81b0e37799d7)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:13.036036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec3b21-93c0-4684-911c-98db698e36e1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:13.038798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 210/403] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:12 2022] GET /identity/v3/groups/4cf27da541c94bae89bd81b0e37799d7 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:13.041036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361fbd2-7554-4315-928f-1383dfce4df6 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:13.041323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361fbd2-7554-4315-928f-1383dfce4df6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:13.041758 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361fbd2-7554-4315-928f-1383dfce4df6 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:13.048061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 211/404] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:13.049347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361fbd2-7554-4315-928f-1383dfce4df6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:13.104297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfb065-f78e-4062-8186-34a1b383ddaf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:13.156557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:13.157560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69395ab8-36b7-4923-9a39-6b70117c5bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:13.158354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69395ab8-36b7-4923-9a39-6b70117c5bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:13.158546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69395ab8-36b7-4923-9a39-6b70117c5bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:13.159632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69395ab8-36b7-4923-9a39-6b70117c5bc9 None admin] PATH_INFO: `/v3/groups/4cf27da541c94bae89bd81b0e37799d7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:13.160812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69395ab8-36b7-4923-9a39-6b70117c5bc9 None admin] RBAC: Authorizing `identity:get_group(group_id=4cf27da541c94bae89bd81b0e37799d7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:13.165154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69395ab8-36b7-4923-9a39-6b70117c5bc9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:13.165154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 194/405] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:12 2022] GET /identity/v3/groups/4cf27da541c94bae89bd81b0e37799d7 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:13.166350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee36f96-7247-4a93-b7b3-a747e7ef7016 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:13.166638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee36f96-7247-4a93-b7b3-a747e7ef7016 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:13.167004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee36f96-7247-4a93-b7b3-a747e7ef7016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:13.186315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3ee36f96-7247-4a93-b7b3-a747e7ef7016 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:13.187507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3ee36f96-7247-4a93-b7b3-a747e7ef7016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:13.209335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361fbd2-7554-4315-928f-1383dfce4df6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:13.255691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756388f-895f-48a2-9c76-965673b404e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:13.256755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756388f-895f-48a2-9c76-965673b404e7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:13.257225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756388f-895f-48a2-9c76-965673b404e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:13.257747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 195/406] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:13.258137 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756388f-895f-48a2-9c76-965673b404e7 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:13.259094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee36f96-7247-4a93-b7b3-a747e7ef7016 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:13.259768 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756388f-895f-48a2-9c76-965673b404e7 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:13.261595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756388f-895f-48a2-9c76-965673b404e7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:13.264592 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 212/407] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:13 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:13.269586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:13.270655 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756388f-895f-48a2-9c76-965673b404e7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:13.386160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee36f96-7247-4a93-b7b3-a747e7ef7016 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:13.390331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756388f-895f-48a2-9c76-965673b404e7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:13.422071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79f9a7-82dc-4c7f-9f56-5f7f652954b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:13.423198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79f9a7-82dc-4c7f-9f56-5f7f652954b1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:13.423606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79f9a7-82dc-4c7f-9f56-5f7f652954b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:13.424157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79f9a7-82dc-4c7f-9f56-5f7f652954b1 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:13.425079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79f9a7-82dc-4c7f-9f56-5f7f652954b1 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:13.426612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79f9a7-82dc-4c7f-9f56-5f7f652954b1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:13.428339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 196/408] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:13 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:13.429113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79f9a7-82dc-4c7f-9f56-5f7f652954b1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:13.429966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ace814-9ff1-4e3d-869d-fd4781ee8cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:13.430919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ace814-9ff1-4e3d-869d-fd4781ee8cc7 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:13.431414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ace814-9ff1-4e3d-869d-fd4781ee8cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:13.431888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ace814-9ff1-4e3d-869d-fd4781ee8cc7 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2/groups/4cf27da541c94bae89bd81b0e37799d7/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:13.434179 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ace814-9ff1-4e3d-869d-fd4781ee8cc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4912877de99b4c50ad5b9ce264b21ce2, group_id=4cf27da541c94bae89bd81b0e37799d7, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:13.435839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ace814-9ff1-4e3d-869d-fd4781ee8cc7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:13.447822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:13.454939 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 213/409] 10.222.0.17 () {58 vars in 1442 bytes} [Tue Aug 2 08:40:13 2022] PUT /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2/groups/4cf27da541c94bae89bd81b0e37799d7/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:40:13.465635 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ace814-9ff1-4e3d-869d-fd4781ee8cc7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:13.519054 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:13.575733 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79f9a7-82dc-4c7f-9f56-5f7f652954b1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:13.619909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e61c44-113b-4287-9c01-10c0d72c12d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:13.620651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e61c44-113b-4287-9c01-10c0d72c12d6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:13.620989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e61c44-113b-4287-9c01-10c0d72c12d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:13.621274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e61c44-113b-4287-9c01-10c0d72c12d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:13.643669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e61c44-113b-4287-9c01-10c0d72c12d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-94e61c44-113b-4287-9c01-10c0d72c12d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:13.658033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:13.658988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:13.659814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:13.659814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:13.659814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:13.659814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:13.659814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:13.659814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:13.659814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:13.659814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:13.659814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:13.659814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:13.659814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:13.659814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:13.664173 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 197/410] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:13.665050 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e61c44-113b-4287-9c01-10c0d72c12d6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:13.685138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ace814-9ff1-4e3d-869d-fd4781ee8cc7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:13.721935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc81bd-3c8e-4062-91df-d443f9f794c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:13.722626 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc81bd-3c8e-4062-91df-d443f9f794c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:13.722964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc81bd-3c8e-4062-91df-d443f9f794c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:13.723587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc81bd-3c8e-4062-91df-d443f9f794c7 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2/groups/4cf27da541c94bae89bd81b0e37799d7/roles/da75e75c3ada4bf1b93ec17d36ff9a0d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:13.726552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc81bd-3c8e-4062-91df-d443f9f794c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4912877de99b4c50ad5b9ce264b21ce2, group_id=4cf27da541c94bae89bd81b0e37799d7, role_id=da75e75c3ada4bf1b93ec17d36ff9a0d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:13.728908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc81bd-3c8e-4062-91df-d443f9f794c7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:13.749429 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 214/411] 10.222.0.17 () {58 vars in 1442 bytes} [Tue Aug 2 08:40:13 2022] PUT /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2/groups/4cf27da541c94bae89bd81b0e37799d7/roles/da75e75c3ada4bf1b93ec17d36ff9a0d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:40:13.751064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f857a7-e412-4280-9a9a-9d0fffb5a243 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:13.751532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f857a7-e412-4280-9a9a-9d0fffb5a243 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:13.752150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f857a7-e412-4280-9a9a-9d0fffb5a243 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:13.758294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 215/412] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:13.760512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb15bc-301e-48a9-aa83-90f0d2b0c193 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:13.760982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb15bc-301e-48a9-aa83-90f0d2b0c193 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:13.761749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb15bc-301e-48a9-aa83-90f0d2b0c193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:13.798077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6ffb15bc-301e-48a9-aa83-90f0d2b0c193 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:13.799316 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6ffb15bc-301e-48a9-aa83-90f0d2b0c193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:13.846459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e61c44-113b-4287-9c01-10c0d72c12d6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:13.918026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e176567-ada9-4f29-840e-aad7f3b056bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:13.918314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:13.918589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e176567-ada9-4f29-840e-aad7f3b056bd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:13.919341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e176567-ada9-4f29-840e-aad7f3b056bd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:13.919669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e176567-ada9-4f29-840e-aad7f3b056bd None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:13.920494 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e176567-ada9-4f29-840e-aad7f3b056bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:13.920807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e176567-ada9-4f29-840e-aad7f3b056bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:13.922370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e176567-ada9-4f29-840e-aad7f3b056bd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:13.928481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:13.940839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 198/413] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:13.943142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 216/414] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:40:13.946422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e176567-ada9-4f29-840e-aad7f3b056bd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:13.967614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb15bc-301e-48a9-aa83-90f0d2b0c193 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:14.066848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e176567-ada9-4f29-840e-aad7f3b056bd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:14.083489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb15bc-301e-48a9-aa83-90f0d2b0c193 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:14.103445 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7b347-5a5e-4c94-8e65-6b886db1f6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:14.104100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7b347-5a5e-4c94-8e65-6b886db1f6cf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:14.104412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7b347-5a5e-4c94-8e65-6b886db1f6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:14.104689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7b347-5a5e-4c94-8e65-6b886db1f6cf None admin] PATH_INFO: `/v3/groups/65245891d9e746c5aafb9730a9bd9a51` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:14.105843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7b347-5a5e-4c94-8e65-6b886db1f6cf None admin] RBAC: Authorizing `identity:get_group(group_id=65245891d9e746c5aafb9730a9bd9a51)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:14.107491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7b347-5a5e-4c94-8e65-6b886db1f6cf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:14.109177 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 199/415] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:13 2022] GET /identity/v3/groups/65245891d9e746c5aafb9730a9bd9a51 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:14.114553 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7b347-5a5e-4c94-8e65-6b886db1f6cf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:14.172138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4d5c0-a4ab-4346-a5de-d6c2369d7e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:14.172875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4d5c0-a4ab-4346-a5de-d6c2369d7e2f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:14.173167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4d5c0-a4ab-4346-a5de-d6c2369d7e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:14.173454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4d5c0-a4ab-4346-a5de-d6c2369d7e2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:14.180036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:14.198473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4d5c0-a4ab-4346-a5de-d6c2369d7e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-53a4d5c0-a4ab-4346-a5de-d6c2369d7e2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:14.203696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:14.204716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:14.205879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 217/416] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:14.213446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4d5c0-a4ab-4346-a5de-d6c2369d7e2f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:14.220964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7b347-5a5e-4c94-8e65-6b886db1f6cf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:14.255481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80faa459-e0aa-42b6-b24d-92589bedbd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:14.256146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faa459-e0aa-42b6-b24d-92589bedbd02 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:14.256442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faa459-e0aa-42b6-b24d-92589bedbd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:14.256719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faa459-e0aa-42b6-b24d-92589bedbd02 None admin] PATH_INFO: `/v3/projects/373878c44f1d4227ba8ac54103602eff` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:14.257885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80faa459-e0aa-42b6-b24d-92589bedbd02 None admin] RBAC: Authorizing `identity:get_project(project_id=373878c44f1d4227ba8ac54103602eff)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:14.259872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80faa459-e0aa-42b6-b24d-92589bedbd02 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:14.261895 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 200/417] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:14 2022] GET /identity/v3/projects/373878c44f1d4227ba8ac54103602eff => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:14.267677 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80faa459-e0aa-42b6-b24d-92589bedbd02 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:14.313218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:14.375504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80faa459-e0aa-42b6-b24d-92589bedbd02 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:14.407439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:14.412749 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff7af8-9470-4b3b-939a-f591dd8e3e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:14.416165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff7af8-9470-4b3b-939a-f591dd8e3e3e None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:14.416165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff7af8-9470-4b3b-939a-f591dd8e3e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:14.416165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff7af8-9470-4b3b-939a-f591dd8e3e3e None admin] PATH_INFO: `/v3/projects/373878c44f1d4227ba8ac54103602eff/groups/65245891d9e746c5aafb9730a9bd9a51/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:14.416529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff7af8-9470-4b3b-939a-f591dd8e3e3e None admin] RBAC: Authorizing `identity:create_grant(project_id=373878c44f1d4227ba8ac54103602eff, group_id=65245891d9e746c5aafb9730a9bd9a51, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:14.417752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff7af8-9470-4b3b-939a-f591dd8e3e3e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:14.426199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4d5c0-a4ab-4346-a5de-d6c2369d7e2f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:14.444655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 201/418] 10.222.0.17 () {58 vars in 1442 bytes} [Tue Aug 2 08:40:14 2022] PUT /identity/v3/projects/373878c44f1d4227ba8ac54103602eff/groups/65245891d9e746c5aafb9730a9bd9a51/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:40:14.465749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9255-ef33-4b4a-bb36-863d87d7d836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:14.466400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9255-ef33-4b4a-bb36-863d87d7d836 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:14.466687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9255-ef33-4b4a-bb36-863d87d7d836 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:14.466966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9255-ef33-4b4a-bb36-863d87d7d836 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:14.467922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e9255-ef33-4b4a-bb36-863d87d7d836 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:14.468311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e9255-ef33-4b4a-bb36-863d87d7d836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:14.469884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e9255-ef33-4b4a-bb36-863d87d7d836 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:14.482953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 218/419] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:40:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:14.488385 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff7af8-9470-4b3b-939a-f591dd8e3e3e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:14.622030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff7af8-9470-4b3b-939a-f591dd8e3e3e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:14.657437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbd43e-c80c-45ca-94de-701f11fea0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:14.658062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbd43e-c80c-45ca-94de-701f11fea0db None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:14.658347 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbd43e-c80c-45ca-94de-701f11fea0db None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:14.658624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbd43e-c80c-45ca-94de-701f11fea0db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:14.725727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:14.736251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbd43e-c80c-45ca-94de-701f11fea0db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:14.737736 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbd43e-c80c-45ca-94de-701f11fea0db None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:14.879657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 202/420] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:14.886081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9255-ef33-4b4a-bb36-863d87d7d836 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:15.040840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9255-ef33-4b4a-bb36-863d87d7d836 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:15.061723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:15.095612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f0ebc-f842-4ca3-a903-164d7b009e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:15.096294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f0ebc-f842-4ca3-a903-164d7b009e37 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:15.096584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f0ebc-f842-4ca3-a903-164d7b009e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:15.096865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f0ebc-f842-4ca3-a903-164d7b009e37 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:15.098062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f0ebc-f842-4ca3-a903-164d7b009e37 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:15.099524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f0ebc-f842-4ca3-a903-164d7b009e37 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:15.101229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 219/421] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:14 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:15.106981 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbd43e-c80c-45ca-94de-701f11fea0db None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:15.247961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:15.269440 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbd43e-c80c-45ca-94de-701f11fea0db None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:15.323507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e394ec1-6dfd-4faa-bf24-52c23172bb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:15.324559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e394ec1-6dfd-4faa-bf24-52c23172bb60 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:15.325091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e394ec1-6dfd-4faa-bf24-52c23172bb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:15.325568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e394ec1-6dfd-4faa-bf24-52c23172bb60 None admin] PATH_INFO: `/v3/groups/4cf27da541c94bae89bd81b0e37799d7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:15.328808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e394ec1-6dfd-4faa-bf24-52c23172bb60 None admin] RBAC: Authorizing `identity:get_group(group_id=4cf27da541c94bae89bd81b0e37799d7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:15.330728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e394ec1-6dfd-4faa-bf24-52c23172bb60 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:15.332913 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 203/422] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:15 2022] GET /identity/v3/groups/4cf27da541c94bae89bd81b0e37799d7 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:15.338855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f0ebc-f842-4ca3-a903-164d7b009e37 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:15.453291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab034c-7215-4e80-813e-ff5a3b4d5e5f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:15.453672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab034c-7215-4e80-813e-ff5a3b4d5e5f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:15.453851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab034c-7215-4e80-813e-ff5a3b4d5e5f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:15.455463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 204/423] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:40:15.462006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e361e4-d823-4913-975a-c8f83c40c387 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:15.462296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e361e4-d823-4913-975a-c8f83c40c387 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:15.462575 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e361e4-d823-4913-975a-c8f83c40c387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:15.493223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-27e361e4-d823-4913-975a-c8f83c40c387 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:15.494413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-27e361e4-d823-4913-975a-c8f83c40c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:15.536053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f0ebc-f842-4ca3-a903-164d7b009e37 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:15.614253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 205/424] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:15.614828 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff510a0-f535-4517-8655-f63755bbdefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:15.615455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff510a0-f535-4517-8655-f63755bbdefb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:15.615739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff510a0-f535-4517-8655-f63755bbdefb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:15.616015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff510a0-f535-4517-8655-f63755bbdefb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:15.620902 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff510a0-f535-4517-8655-f63755bbdefb None admin] RBAC: Adding query filter params (group.id=4cf27da541c94bae89bd81b0e37799d7, role.id=ad3a96ed9c2944be914156fa1c4613af, scope.project.id=d7240a923ed848ce82516c291da74aea) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:15.621232 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff510a0-f535-4517-8655-f63755bbdefb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:15.622682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff510a0-f535-4517-8655-f63755bbdefb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:15.629534 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 220/425] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Aug 2 08:40:15 2022] GET /identity/v3/role_assignments?group.id=4cf27da541c94bae89bd81b0e37799d7&scope.project.id=d7240a923ed848ce82516c291da74aea&role.id=ad3a96ed9c2944be914156fa1c4613af => generated 611 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:15.650934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e361e4-d823-4913-975a-c8f83c40c387 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:15.783375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:15.794806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e361e4-d823-4913-975a-c8f83c40c387 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:15.850736 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc98088-4277-4696-ac54-68561a6eb600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:15.851402 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc98088-4277-4696-ac54-68561a6eb600 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:15.851684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc98088-4277-4696-ac54-68561a6eb600 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:15.851990 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc98088-4277-4696-ac54-68561a6eb600 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:15.873388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc98088-4277-4696-ac54-68561a6eb600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-4dc98088-4277-4696-ac54-68561a6eb600 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:15.878424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:15.879289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:15.880529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 206/426] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:40:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:15.886133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff510a0-f535-4517-8655-f63755bbdefb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:15.950237 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:16.024631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff510a0-f535-4517-8655-f63755bbdefb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:16.061389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e76008-f683-4bf7-bf1e-608bc319b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:16.062390 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e76008-f683-4bf7-bf1e-608bc319b6cd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:16.062875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e76008-f683-4bf7-bf1e-608bc319b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:16.063375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e76008-f683-4bf7-bf1e-608bc319b6cd None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:16.064317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e76008-f683-4bf7-bf1e-608bc319b6cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:16.064827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e76008-f683-4bf7-bf1e-608bc319b6cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:16.066408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e76008-f683-4bf7-bf1e-608bc319b6cd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:16.080447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 221/427] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:16.082264 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc98088-4277-4696-ac54-68561a6eb600 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:16.161370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79293898-3595-4c8b-a077-79bcf0c5488a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:16.161980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79293898-3595-4c8b-a077-79bcf0c5488a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:16.162489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79293898-3595-4c8b-a077-79bcf0c5488a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:16.164306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 222/428] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:40:16.172332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd967-2904-4f05-aa5e-0f7b7aa79a50 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:16.172618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd967-2904-4f05-aa5e-0f7b7aa79a50 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:16.172898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd967-2904-4f05-aa5e-0f7b7aa79a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:16.198087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7cefd967-2904-4f05-aa5e-0f7b7aa79a50 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:16.199292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7cefd967-2904-4f05-aa5e-0f7b7aa79a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:16.205625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc98088-4277-4696-ac54-68561a6eb600 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:16.256416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f80c4-f5a5-467f-9190-a8abbcb58fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:16.257032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f80c4-f5a5-467f-9190-a8abbcb58fff None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:16.257305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f80c4-f5a5-467f-9190-a8abbcb58fff None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:16.257574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f80c4-f5a5-467f-9190-a8abbcb58fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:16.281102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:16.301865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 223/429] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:16.325173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fc190-1e60-446e-8109-53ec71a3b8ea None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:16.325739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fc190-1e60-446e-8109-53ec71a3b8ea None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:16.326194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fc190-1e60-446e-8109-53ec71a3b8ea None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:16.328471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 224/430] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:40:16.333272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fc190-1e60-446e-8109-53ec71a3b8ea None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:16.350833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f80c4-f5a5-467f-9190-a8abbcb58fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:16.353139 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f80c4-f5a5-467f-9190-a8abbcb58fff None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:16.385523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:16.477463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fc190-1e60-446e-8109-53ec71a3b8ea None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:16.491012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 207/431] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:16.492735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a969df5-8ae0-41f0-90ad-7fcffcf363cf None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:16.493212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a969df5-8ae0-41f0-90ad-7fcffcf363cf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:16.493673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a969df5-8ae0-41f0-90ad-7fcffcf363cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:16.513479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8a969df5-8ae0-41f0-90ad-7fcffcf363cf None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:16.514808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8a969df5-8ae0-41f0-90ad-7fcffcf363cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:16.518601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b95bb3-5a7d-4ca7-bb6a-9207ead26335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:16.519257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b95bb3-5a7d-4ca7-bb6a-9207ead26335 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:16.519542 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b95bb3-5a7d-4ca7-bb6a-9207ead26335 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:16.519820 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b95bb3-5a7d-4ca7-bb6a-9207ead26335 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:16.534175 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b95bb3-5a7d-4ca7-bb6a-9207ead26335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e6b95bb3-5a7d-4ca7-bb6a-9207ead26335 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:16.540986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:16.541879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:16.542696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:16.542696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:16.542696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:16.542696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:16.542696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:16.542696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:16.542696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:16.542696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:16.542696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:16.542696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:16.542696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:40:16.542696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:16.546361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 225/432] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:16.546361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b95bb3-5a7d-4ca7-bb6a-9207ead26335 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:16.590052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:16.615347 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 208/433] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:16.616359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a969df5-8ae0-41f0-90ad-7fcffcf363cf None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:16.661772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:16.669975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b95bb3-5a7d-4ca7-bb6a-9207ead26335 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:16.708151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611008e5-3431-4254-9c02-75c258ea9a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:16.709076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611008e5-3431-4254-9c02-75c258ea9a14 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:16.709484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611008e5-3431-4254-9c02-75c258ea9a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:16.709763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611008e5-3431-4254-9c02-75c258ea9a14 None admin] PATH_INFO: `/v3/projects/d7240a923ed848ce82516c291da74aea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:16.711066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611008e5-3431-4254-9c02-75c258ea9a14 None admin] RBAC: Authorizing `identity:get_project(project_id=d7240a923ed848ce82516c291da74aea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:16.713312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611008e5-3431-4254-9c02-75c258ea9a14 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:16.720654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 226/434] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:16 2022] GET /identity/v3/projects/d7240a923ed848ce82516c291da74aea => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:16.720654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611008e5-3431-4254-9c02-75c258ea9a14 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:16.729423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a969df5-8ae0-41f0-90ad-7fcffcf363cf None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:16.765020 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7ae6a-f7f5-46be-8a19-9c5babe163f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:16.765646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7ae6a-f7f5-46be-8a19-9c5babe163f4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:16.766243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7ae6a-f7f5-46be-8a19-9c5babe163f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:16.766526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7ae6a-f7f5-46be-8a19-9c5babe163f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:16.767400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7ae6a-f7f5-46be-8a19-9c5babe163f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:16.767713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7ae6a-f7f5-46be-8a19-9c5babe163f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:16.769281 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7ae6a-f7f5-46be-8a19-9c5babe163f4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:16.777996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 209/435] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:40:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:16.778794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7ae6a-f7f5-46be-8a19-9c5babe163f4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:16.829266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:16.840075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611008e5-3431-4254-9c02-75c258ea9a14 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:16.878489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72541741-36a3-48fa-b0cf-7e52044d9e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:16.879131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72541741-36a3-48fa-b0cf-7e52044d9e61 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:16.879413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72541741-36a3-48fa-b0cf-7e52044d9e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:16.879705 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72541741-36a3-48fa-b0cf-7e52044d9e61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:16.891491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72541741-36a3-48fa-b0cf-7e52044d9e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-72541741-36a3-48fa-b0cf-7e52044d9e61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:16.896707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:16.897598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:16.898380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:16.898380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:16.898380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:16.898380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:16.898380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:16.898380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:16.898380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:16.898380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:16.898380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:16.898380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:16.898380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:16.898380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:16.898969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7ae6a-f7f5-46be-8a19-9c5babe163f4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:16.902961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 227/436] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:40:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:16.903721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72541741-36a3-48fa-b0cf-7e52044d9e61 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:16.932093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:16.941148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d64af-e7c3-456f-9ca4-44065d64a9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:16.941923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d64af-e7c3-456f-9ca4-44065d64a9eb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:16.942216 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d64af-e7c3-456f-9ca4-44065d64a9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:16.942557 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d64af-e7c3-456f-9ca4-44065d64a9eb None admin] PATH_INFO: `/v3/groups/4cf27da541c94bae89bd81b0e37799d7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:16.943889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d64af-e7c3-456f-9ca4-44065d64a9eb None admin] RBAC: Authorizing `identity:get_group(group_id=4cf27da541c94bae89bd81b0e37799d7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:16.945401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d64af-e7c3-456f-9ca4-44065d64a9eb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:16.952720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 210/437] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:16 2022] GET /identity/v3/groups/4cf27da541c94bae89bd81b0e37799d7 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:16.952720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d64af-e7c3-456f-9ca4-44065d64a9eb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:17.013289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72541741-36a3-48fa-b0cf-7e52044d9e61 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:17.047365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c21829-5f3c-4cb9-9c06-4d9de56771ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:17.048002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c21829-5f3c-4cb9-9c06-4d9de56771ac None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:17.048322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c21829-5f3c-4cb9-9c06-4d9de56771ac None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:17.048595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c21829-5f3c-4cb9-9c06-4d9de56771ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:17.051837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d64af-e7c3-456f-9ca4-44065d64a9eb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:17.062738 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:17.088837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84709-0251-4c1b-9a88-3c3b65b36a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:17.089453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84709-0251-4c1b-9a88-3c3b65b36a6b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:17.089731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84709-0251-4c1b-9a88-3c3b65b36a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:17.090006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84709-0251-4c1b-9a88-3c3b65b36a6b None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:17.090707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb84709-0251-4c1b-9a88-3c3b65b36a6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:17.091016 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb84709-0251-4c1b-9a88-3c3b65b36a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:17.092613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb84709-0251-4c1b-9a88-3c3b65b36a6b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:17.100524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 211/438] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:17.101402 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84709-0251-4c1b-9a88-3c3b65b36a6b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:17.119946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c21829-5f3c-4cb9-9c06-4d9de56771ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:17.121454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c21829-5f3c-4cb9-9c06-4d9de56771ac None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:17.144873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:17.201900 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84709-0251-4c1b-9a88-3c3b65b36a6b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:17.220077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 228/439] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:17.221363 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f3ccf-f642-4087-9687-d18ddaa9228a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:17.221675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f3ccf-f642-4087-9687-d18ddaa9228a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:17.221899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f3ccf-f642-4087-9687-d18ddaa9228a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:17.223168 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 229/440] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:17.223865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f3ccf-f642-4087-9687-d18ddaa9228a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:17.239591 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadcca2-5b02-4191-9a39-838447fb0147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:17.240455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadcca2-5b02-4191-9a39-838447fb0147 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:17.240629 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadcca2-5b02-4191-9a39-838447fb0147 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:17.240901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadcca2-5b02-4191-9a39-838447fb0147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:17.241687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadcca2-5b02-4191-9a39-838447fb0147 None admin] RBAC: Adding query filter params (group.id=4cf27da541c94bae89bd81b0e37799d7, role.id=da75e75c3ada4bf1b93ec17d36ff9a0d, scope.project.id=d7240a923ed848ce82516c291da74aea) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:17.242000 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadcca2-5b02-4191-9a39-838447fb0147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:17.243986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadcca2-5b02-4191-9a39-838447fb0147 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:17.263965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 212/441] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Aug 2 08:40:17 2022] GET /identity/v3/role_assignments?group.id=4cf27da541c94bae89bd81b0e37799d7&scope.project.id=d7240a923ed848ce82516c291da74aea&role.id=da75e75c3ada4bf1b93ec17d36ff9a0d => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:17.263965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadcca2-5b02-4191-9a39-838447fb0147 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:17.309742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:17.353488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f3ccf-f642-4087-9687-d18ddaa9228a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:17.379674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:17.385665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadcca2-5b02-4191-9a39-838447fb0147 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:17.395554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6a6f-7573-4886-802d-1fc22862fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:17.396474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6a6f-7573-4886-802d-1fc22862fd25 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:17.397214 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6a6f-7573-4886-802d-1fc22862fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:17.397944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6a6f-7573-4886-802d-1fc22862fd25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:17.431611 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbe6d5-f24d-420d-9111-d3390b126afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:17.431611 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbe6d5-f24d-420d-9111-d3390b126afb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:17.431611 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbe6d5-f24d-420d-9111-d3390b126afb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:17.431997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbe6d5-f24d-420d-9111-d3390b126afb None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:17.433224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbe6d5-f24d-420d-9111-d3390b126afb None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:17.434869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbe6d5-f24d-420d-9111-d3390b126afb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:17.437266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 213/442] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:17 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:17.438887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472f0c5-a7f0-479a-acd9-d1561b01b61b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:17.439347 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472f0c5-a7f0-479a-acd9-d1561b01b61b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:17.439564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472f0c5-a7f0-479a-acd9-d1561b01b61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:17.459650 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b472f0c5-a7f0-479a-acd9-d1561b01b61b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:17.460871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b472f0c5-a7f0-479a-acd9-d1561b01b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:17.488979 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db6a6f-7573-4886-802d-1fc22862fd25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:17.492151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db6a6f-7573-4886-802d-1fc22862fd25 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:17.543402 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 214/443] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:17.548175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472f0c5-a7f0-479a-acd9-d1561b01b61b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:17.587888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:17.616181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 230/444] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:17.616181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6a6f-7573-4886-802d-1fc22862fd25 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:17.642453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:17.670063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472f0c5-a7f0-479a-acd9-d1561b01b61b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:17.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fff896-f6dd-4e75-a7cb-09392e8ecf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:17.704984 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fff896-f6dd-4e75-a7cb-09392e8ecf29 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:17.705260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fff896-f6dd-4e75-a7cb-09392e8ecf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:17.705537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fff896-f6dd-4e75-a7cb-09392e8ecf29 None admin] PATH_INFO: `/v3/groups/4cf27da541c94bae89bd81b0e37799d7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:17.709158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fff896-f6dd-4e75-a7cb-09392e8ecf29 None admin] RBAC: Authorizing `identity:get_group(group_id=4cf27da541c94bae89bd81b0e37799d7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:17.711893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fff896-f6dd-4e75-a7cb-09392e8ecf29 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:17.713581 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 215/445] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:17 2022] GET /identity/v3/groups/4cf27da541c94bae89bd81b0e37799d7 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:17.714460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fff896-f6dd-4e75-a7cb-09392e8ecf29 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:17.725905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6a6f-7573-4886-802d-1fc22862fd25 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:17.764907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eef8a6-024b-4267-b47d-098387e1832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:17.765561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eef8a6-024b-4267-b47d-098387e1832f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:17.765840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eef8a6-024b-4267-b47d-098387e1832f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:17.766112 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eef8a6-024b-4267-b47d-098387e1832f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:17.776369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eef8a6-024b-4267-b47d-098387e1832f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-36eef8a6-024b-4267-b47d-098387e1832f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:17.781314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:17.782281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:17.783082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 231/446] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:17.783767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eef8a6-024b-4267-b47d-098387e1832f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:17.832597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fff896-f6dd-4e75-a7cb-09392e8ecf29 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:17.835150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:17.875021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eda52-11db-4168-bb1d-5fb1b295ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:17.875661 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eda52-11db-4168-bb1d-5fb1b295ac50 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:17.876109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eda52-11db-4168-bb1d-5fb1b295ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:17.876417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eda52-11db-4168-bb1d-5fb1b295ac50 None admin] PATH_INFO: `/v3/projects/4912877de99b4c50ad5b9ce264b21ce2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:17.878572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0eda52-11db-4168-bb1d-5fb1b295ac50 None admin] RBAC: Authorizing `identity:get_project(project_id=4912877de99b4c50ad5b9ce264b21ce2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:17.880034 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0eda52-11db-4168-bb1d-5fb1b295ac50 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:17.881760 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 216/447] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:17 2022] GET /identity/v3/projects/4912877de99b4c50ad5b9ce264b21ce2 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:17.882721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eda52-11db-4168-bb1d-5fb1b295ac50 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:17.884365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:17.905815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eef8a6-024b-4267-b47d-098387e1832f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:17.948841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774de01e-4cec-4e9b-b8a4-61c7584a6ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:17.949467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774de01e-4cec-4e9b-b8a4-61c7584a6ebe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:17.949754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774de01e-4cec-4e9b-b8a4-61c7584a6ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:17.950033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774de01e-4cec-4e9b-b8a4-61c7584a6ebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:17.950857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774de01e-4cec-4e9b-b8a4-61c7584a6ebe None admin] RBAC: Adding query filter params (group.id=4cf27da541c94bae89bd81b0e37799d7, role.id=ad3a96ed9c2944be914156fa1c4613af, scope.project.id=4912877de99b4c50ad5b9ce264b21ce2) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:17.951170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774de01e-4cec-4e9b-b8a4-61c7584a6ebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:17.952658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774de01e-4cec-4e9b-b8a4-61c7584a6ebe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:17.958907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 232/448] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Aug 2 08:40:17 2022] GET /identity/v3/role_assignments?group.id=4cf27da541c94bae89bd81b0e37799d7&scope.project.id=4912877de99b4c50ad5b9ce264b21ce2&role.id=ad3a96ed9c2944be914156fa1c4613af => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:17.959706 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774de01e-4cec-4e9b-b8a4-61c7584a6ebe None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:18.026566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eda52-11db-4168-bb1d-5fb1b295ac50 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:18.072688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5793ab-bd0a-4782-b0fc-db1645881580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:18.073226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5793ab-bd0a-4782-b0fc-db1645881580 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:18.073513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5793ab-bd0a-4782-b0fc-db1645881580 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:18.073813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5793ab-bd0a-4782-b0fc-db1645881580 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:18.074532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5793ab-bd0a-4782-b0fc-db1645881580 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:18.074837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5793ab-bd0a-4782-b0fc-db1645881580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:18.076397 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5793ab-bd0a-4782-b0fc-db1645881580 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:18.087472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 217/449] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:18.093536 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5793ab-bd0a-4782-b0fc-db1645881580 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:18.104655 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774de01e-4cec-4e9b-b8a4-61c7584a6ebe None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:18.134871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:18.143213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c3b45-365c-4cc9-bec7-85da86f58688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:18.143909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c3b45-365c-4cc9-bec7-85da86f58688 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:18.144221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c3b45-365c-4cc9-bec7-85da86f58688 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:18.144523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c3b45-365c-4cc9-bec7-85da86f58688 None admin] PATH_INFO: `/v3/groups/4cf27da541c94bae89bd81b0e37799d7` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:18.145709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c3b45-365c-4cc9-bec7-85da86f58688 None admin] RBAC: Authorizing `identity:get_group(group_id=4cf27da541c94bae89bd81b0e37799d7)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:18.147173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c3b45-365c-4cc9-bec7-85da86f58688 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:18.148862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 233/450] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:17 2022] GET /identity/v3/groups/4cf27da541c94bae89bd81b0e37799d7 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:18.154761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c3b45-365c-4cc9-bec7-85da86f58688 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:18.177656 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:18.228675 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5793ab-bd0a-4782-b0fc-db1645881580 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:18.291631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd340f98-3adc-40f6-a3c6-63cf4aa13876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:18.291631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340f98-3adc-40f6-a3c6-63cf4aa13876 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:18.291631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340f98-3adc-40f6-a3c6-63cf4aa13876 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:18.291631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340f98-3adc-40f6-a3c6-63cf4aa13876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:18.302121 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c3b45-365c-4cc9-bec7-85da86f58688 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:18.346485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38d727-1039-44bf-8f3f-b8c5d69b3062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:18.347349 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38d727-1039-44bf-8f3f-b8c5d69b3062 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:18.347640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38d727-1039-44bf-8f3f-b8c5d69b3062 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:18.348366 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38d727-1039-44bf-8f3f-b8c5d69b3062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:18.348737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38d727-1039-44bf-8f3f-b8c5d69b3062 None admin] RBAC: Adding query filter params (group.id=4cf27da541c94bae89bd81b0e37799d7, role.id=da75e75c3ada4bf1b93ec17d36ff9a0d, scope.project.id=4912877de99b4c50ad5b9ce264b21ce2) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:18.349052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38d727-1039-44bf-8f3f-b8c5d69b3062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:18.350525 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38d727-1039-44bf-8f3f-b8c5d69b3062 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:18.359001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 234/451] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Aug 2 08:40:18 2022] GET /identity/v3/role_assignments?group.id=4cf27da541c94bae89bd81b0e37799d7&scope.project.id=4912877de99b4c50ad5b9ce264b21ce2&role.id=da75e75c3ada4bf1b93ec17d36ff9a0d => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:18.386556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd340f98-3adc-40f6-a3c6-63cf4aa13876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:18.388085 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd340f98-3adc-40f6-a3c6-63cf4aa13876 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:18.424455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:18.498901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 218/452] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:40:18.504875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38d727-1039-44bf-8f3f-b8c5d69b3062 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:18.591074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:18.617636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38d727-1039-44bf-8f3f-b8c5d69b3062 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:18.685755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff5dfe-c8a3-4b5d-90e8-2edb93fbb9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:18.686409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff5dfe-c8a3-4b5d-90e8-2edb93fbb9bf None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:18.686692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff5dfe-c8a3-4b5d-90e8-2edb93fbb9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:18.686967 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff5dfe-c8a3-4b5d-90e8-2edb93fbb9bf None admin] PATH_INFO: `/v3/projects/373878c44f1d4227ba8ac54103602eff` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:18.688180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff5dfe-c8a3-4b5d-90e8-2edb93fbb9bf None admin] RBAC: Authorizing `identity:get_project(project_id=373878c44f1d4227ba8ac54103602eff)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:18.690217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff5dfe-c8a3-4b5d-90e8-2edb93fbb9bf None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:18.691922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 235/453] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:40:18 2022] GET /identity/v3/projects/373878c44f1d4227ba8ac54103602eff => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:18.698045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd340f98-3adc-40f6-a3c6-63cf4aa13876 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:18.797058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd340f98-3adc-40f6-a3c6-63cf4aa13876 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:18.826865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:18.832376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b5dec-452d-4056-9f9b-45b2cad4b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:18.833033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b5dec-452d-4056-9f9b-45b2cad4b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:18.833342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b5dec-452d-4056-9f9b-45b2cad4b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:18.833876 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b5dec-452d-4056-9f9b-45b2cad4b7d5 None admin] PATH_INFO: `/v3/groups/65245891d9e746c5aafb9730a9bd9a51` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:18.835013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b5dec-452d-4056-9f9b-45b2cad4b7d5 None admin] RBAC: Authorizing `identity:get_group(group_id=65245891d9e746c5aafb9730a9bd9a51)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:18.837123 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b5dec-452d-4056-9f9b-45b2cad4b7d5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:18.838765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 219/454] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Aug 2 08:40:18 2022] GET /identity/v3/groups/65245891d9e746c5aafb9730a9bd9a51 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:18.845048 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff5dfe-c8a3-4b5d-90e8-2edb93fbb9bf None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:18.942274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff5dfe-c8a3-4b5d-90e8-2edb93fbb9bf None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:18.978364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca55a28-b90b-4fe3-ac55-9ced779ae80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:18.979017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca55a28-b90b-4fe3-ac55-9ced779ae80e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:18.979298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca55a28-b90b-4fe3-ac55-9ced779ae80e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:18.979570 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca55a28-b90b-4fe3-ac55-9ced779ae80e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:18.980379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca55a28-b90b-4fe3-ac55-9ced779ae80e None admin] RBAC: Adding query filter params (group.id=65245891d9e746c5aafb9730a9bd9a51, role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=373878c44f1d4227ba8ac54103602eff) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:18.980695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca55a28-b90b-4fe3-ac55-9ced779ae80e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:18.982129 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca55a28-b90b-4fe3-ac55-9ced779ae80e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:18.990326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 236/455] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Aug 2 08:40:18 2022] GET /identity/v3/role_assignments?group.id=65245891d9e746c5aafb9730a9bd9a51&scope.project.id=373878c44f1d4227ba8ac54103602eff&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:21.378746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b8613-59d5-4724-a258-edc86ceacf63 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:21.379308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b8613-59d5-4724-a258-edc86ceacf63 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:21.379308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b8613-59d5-4724-a258-edc86ceacf63 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:21.380954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 220/456] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:21.387080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a63862-3643-4ced-a691-102c8547aafa None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:21.387546 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a63862-3643-4ced-a691-102c8547aafa None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:21.387641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a63862-3643-4ced-a691-102c8547aafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:21.411642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-91a63862-3643-4ced-a691-102c8547aafa None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:21.412901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-91a63862-3643-4ced-a691-102c8547aafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:21.417252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:21.511859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 237/457] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:40:21.548293 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b8613-59d5-4724-a258-edc86ceacf63 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:21.689907 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b8613-59d5-4724-a258-edc86ceacf63 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:21.735564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f3ba0-a621-424f-8c66-a8dc96079a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:21.736522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f3ba0-a621-424f-8c66-a8dc96079a4f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:21.736952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f3ba0-a621-424f-8c66-a8dc96079a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:21.737409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f3ba0-a621-424f-8c66-a8dc96079a4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:21.749543 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f3ba0-a621-424f-8c66-a8dc96079a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:21.751222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f3ba0-a621-424f-8c66-a8dc96079a4f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:21.758065 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47053a8b-5c18-44b2-b2d2-5e7f4b533a05 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:21.758477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47053a8b-5c18-44b2-b2d2-5e7f4b533a05 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:21.758855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47053a8b-5c18-44b2-b2d2-5e7f4b533a05 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:21.760340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 238/458] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:21.765357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a5808-ab4b-4afa-b748-06efb2739e3b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:21.765752 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a5808-ab4b-4afa-b748-06efb2739e3b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:21.766124 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a5808-ab4b-4afa-b748-06efb2739e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-be4f3ba0-a621-424f-8c66-a8dc96079a4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:21.768460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:21.769561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:21.770621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:21.770621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:21.770621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:21.770621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:21.772561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 221/459] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:21.780862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f3ba0-a621-424f-8c66-a8dc96079a4f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:21.802119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6e0a5808-ab4b-4afa-b748-06efb2739e3b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:21.806037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6e0a5808-ab4b-4afa-b748-06efb2739e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:21.836236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:21.889017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f3ba0-a621-424f-8c66-a8dc96079a4f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:21.889394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 239/460] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:21.891025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a32c2-8d76-428f-8281-7387337b3153 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:21.891598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a32c2-8d76-428f-8281-7387337b3153 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:21.892070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a32c2-8d76-428f-8281-7387337b3153 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:21.893605 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 240/461] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:21.903813 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2bbce-17ab-4504-9173-957989220cfd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:21.904582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2bbce-17ab-4504-9173-957989220cfd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:21.905091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2bbce-17ab-4504-9173-957989220cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:21.924860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef10a47-dadc-4038-bfe9-cc8a4b82f5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:21.925484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef10a47-dadc-4038-bfe9-cc8a4b82f5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:21.925771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef10a47-dadc-4038-bfe9-cc8a4b82f5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:21.926052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef10a47-dadc-4038-bfe9-cc8a4b82f5f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:21.926746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef10a47-dadc-4038-bfe9-cc8a4b82f5f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:21.927056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef10a47-dadc-4038-bfe9-cc8a4b82f5f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:21.928472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef10a47-dadc-4038-bfe9-cc8a4b82f5f1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:21.929023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-12c2bbce-17ab-4504-9173-957989220cfd None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:21.930529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-12c2bbce-17ab-4504-9173-957989220cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:21.941536 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 222/462] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:21.942320 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef10a47-dadc-4038-bfe9-cc8a4b82f5f1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:22.000971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:22.007948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 241/463] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:22.010291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2bbce-17ab-4504-9173-957989220cfd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:22.057945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef10a47-dadc-4038-bfe9-cc8a4b82f5f1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:22.072938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:22.096415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b305d-b88b-4db4-abed-9d8b831a93ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:22.097160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b305d-b88b-4db4-abed-9d8b831a93ad None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:22.097447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b305d-b88b-4db4-abed-9d8b831a93ad None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:22.097731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b305d-b88b-4db4-abed-9d8b831a93ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:22.109163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b305d-b88b-4db4-abed-9d8b831a93ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:22.110808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b305d-b88b-4db4-abed-9d8b831a93ad None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:22.127149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2bbce-17ab-4504-9173-957989220cfd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-627b305d-b88b-4db4-abed-9d8b831a93ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:22.127586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:22.128439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:22.129261 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:22.129261 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:22.129261 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:22.129261 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:22.129261 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 223/464] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:22.129922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b305d-b88b-4db4-abed-9d8b831a93ad None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:22.169874 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e758f1-1439-4d2a-b279-81144ad9474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:22.170535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e758f1-1439-4d2a-b279-81144ad9474a None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:22.170834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e758f1-1439-4d2a-b279-81144ad9474a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:22.171115 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e758f1-1439-4d2a-b279-81144ad9474a None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:22.171841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e758f1-1439-4d2a-b279-81144ad9474a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:22.173427 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e758f1-1439-4d2a-b279-81144ad9474a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:22.197471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 242/465] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:40:22 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:40:22.198641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80bfb5-5661-4d1c-9b24-33b76ead656d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:22.198939 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80bfb5-5661-4d1c-9b24-33b76ead656d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:22.199243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80bfb5-5661-4d1c-9b24-33b76ead656d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:22.200770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 243/466] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:22.201465 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80bfb5-5661-4d1c-9b24-33b76ead656d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:22.273639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b305d-b88b-4db4-abed-9d8b831a93ad None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:22.291560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:22.318753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84dac96-c90e-42bc-aac3-db283fbc05af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:22.319822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dac96-c90e-42bc-aac3-db283fbc05af None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:22.320356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dac96-c90e-42bc-aac3-db283fbc05af None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:22.322276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dac96-c90e-42bc-aac3-db283fbc05af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:22.336607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84dac96-c90e-42bc-aac3-db283fbc05af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:22.338489 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84dac96-c90e-42bc-aac3-db283fbc05af None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:22.350321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80bfb5-5661-4d1c-9b24-33b76ead656d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b84dac96-c90e-42bc-aac3-db283fbc05af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:22.356657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:22.357515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:22.358373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:22.358373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:22.358373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:22.358373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:22.360858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 224/467] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:22.362605 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd6ff-6220-40a4-8267-70bb3763c918 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:22.363127 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd6ff-6220-40a4-8267-70bb3763c918 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:22.363624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd6ff-6220-40a4-8267-70bb3763c918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:22.383006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fb5cd6ff-6220-40a4-8267-70bb3763c918 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:22.386875 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fb5cd6ff-6220-40a4-8267-70bb3763c918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:22.399108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95125398-7167-4a6d-9537-99df44f42584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:22.399863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95125398-7167-4a6d-9537-99df44f42584 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:22.400164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95125398-7167-4a6d-9537-99df44f42584 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:22.400428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95125398-7167-4a6d-9537-99df44f42584 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:22.400855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:22.401342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95125398-7167-4a6d-9537-99df44f42584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:22.401671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95125398-7167-4a6d-9537-99df44f42584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:22.403451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95125398-7167-4a6d-9537-99df44f42584 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:22.419533 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 244/468] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:22.421881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95125398-7167-4a6d-9537-99df44f42584 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:22.479295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 225/469] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:22.480383 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cd6ff-6220-40a4-8267-70bb3763c918 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:22.553243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95125398-7167-4a6d-9537-99df44f42584 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:22.586503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:22.611836 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b767e1-2b7d-49de-b56e-e874151cde7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:22.612497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b767e1-2b7d-49de-b56e-e874151cde7c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:22.612787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b767e1-2b7d-49de-b56e-e874151cde7c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:22.613127 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b767e1-2b7d-49de-b56e-e874151cde7c None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:22.614102 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b767e1-2b7d-49de-b56e-e874151cde7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:22.614418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b767e1-2b7d-49de-b56e-e874151cde7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:22.616434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b767e1-2b7d-49de-b56e-e874151cde7c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:22.624363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cd6ff-6220-40a4-8267-70bb3763c918 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:22.636393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 245/470] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:22.637710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b767e1-2b7d-49de-b56e-e874151cde7c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:22.666033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b6223-db15-47f3-9c64-9edafa5ac7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:22.667353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b6223-db15-47f3-9c64-9edafa5ac7bb None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:22.667877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b6223-db15-47f3-9c64-9edafa5ac7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:22.668390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b6223-db15-47f3-9c64-9edafa5ac7bb None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:22.669299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b6223-db15-47f3-9c64-9edafa5ac7bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:22.672359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b6223-db15-47f3-9c64-9edafa5ac7bb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:22.704435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 226/471] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:40:22 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:40:22.705418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b6223-db15-47f3-9c64-9edafa5ac7bb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:22.711189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:22.771008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b767e1-2b7d-49de-b56e-e874151cde7c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:22.843632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95aebab-ce05-4081-9e91-4cd3c7de3c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:22.844353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95aebab-ce05-4081-9e91-4cd3c7de3c46 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:22.844644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95aebab-ce05-4081-9e91-4cd3c7de3c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:22.844923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95aebab-ce05-4081-9e91-4cd3c7de3c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:22.871105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95aebab-ce05-4081-9e91-4cd3c7de3c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:22.875542 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95aebab-ce05-4081-9e91-4cd3c7de3c46 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-d95aebab-ce05-4081-9e91-4cd3c7de3c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:22.901649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:22.902632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:22.903451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:22.903451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:22.903451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:22.903451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:22.903451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 246/472] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:22.909180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95aebab-ce05-4081-9e91-4cd3c7de3c46 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:22.920812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b6223-db15-47f3-9c64-9edafa5ac7bb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:22.946915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:22.960681 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5375811-fc5a-4bf3-8cae-8eb283847a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:22.962321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5375811-fc5a-4bf3-8cae-8eb283847a2c None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:22.962779 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5375811-fc5a-4bf3-8cae-8eb283847a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:22.963102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5375811-fc5a-4bf3-8cae-8eb283847a2c None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:22.963903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5375811-fc5a-4bf3-8cae-8eb283847a2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:22.965948 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5375811-fc5a-4bf3-8cae-8eb283847a2c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:22.999773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 227/473] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:40:22 2022] POST /identity/v3/users => generated 248 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:40:23.052583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95aebab-ce05-4081-9e91-4cd3c7de3c46 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:23.098184 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80333-cbfb-479d-8f2a-45ee2a103043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:23.098832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80333-cbfb-479d-8f2a-45ee2a103043 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:23.099116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80333-cbfb-479d-8f2a-45ee2a103043 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:23.099394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80333-cbfb-479d-8f2a-45ee2a103043 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:23.100110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80333-cbfb-479d-8f2a-45ee2a103043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:23.100447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80333-cbfb-479d-8f2a-45ee2a103043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:23.102604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80333-cbfb-479d-8f2a-45ee2a103043 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:23.117900 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 247/474] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:23.123905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5375811-fc5a-4bf3-8cae-8eb283847a2c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:23.181557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920cc73-247e-408b-a183-ae1db912056e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:23.181867 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920cc73-247e-408b-a183-ae1db912056e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:23.182127 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920cc73-247e-408b-a183-ae1db912056e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:23.184046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 248/475] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:23.198057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae522a-8ecb-4b82-9108-aab7bf805de8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:23.198359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae522a-8ecb-4b82-9108-aab7bf805de8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:23.198628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae522a-8ecb-4b82-9108-aab7bf805de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:23.202908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:23.222701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-02ae522a-8ecb-4b82-9108-aab7bf805de8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:23.223901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-02ae522a-8ecb-4b82-9108-aab7bf805de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:23.259518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5375811-fc5a-4bf3-8cae-8eb283847a2c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:23.308481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9c30d-6b6e-4050-85ae-54a68bd536bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:23.309046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9c30d-6b6e-4050-85ae-54a68bd536bd None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:23.309336 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9c30d-6b6e-4050-85ae-54a68bd536bd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:23.309616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9c30d-6b6e-4050-85ae-54a68bd536bd None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:23.310311 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9c30d-6b6e-4050-85ae-54a68bd536bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:23.311761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9c30d-6b6e-4050-85ae-54a68bd536bd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:23.312274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 249/476] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:40:23.333307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae522a-8ecb-4b82-9108-aab7bf805de8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:23.352750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 228/477] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:40:23 2022] POST /identity/v3/users => generated 249 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:40:23.360225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:23.465932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae522a-8ecb-4b82-9108-aab7bf805de8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:23.506600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d8267-d536-4a12-a867-543b1c06a941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:23.507238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d8267-d536-4a12-a867-543b1c06a941 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:23.507521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d8267-d536-4a12-a867-543b1c06a941 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:23.507796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d8267-d536-4a12-a867-543b1c06a941 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:23.509083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d8267-d536-4a12-a867-543b1c06a941 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:23.510593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d8267-d536-4a12-a867-543b1c06a941 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:23.525118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.sql.core [None req-9e0d8267-d536-4a12-a867-543b1c06a941 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 08:40:23.525118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 08:40:23.525118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [parameters: {'id': 'df80ccee1599440eb0a7187c3f1fd03e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 08:40:23.525118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80209) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9e0d8267-d536-4a12-a867-543b1c06a941 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result.read() Aug 02 08:40:23.543788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return ref.to_dict() Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:40:23.545988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application yield resource Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise self.value Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application session.commit() Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 08:40:23.548098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.session.flush() Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application compat.raise_( Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 08:40:23.550322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:40:23.551632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result.read() Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:40:23.560882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [parameters: {'id': 'df80ccee1599440eb0a7187c3f1fd03e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:23.562598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 08:40:23.564550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:23.566384 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 250/478] 10.222.0.17 () {60 vars in 1131 bytes} [Tue Aug 2 08:40:23 2022] POST /identity/v3/roles => generated 144 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:23.566517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9c30d-6b6e-4050-85ae-54a68bd536bd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:23.664669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9c30d-6b6e-4050-85ae-54a68bd536bd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:23.679317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:23.717921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abaee9-b5d8-4b92-96d0-c3ae8cbe9310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:23.718583 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abaee9-b5d8-4b92-96d0-c3ae8cbe9310 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:23.718911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abaee9-b5d8-4b92-96d0-c3ae8cbe9310 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:23.719190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abaee9-b5d8-4b92-96d0-c3ae8cbe9310 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:23.731261 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abaee9-b5d8-4b92-96d0-c3ae8cbe9310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d0abaee9-b5d8-4b92-96d0-c3ae8cbe9310 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:23.737845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:23.739854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:23.741789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:23.741789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:23.741789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:23.741789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:23.741789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:23.741789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:23.741789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:23.741789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:23.741789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:23.741789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:23.741789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:40:23.741789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:23.748149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 229/479] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:40:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:23.748336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d8267-d536-4a12-a867-543b1c06a941 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:23.857724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:23.890532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d8267-d536-4a12-a867-543b1c06a941 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:23.927492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61631a15-e520-465e-95e0-0fd2d2a7c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:23.928187 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61631a15-e520-465e-95e0-0fd2d2a7c07f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:23.928472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61631a15-e520-465e-95e0-0fd2d2a7c07f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:23.928745 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61631a15-e520-465e-95e0-0fd2d2a7c07f None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:23.929459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61631a15-e520-465e-95e0-0fd2d2a7c07f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:23.929761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61631a15-e520-465e-95e0-0fd2d2a7c07f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:23.931752 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61631a15-e520-465e-95e0-0fd2d2a7c07f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:23.944259 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 251/480] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:24.504589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b30a8-7bd7-4270-9180-4f709fff028d None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:24.504589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b30a8-7bd7-4270-9180-4f709fff028d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:24.504589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b30a8-7bd7-4270-9180-4f709fff028d None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:24.504589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 230/481] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:24.510843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50e398-bc08-4d08-8213-9fac4baee24f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:24.511353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50e398-bc08-4d08-8213-9fac4baee24f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:24.511506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50e398-bc08-4d08-8213-9fac4baee24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:24.537118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3e50e398-bc08-4d08-8213-9fac4baee24f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:24.538386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3e50e398-bc08-4d08-8213-9fac4baee24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:24.616567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 252/482] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:24.653140 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b30a8-7bd7-4270-9180-4f709fff028d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:24.772675 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b30a8-7bd7-4270-9180-4f709fff028d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:24.817744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a32c3-39e9-470c-9429-619f12f0ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:24.818392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a32c3-39e9-470c-9429-619f12f0ec0f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:24.818672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a32c3-39e9-470c-9429-619f12f0ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:24.818946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a32c3-39e9-470c-9429-619f12f0ec0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:24.832803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a32c3-39e9-470c-9429-619f12f0ec0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e95a32c3-39e9-470c-9429-619f12f0ec0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:24.838737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:24.840849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:24.842745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 231/483] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:24.850138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50e398-bc08-4d08-8213-9fac4baee24f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:24.937267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:24.967222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50e398-bc08-4d08-8213-9fac4baee24f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:25.007224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad3c2b-042b-463c-9409-f6a9762a7403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:25.007851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad3c2b-042b-463c-9409-f6a9762a7403 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:25.008688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad3c2b-042b-463c-9409-f6a9762a7403 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:25.008962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad3c2b-042b-463c-9409-f6a9762a7403 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:25.009770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad3c2b-042b-463c-9409-f6a9762a7403 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:25.010085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad3c2b-042b-463c-9409-f6a9762a7403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:25.014130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad3c2b-042b-463c-9409-f6a9762a7403 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:25.021288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 253/484] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:25.028607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a32c3-39e9-470c-9429-619f12f0ec0f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:25.086409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:25.175898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a32c3-39e9-470c-9429-619f12f0ec0f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:25.224979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9b037-5817-4b9a-9a07-6f7815d5e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:25.225617 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9b037-5817-4b9a-9a07-6f7815d5e921 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:25.226039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9b037-5817-4b9a-9a07-6f7815d5e921 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:25.226318 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9b037-5817-4b9a-9a07-6f7815d5e921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:25.240417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9b037-5817-4b9a-9a07-6f7815d5e921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:25.241928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9b037-5817-4b9a-9a07-6f7815d5e921 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-2cf9b037-5817-4b9a-9a07-6f7815d5e921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:25.263364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:25.264253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:25.265089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:25.265089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:25.265089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:25.265089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:25.265089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 232/485] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:25.270153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad3c2b-042b-463c-9409-f6a9762a7403 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:25.404722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad3c2b-042b-463c-9409-f6a9762a7403 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:25.447584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c3a42-3547-4b7d-b194-5ddf9240df7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:25.448226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c3a42-3547-4b7d-b194-5ddf9240df7f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:25.448513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c3a42-3547-4b7d-b194-5ddf9240df7f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:25.448788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c3a42-3547-4b7d-b194-5ddf9240df7f None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:25.449485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c3a42-3547-4b7d-b194-5ddf9240df7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:25.449792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c3a42-3547-4b7d-b194-5ddf9240df7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:25.451331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c3a42-3547-4b7d-b194-5ddf9240df7f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:25.453877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:25.470987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 254/486] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:25.476039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9b037-5817-4b9a-9a07-6f7815d5e921 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:25.564253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e700ba9-a731-4550-9c41-40f103dbbc92 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:25.564761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e700ba9-a731-4550-9c41-40f103dbbc92 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:25.564866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e700ba9-a731-4550-9c41-40f103dbbc92 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:25.566414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 255/487] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:40:25.571384 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37b5e5-a33d-45be-963f-ea692c94d942 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:25.571686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37b5e5-a33d-45be-963f-ea692c94d942 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:25.571985 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37b5e5-a33d-45be-963f-ea692c94d942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:25.600396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-be37b5e5-a33d-45be-963f-ea692c94d942 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:25.601641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-be37b5e5-a33d-45be-963f-ea692c94d942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:25.623055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:25.649741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9b037-5817-4b9a-9a07-6f7815d5e921 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:25.718423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaac587-af20-439e-a634-7a2662275f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:25.719020 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaac587-af20-439e-a634-7a2662275f6b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:25.719277 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaac587-af20-439e-a634-7a2662275f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:25.719525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaac587-af20-439e-a634-7a2662275f6b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:25.730861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 256/488] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:40:25.736993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaac587-af20-439e-a634-7a2662275f6b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:25.738476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaac587-af20-439e-a634-7a2662275f6b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-daaac587-af20-439e-a634-7a2662275f6b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:25.759457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:25.760459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:25.762666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:25.762666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:25.762666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:25.762666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:25.762666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:25.762666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:25.762666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:25.762666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:25.762666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:40:25.762666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:25.762666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 233/489] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Aug 2 08:40:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:25.766528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37b5e5-a33d-45be-963f-ea692c94d942 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:25.781825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaac587-af20-439e-a634-7a2662275f6b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:25.904134 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37b5e5-a33d-45be-963f-ea692c94d942 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:25.934428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:25.938701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaac587-af20-439e-a634-7a2662275f6b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:25.944834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de28be-99f1-4d02-a13b-6c02f3026374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:25.945572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de28be-99f1-4d02-a13b-6c02f3026374 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:25.945927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de28be-99f1-4d02-a13b-6c02f3026374 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:25.946336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de28be-99f1-4d02-a13b-6c02f3026374 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:25.947368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de28be-99f1-4d02-a13b-6c02f3026374 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:25.947748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de28be-99f1-4d02-a13b-6c02f3026374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:25.949445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de28be-99f1-4d02-a13b-6c02f3026374 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:25.977376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c60038-fed0-4168-a002-04b87374ac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:25.977951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c60038-fed0-4168-a002-04b87374ac0a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:25.978233 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c60038-fed0-4168-a002-04b87374ac0a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:25.978505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c60038-fed0-4168-a002-04b87374ac0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:25.990902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c60038-fed0-4168-a002-04b87374ac0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:25.996254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 257/490] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Aug 2 08:40:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-86c60038-fed0-4168-a002-04b87374ac0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:25.996463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:25.997295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:25.999384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 234/491] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:26.000886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3952b91-05ba-48d3-979f-e1cf05e992d1 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.001011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c60038-fed0-4168-a002-04b87374ac0a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:26.001142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3952b91-05ba-48d3-979f-e1cf05e992d1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.001142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3952b91-05ba-48d3-979f-e1cf05e992d1 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.003025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 258/492] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:26.004184 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3952b91-05ba-48d3-979f-e1cf05e992d1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:26.016055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:26.128519 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3952b91-05ba-48d3-979f-e1cf05e992d1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:26.138594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c60038-fed0-4168-a002-04b87374ac0a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:26.166628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5769f-2d67-4f07-9e32-ac360ecd0f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:26.167254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5769f-2d67-4f07-9e32-ac360ecd0f3a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.167536 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5769f-2d67-4f07-9e32-ac360ecd0f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.167816 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5769f-2d67-4f07-9e32-ac360ecd0f3a None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.168568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5769f-2d67-4f07-9e32-ac360ecd0f3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:26.168877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5769f-2d67-4f07-9e32-ac360ecd0f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:26.170249 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5769f-2d67-4f07-9e32-ac360ecd0f3a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:26.176397 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab25d3-da78-4bf2-a7e8-23e55aa60e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:26.176937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab25d3-da78-4bf2-a7e8-23e55aa60e83 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.177216 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab25d3-da78-4bf2-a7e8-23e55aa60e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.177491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab25d3-da78-4bf2-a7e8-23e55aa60e83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.180335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 259/493] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:26.180335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0183c-7d7b-45be-ac2c-90ff20304dbe None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.180335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0183c-7d7b-45be-ac2c-90ff20304dbe None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.180636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0183c-7d7b-45be-ac2c-90ff20304dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.199767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-21d0183c-7d7b-45be-ac2c-90ff20304dbe None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:26.201185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-21d0183c-7d7b-45be-ac2c-90ff20304dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:26.252426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab25d3-da78-4bf2-a7e8-23e55aa60e83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:26.252608 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:26.253885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab25d3-da78-4bf2-a7e8-23e55aa60e83 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:26.262640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:26.280393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 260/494] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:26.281456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaffe4-b3f0-456a-8b99-458f55fe916b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.281750 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaffe4-b3f0-456a-8b99-458f55fe916b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.282024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaffe4-b3f0-456a-8b99-458f55fe916b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.287484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 261/495] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:26.287484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaffe4-b3f0-456a-8b99-458f55fe916b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:26.383755 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 235/496] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:26.386253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3d8b6-d9dd-47cd-8d76-1a126af4760e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.386697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3d8b6-d9dd-47cd-8d76-1a126af4760e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.387120 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3d8b6-d9dd-47cd-8d76-1a126af4760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.399491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaffe4-b3f0-456a-8b99-458f55fe916b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:26.411550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-64c3d8b6-d9dd-47cd-8d76-1a126af4760e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:26.413333 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-64c3d8b6-d9dd-47cd-8d76-1a126af4760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:26.437280 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259c66e-e3a7-4b6a-b4a2-893dbee3e273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:26.437925 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259c66e-e3a7-4b6a-b4a2-893dbee3e273 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.438210 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259c66e-e3a7-4b6a-b4a2-893dbee3e273 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.438488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259c66e-e3a7-4b6a-b4a2-893dbee3e273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.450018 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259c66e-e3a7-4b6a-b4a2-893dbee3e273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:26.451531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259c66e-e3a7-4b6a-b4a2-893dbee3e273 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-0259c66e-e3a7-4b6a-b4a2-893dbee3e273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:26.468251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:26.469315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:26.470400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:26.470400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:26.470400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:26.470400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:26.471351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 262/497] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:26.472025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259c66e-e3a7-4b6a-b4a2-893dbee3e273 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:26.504266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 236/498] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:26.504266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3d8b6-d9dd-47cd-8d76-1a126af4760e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:26.506328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:26.547634 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:26.587071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259c66e-e3a7-4b6a-b4a2-893dbee3e273 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:26.615149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3d8b6-d9dd-47cd-8d76-1a126af4760e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:26.623116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70732c-54d7-4752-87e5-89bf6fdcb95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:26.623754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70732c-54d7-4752-87e5-89bf6fdcb95b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.624039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70732c-54d7-4752-87e5-89bf6fdcb95b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.624346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70732c-54d7-4752-87e5-89bf6fdcb95b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.634923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70732c-54d7-4752-87e5-89bf6fdcb95b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7f70732c-54d7-4752-87e5-89bf6fdcb95b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:26.640410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:26.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 263/499] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:26.642351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70732c-54d7-4752-87e5-89bf6fdcb95b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:26.653404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42b1ab-dd31-4621-b26b-520f350adf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:26.654044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42b1ab-dd31-4621-b26b-520f350adf82 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.654329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42b1ab-dd31-4621-b26b-520f350adf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.654605 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42b1ab-dd31-4621-b26b-520f350adf82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.664632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42b1ab-dd31-4621-b26b-520f350adf82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:26.666081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42b1ab-dd31-4621-b26b-520f350adf82 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-aa42b1ab-dd31-4621-b26b-520f350adf82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:26.683187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:26.684029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:26.684982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:26.684982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:26.684982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:26.684982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:26.684982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 237/500] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:26.685993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42b1ab-dd31-4621-b26b-520f350adf82 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:26.739893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:26.753368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70732c-54d7-4752-87e5-89bf6fdcb95b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:26.781624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:26.786902 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340a9b1-23ed-4ef5-b218-748a036d2777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:26.787524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340a9b1-23ed-4ef5-b218-748a036d2777 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.787811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340a9b1-23ed-4ef5-b218-748a036d2777 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.788091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340a9b1-23ed-4ef5-b218-748a036d2777 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.788813 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340a9b1-23ed-4ef5-b218-748a036d2777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:26.789123 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340a9b1-23ed-4ef5-b218-748a036d2777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:26.790508 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340a9b1-23ed-4ef5-b218-748a036d2777 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:26.794591 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42b1ab-dd31-4621-b26b-520f350adf82 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:26.802398 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 264/501] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:26.803692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb79b0-607b-45f6-91ac-ed5da5b6c560 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.803981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb79b0-607b-45f6-91ac-ed5da5b6c560 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.804388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb79b0-607b-45f6-91ac-ed5da5b6c560 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.806029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 265/502] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:26.808307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb79b0-607b-45f6-91ac-ed5da5b6c560 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:26.834426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597dac-10ba-45cd-ae54-1d7fbc1d3bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:26.835064 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597dac-10ba-45cd-ae54-1d7fbc1d3bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.835349 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597dac-10ba-45cd-ae54-1d7fbc1d3bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.835627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597dac-10ba-45cd-ae54-1d7fbc1d3bd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.845677 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a597dac-10ba-45cd-ae54-1d7fbc1d3bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8a597dac-10ba-45cd-ae54-1d7fbc1d3bd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:26.851092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:26.851956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:26.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 238/503] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:26.853481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597dac-10ba-45cd-ae54-1d7fbc1d3bd2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:26.912584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb79b0-607b-45f6-91ac-ed5da5b6c560 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:26.950027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b706372-554b-417d-8c2a-e7b4138b9930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:26.950643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b706372-554b-417d-8c2a-e7b4138b9930 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.951040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b706372-554b-417d-8c2a-e7b4138b9930 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.951283 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b706372-554b-417d-8c2a-e7b4138b9930 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.951991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b706372-554b-417d-8c2a-e7b4138b9930 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:26.952375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b706372-554b-417d-8c2a-e7b4138b9930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:26.953769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b706372-554b-417d-8c2a-e7b4138b9930 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:26.957119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597dac-10ba-45cd-ae54-1d7fbc1d3bd2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:26.962236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 266/504] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:26.963034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b706372-554b-417d-8c2a-e7b4138b9930 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:26.979096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:26.991601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1c0f9-f7ef-4991-b55e-21df4fb72194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:26.992253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c0f9-f7ef-4991-b55e-21df4fb72194 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:26.992592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c0f9-f7ef-4991-b55e-21df4fb72194 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:26.992877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c0f9-f7ef-4991-b55e-21df4fb72194 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:26.993564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1c0f9-f7ef-4991-b55e-21df4fb72194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:26.993871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1c0f9-f7ef-4991-b55e-21df4fb72194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:26.995246 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1c0f9-f7ef-4991-b55e-21df4fb72194 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:27.006686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 239/505] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:27.008442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c4fe3-ddbf-42e4-a51c-00d89c8633b6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:27.008740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c4fe3-ddbf-42e4-a51c-00d89c8633b6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:27.009014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c4fe3-ddbf-42e4-a51c-00d89c8633b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:27.027620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ec1c4fe3-ddbf-42e4-a51c-00d89c8633b6 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:27.028828 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ec1c4fe3-ddbf-42e4-a51c-00d89c8633b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:27.030874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:27.065766 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b706372-554b-417d-8c2a-e7b4138b9930 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:27.096947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 240/506] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:27.097785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c4fe3-ddbf-42e4-a51c-00d89c8633b6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:27.103068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c99fe-a1b0-4c5a-98b7-ef00f42e3fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:27.103717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c99fe-a1b0-4c5a-98b7-ef00f42e3fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:27.104001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c99fe-a1b0-4c5a-98b7-ef00f42e3fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:27.104305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c99fe-a1b0-4c5a-98b7-ef00f42e3fe7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:27.113238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c99fe-a1b0-4c5a-98b7-ef00f42e3fe7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:27.114808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c99fe-a1b0-4c5a-98b7-ef00f42e3fe7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-d53c99fe-a1b0-4c5a-98b7-ef00f42e3fe7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:27.127952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:27.129041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:27.129937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:27.129937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:27.129937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:27.129937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:27.129937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:27.129937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:27.129937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:27.129937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:27.129937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:40:27.129937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:27.129937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 267/507] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:27.130481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c99fe-a1b0-4c5a-98b7-ef00f42e3fe7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:27.198544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:27.209778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c4fe3-ddbf-42e4-a51c-00d89c8633b6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:27.230902 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c99fe-a1b0-4c5a-98b7-ef00f42e3fe7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:27.243059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77899bc8-2f61-47b5-b9b0-1db5a198d96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:27.243670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77899bc8-2f61-47b5-b9b0-1db5a198d96d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:27.243951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77899bc8-2f61-47b5-b9b0-1db5a198d96d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:27.244262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77899bc8-2f61-47b5-b9b0-1db5a198d96d None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:27.244977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77899bc8-2f61-47b5-b9b0-1db5a198d96d None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:27.245282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77899bc8-2f61-47b5-b9b0-1db5a198d96d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:27.246643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77899bc8-2f61-47b5-b9b0-1db5a198d96d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:27.251641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:27.260357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 241/508] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:27.261211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77899bc8-2f61-47b5-b9b0-1db5a198d96d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:27.265054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d977f-aa97-4bf3-9829-3cc800cc3d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:27.265695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d977f-aa97-4bf3-9829-3cc800cc3d31 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:27.265978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d977f-aa97-4bf3-9829-3cc800cc3d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:27.266255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d977f-aa97-4bf3-9829-3cc800cc3d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:27.277609 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d977f-aa97-4bf3-9829-3cc800cc3d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:27.279070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d977f-aa97-4bf3-9829-3cc800cc3d31 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1b6d977f-aa97-4bf3-9829-3cc800cc3d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:27.293275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:27.294118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:27.295035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:27.295035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:27.295035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:27.295035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:27.295035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 268/509] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:27.295304 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d977f-aa97-4bf3-9829-3cc800cc3d31 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:27.369957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77899bc8-2f61-47b5-b9b0-1db5a198d96d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:27.403007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8564f-b2c1-4a11-b6a9-ad4186dc3923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:27.403646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8564f-b2c1-4a11-b6a9-ad4186dc3923 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:27.403938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8564f-b2c1-4a11-b6a9-ad4186dc3923 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:27.404066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d977f-aa97-4bf3-9829-3cc800cc3d31 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:27.404245 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8564f-b2c1-4a11-b6a9-ad4186dc3923 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:27.410900 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8564f-b2c1-4a11-b6a9-ad4186dc3923 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:27.412381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8564f-b2c1-4a11-b6a9-ad4186dc3923 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-6de8564f-b2c1-4a11-b6a9-ad4186dc3923 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:27.424444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:27.425280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:27.426111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:27.426111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:27.426111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:27.426111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:27.426111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:27.426111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:27.426111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:27.426111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:27.426111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 242/510] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:27.426564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8564f-b2c1-4a11-b6a9-ad4186dc3923 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:27.427043 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:27.442784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0129d-d610-453d-982a-082c4819fa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:27.443421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0129d-d610-453d-982a-082c4819fa7e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:27.443706 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0129d-d610-453d-982a-082c4819fa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:27.443983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0129d-d610-453d-982a-082c4819fa7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:27.455180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0129d-d610-453d-982a-082c4819fa7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:27.456674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0129d-d610-453d-982a-082c4819fa7e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-79c0129d-d610-453d-982a-082c4819fa7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:27.470826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:27.471692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:27.472849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:27.472849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:27.472849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:27.472849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:27.472849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 269/511] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:27.472849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0129d-d610-453d-982a-082c4819fa7e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:27.491973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:27.537803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8564f-b2c1-4a11-b6a9-ad4186dc3923 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:27.571664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a22e6-f388-4d5c-8a1e-041a1cb74904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:27.572310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a22e6-f388-4d5c-8a1e-041a1cb74904 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:27.572589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a22e6-f388-4d5c-8a1e-041a1cb74904 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:27.572858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a22e6-f388-4d5c-8a1e-041a1cb74904 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:27.573642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a22e6-f388-4d5c-8a1e-041a1cb74904 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:27.573950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a22e6-f388-4d5c-8a1e-041a1cb74904 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:27.575371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a22e6-f388-4d5c-8a1e-041a1cb74904 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:27.576049 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0129d-d610-453d-982a-082c4819fa7e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:27.609135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a0a89-1066-4f10-80f9-4eb886bf5215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:27.609780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0a89-1066-4f10-80f9-4eb886bf5215 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:27.610063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0a89-1066-4f10-80f9-4eb886bf5215 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:27.610342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0a89-1066-4f10-80f9-4eb886bf5215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:27.611074 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 243/512] 10.222.0.17 () {56 vars in 1137 bytes} [Tue Aug 2 08:40:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:27.611905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a22e6-f388-4d5c-8a1e-041a1cb74904 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:27.623285 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a0a89-1066-4f10-80f9-4eb886bf5215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:27.624760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a0a89-1066-4f10-80f9-4eb886bf5215 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e24a0a89-1066-4f10-80f9-4eb886bf5215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:27.639532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:27.640386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:27.646020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:27.646020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:27.646020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:27.646020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:27.646020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 270/513] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:27.646020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a0a89-1066-4f10-80f9-4eb886bf5215 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:27.668890 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:27.721696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a22e6-f388-4d5c-8a1e-041a1cb74904 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:27.740573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:27.749785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a0a89-1066-4f10-80f9-4eb886bf5215 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:27.757707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087f4e9-3182-4261-b8b9-69f64210e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:27.758365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f4e9-3182-4261-b8b9-69f64210e541 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:27.758655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f4e9-3182-4261-b8b9-69f64210e541 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:27.758937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f4e9-3182-4261-b8b9-69f64210e541 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:27.759912 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087f4e9-3182-4261-b8b9-69f64210e541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:27.760252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087f4e9-3182-4261-b8b9-69f64210e541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:27.761631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087f4e9-3182-4261-b8b9-69f64210e541 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:27.773130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 244/514] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:27.773954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087f4e9-3182-4261-b8b9-69f64210e541 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:27.784285 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1b632-fd20-441e-b6f7-6deac4f14e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:27.784906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1b632-fd20-441e-b6f7-6deac4f14e91 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:27.785188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1b632-fd20-441e-b6f7-6deac4f14e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:27.785464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1b632-fd20-441e-b6f7-6deac4f14e91 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:27.786218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1b632-fd20-441e-b6f7-6deac4f14e91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:27.786530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1b632-fd20-441e-b6f7-6deac4f14e91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:27.787970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1b632-fd20-441e-b6f7-6deac4f14e91 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:27.811167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 271/515] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:27.811167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1b632-fd20-441e-b6f7-6deac4f14e91 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:27.877683 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087f4e9-3182-4261-b8b9-69f64210e541 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:27.894776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:27.910231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f338de-bbe2-4bc2-83e4-9606ab80fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:27.910393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1b632-fd20-441e-b6f7-6deac4f14e91 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:27.910844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f338de-bbe2-4bc2-83e4-9606ab80fbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:27.911123 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f338de-bbe2-4bc2-83e4-9606ab80fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:27.911396 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f338de-bbe2-4bc2-83e4-9606ab80fbb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:27.912080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f338de-bbe2-4bc2-83e4-9606ab80fbb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:27.912417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f338de-bbe2-4bc2-83e4-9606ab80fbb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:27.913786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f338de-bbe2-4bc2-83e4-9606ab80fbb7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:27.925877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 245/516] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:27.926684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f338de-bbe2-4bc2-83e4-9606ab80fbb7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:27.946572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1731ab-6014-4dcd-bdf1-dfc7bc8ec236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:27.947191 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1731ab-6014-4dcd-bdf1-dfc7bc8ec236 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:27.947478 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1731ab-6014-4dcd-bdf1-dfc7bc8ec236 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:27.947754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1731ab-6014-4dcd-bdf1-dfc7bc8ec236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:27.965467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:28.014866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1731ab-6014-4dcd-bdf1-dfc7bc8ec236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:28.016495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1731ab-6014-4dcd-bdf1-dfc7bc8ec236 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:28.026507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f338de-bbe2-4bc2-83e4-9606ab80fbb7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:28.061463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71bed7-3f23-4655-9ee0-716e9484e379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:28.062084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71bed7-3f23-4655-9ee0-716e9484e379 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:28.062374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71bed7-3f23-4655-9ee0-716e9484e379 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:28.062651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71bed7-3f23-4655-9ee0-716e9484e379 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:28.063354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71bed7-3f23-4655-9ee0-716e9484e379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:28.063647 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71bed7-3f23-4655-9ee0-716e9484e379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:28.065044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71bed7-3f23-4655-9ee0-716e9484e379 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:28.076290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 246/517] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:28.077275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71bed7-3f23-4655-9ee0-716e9484e379 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:28.105068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:28.120746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 272/518] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:28.125322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1731ab-6014-4dcd-bdf1-dfc7bc8ec236 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:28.180590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:28.184381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71bed7-3f23-4655-9ee0-716e9484e379 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:28.220086 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b373c06-a20b-48a3-9ff8-fa7b59f43a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:28.220314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1731ab-6014-4dcd-bdf1-dfc7bc8ec236 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:28.220746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b373c06-a20b-48a3-9ff8-fa7b59f43a2d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:28.221023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b373c06-a20b-48a3-9ff8-fa7b59f43a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:28.221292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b373c06-a20b-48a3-9ff8-fa7b59f43a2d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:28.229119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b373c06-a20b-48a3-9ff8-fa7b59f43a2d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:28.230571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b373c06-a20b-48a3-9ff8-fa7b59f43a2d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-7b373c06-a20b-48a3-9ff8-fa7b59f43a2d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:28.241598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:28.242658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:28.243539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:28.243539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:28.243539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:28.243539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:28.243539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:28.243539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:28.243539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:28.243539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:28.243539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:40:28.243539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:28.243539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 247/519] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:28.243539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b373c06-a20b-48a3-9ff8-fa7b59f43a2d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:28.258228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a3b09-2035-4762-93f7-23f96b03a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:28.258838 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a3b09-2035-4762-93f7-23f96b03a633 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:28.259120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a3b09-2035-4762-93f7-23f96b03a633 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:28.259393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a3b09-2035-4762-93f7-23f96b03a633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:28.260203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a3b09-2035-4762-93f7-23f96b03a633 None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=e1de289ba7ae4140a421127b8f18901f) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:28.260519 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a3b09-2035-4762-93f7-23f96b03a633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:28.261945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a3b09-2035-4762-93f7-23f96b03a633 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:28.280426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 273/520] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:28 2022] GET /identity/v3/role_assignments?user.id=e1de289ba7ae4140a421127b8f18901f&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:28.280426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a3b09-2035-4762-93f7-23f96b03a633 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:28.331057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:28.357117 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b373c06-a20b-48a3-9ff8-fa7b59f43a2d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:28.390719 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a3b09-2035-4762-93f7-23f96b03a633 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:28.394715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d4c64-a801-4eb0-b929-535712020ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:28.395344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d4c64-a801-4eb0-b929-535712020ad5 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:28.395626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d4c64-a801-4eb0-b929-535712020ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:28.395901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d4c64-a801-4eb0-b929-535712020ad5 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:28.396622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d4c64-a801-4eb0-b929-535712020ad5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:28.399180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d4c64-a801-4eb0-b929-535712020ad5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:28.423025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 248/521] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:40:28 2022] POST /identity/v3/users => generated 247 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:40:28.424229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d4c64-a801-4eb0-b929-535712020ad5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:28.429620 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8c7c7-182d-4c12-af02-33884c8d2e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:28.430348 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8c7c7-182d-4c12-af02-33884c8d2e17 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:28.430688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8c7c7-182d-4c12-af02-33884c8d2e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:28.430904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8c7c7-182d-4c12-af02-33884c8d2e17 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:28.440002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8c7c7-182d-4c12-af02-33884c8d2e17 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:28.441541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8c7c7-182d-4c12-af02-33884c8d2e17 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:28.443005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-2bd8c7c7-182d-4c12-af02-33884c8d2e17 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:28.455540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:28.456788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:28.459219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:28.459219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:28.459219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:28.459219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:28.459219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:28.459219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:28.459219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:28.459219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:28.459219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:40:28.459219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:28.459219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 274/522] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:28.459219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8c7c7-182d-4c12-af02-33884c8d2e17 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:28.578389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8c7c7-182d-4c12-af02-33884c8d2e17 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:28.578818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d4c64-a801-4eb0-b929-535712020ad5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:28.592036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:28.622807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18c91a-e529-46a3-9ee8-2b38a64a02e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:28.623434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18c91a-e529-46a3-9ee8-2b38a64a02e3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:28.623710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18c91a-e529-46a3-9ee8-2b38a64a02e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:28.623991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18c91a-e529-46a3-9ee8-2b38a64a02e3 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:28.624826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18c91a-e529-46a3-9ee8-2b38a64a02e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:28.625010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd868e6-4cf2-423f-84ac-c3c92b70e831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:28.625140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18c91a-e529-46a3-9ee8-2b38a64a02e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:28.625649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd868e6-4cf2-423f-84ac-c3c92b70e831 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:28.625928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd868e6-4cf2-423f-84ac-c3c92b70e831 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:28.626200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd868e6-4cf2-423f-84ac-c3c92b70e831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:28.626565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18c91a-e529-46a3-9ee8-2b38a64a02e3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:28.639039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd868e6-4cf2-423f-84ac-c3c92b70e831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:28.640532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd868e6-4cf2-423f-84ac-c3c92b70e831 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:28.649450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 275/523] 10.222.0.17 () {56 vars in 1137 bytes} [Tue Aug 2 08:40:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:28.651146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18c91a-e529-46a3-9ee8-2b38a64a02e3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-5bd868e6-4cf2-423f-84ac-c3c92b70e831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:28.660059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:28.660960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:28.661797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:28.661797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:28.661797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:28.661797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:28.661797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 249/524] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:28.662314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd868e6-4cf2-423f-84ac-c3c92b70e831 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:28.752564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:28.771723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18c91a-e529-46a3-9ee8-2b38a64a02e3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:28.797464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd868e6-4cf2-423f-84ac-c3c92b70e831 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:28.827869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e23a-b31e-41ab-9623-ceddd67b6375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:28.829172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e23a-b31e-41ab-9623-ceddd67b6375 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:28.830121 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e23a-b31e-41ab-9623-ceddd67b6375 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:28.830945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e23a-b31e-41ab-9623-ceddd67b6375 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:28.832240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7e23a-b31e-41ab-9623-ceddd67b6375 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:28.833266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7e23a-b31e-41ab-9623-ceddd67b6375 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:28.835425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7e23a-b31e-41ab-9623-ceddd67b6375 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:28.842511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98658cf9-0349-4f0b-a239-5276edad6c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:28.843144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98658cf9-0349-4f0b-a239-5276edad6c5a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:28.843431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98658cf9-0349-4f0b-a239-5276edad6c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:28.843708 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98658cf9-0349-4f0b-a239-5276edad6c5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:28.863720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 276/525] 10.222.0.17 () {56 vars in 1139 bytes} [Tue Aug 2 08:40:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:28.863720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e23a-b31e-41ab-9623-ceddd67b6375 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:28.896109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:28.950684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98658cf9-0349-4f0b-a239-5276edad6c5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:28.951869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98658cf9-0349-4f0b-a239-5276edad6c5a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:28.988530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e23a-b31e-41ab-9623-ceddd67b6375 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:29.038106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:29.053207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9abaac-0938-4a5b-899a-e6cd4cdc7677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:29.054319 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9abaac-0938-4a5b-899a-e6cd4cdc7677 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:29.055810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9abaac-0938-4a5b-899a-e6cd4cdc7677 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:29.056375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9abaac-0938-4a5b-899a-e6cd4cdc7677 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:29.057835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9abaac-0938-4a5b-899a-e6cd4cdc7677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:29.058823 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9abaac-0938-4a5b-899a-e6cd4cdc7677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:29.062261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9abaac-0938-4a5b-899a-e6cd4cdc7677 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:29.088186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 250/526] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:29.088186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98658cf9-0349-4f0b-a239-5276edad6c5a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:29.093117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 277/527] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:29.093705 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9abaac-0938-4a5b-899a-e6cd4cdc7677 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:29.203802 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98658cf9-0349-4f0b-a239-5276edad6c5a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:29.212291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:29.231397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9abaac-0938-4a5b-899a-e6cd4cdc7677 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:29.253390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d49c2-742e-4fea-a5c6-50585a772d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:29.254191 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d49c2-742e-4fea-a5c6-50585a772d6d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:29.254572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d49c2-742e-4fea-a5c6-50585a772d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:29.254951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d49c2-742e-4fea-a5c6-50585a772d6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:29.271067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0914ab3-1797-42c4-9b14-161738f67b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:29.271940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0914ab3-1797-42c4-9b14-161738f67b4a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:29.272398 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0914ab3-1797-42c4-9b14-161738f67b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:29.272844 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0914ab3-1797-42c4-9b14-161738f67b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:29.284652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0914ab3-1797-42c4-9b14-161738f67b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:29.286390 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0914ab3-1797-42c4-9b14-161738f67b4a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:29.297780 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c0914ab3-1797-42c4-9b14-161738f67b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:29.302482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:29.303595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:29.304687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:29.304687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:29.304687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:29.304687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:29.307279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 278/528] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:29.308397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0914ab3-1797-42c4-9b14-161738f67b4a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:29.351233 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d49c2-742e-4fea-a5c6-50585a772d6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:29.353452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d49c2-742e-4fea-a5c6-50585a772d6d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:29.421331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0914ab3-1797-42c4-9b14-161738f67b4a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:29.462471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8c81d-d76d-4c2d-9432-f91d52066fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:29.463361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8c81d-d76d-4c2d-9432-f91d52066fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:29.463830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8c81d-d76d-4c2d-9432-f91d52066fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:29.464284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8c81d-d76d-4c2d-9432-f91d52066fb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:29.473197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8c81d-d76d-4c2d-9432-f91d52066fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:29.474681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8c81d-d76d-4c2d-9432-f91d52066fb7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:29.476472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-17c8c81d-d76d-4c2d-9432-f91d52066fb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:29.490292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:29.491196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:29.492068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:29.492068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:29.492068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:29.492068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:29.492068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:29.492068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:29.492068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:29.492068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:29.496764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 279/529] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:29.497647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8c81d-d76d-4c2d-9432-f91d52066fb7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:29.503983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 251/530] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:29.505975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d49c2-742e-4fea-a5c6-50585a772d6d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:29.595656 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:29.613871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8c81d-d76d-4c2d-9432-f91d52066fb7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:29.646349 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d49c2-742e-4fea-a5c6-50585a772d6d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:29.658086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f43ad-446c-4303-bafc-b30fd4f2b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:29.658711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f43ad-446c-4303-bafc-b30fd4f2b96a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:29.659056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f43ad-446c-4303-bafc-b30fd4f2b96a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:29.659550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f43ad-446c-4303-bafc-b30fd4f2b96a None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:29.660140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f43ad-446c-4303-bafc-b30fd4f2b96a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:29.660476 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f43ad-446c-4303-bafc-b30fd4f2b96a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:29.662490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f43ad-446c-4303-bafc-b30fd4f2b96a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:29.681475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 280/531] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:29.681475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f43ad-446c-4303-bafc-b30fd4f2b96a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:29.696974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bcf78-7abf-43ef-b1a0-654755a1377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:29.698106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bcf78-7abf-43ef-b1a0-654755a1377e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:29.699055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bcf78-7abf-43ef-b1a0-654755a1377e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:29.699673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bcf78-7abf-43ef-b1a0-654755a1377e None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:29.700785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bcf78-7abf-43ef-b1a0-654755a1377e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:29.701530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bcf78-7abf-43ef-b1a0-654755a1377e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:29.703559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bcf78-7abf-43ef-b1a0-654755a1377e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:29.729451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 252/532] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:29.730540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bcf78-7abf-43ef-b1a0-654755a1377e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:29.752632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:29.821398 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f43ad-446c-4303-bafc-b30fd4f2b96a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:29.857022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bcf78-7abf-43ef-b1a0-654755a1377e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:29.865836 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5b2e8-b17a-4461-85b5-a4a8fc872b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:29.866798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5b2e8-b17a-4461-85b5-a4a8fc872b1c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:29.867159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5b2e8-b17a-4461-85b5-a4a8fc872b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:29.867550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5b2e8-b17a-4461-85b5-a4a8fc872b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:29.880246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5b2e8-b17a-4461-85b5-a4a8fc872b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:29.882395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5b2e8-b17a-4461-85b5-a4a8fc872b1c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:29.889474 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:29.901200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0660b0d-7529-410b-aa10-d8f2dffda3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:29.902087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0660b0d-7529-410b-aa10-d8f2dffda3df None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:29.902547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0660b0d-7529-410b-aa10-d8f2dffda3df None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:29.902999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0660b0d-7529-410b-aa10-d8f2dffda3df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e6f5b2e8-b17a-4461-85b5-a4a8fc872b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:29.904367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:29.905193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:29.906046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:29.906046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:29.906046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:29.906046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:29.910305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 281/533] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:29.911247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5b2e8-b17a-4461-85b5-a4a8fc872b1c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:29.913288 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0660b0d-7529-410b-aa10-d8f2dffda3df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:29.916219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0660b0d-7529-410b-aa10-d8f2dffda3df None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f0660b0d-7529-410b-aa10-d8f2dffda3df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:29.930961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:29.931814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:29.932678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:29.932678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:29.932678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:29.932678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:29.932678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:29.932678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:29.932678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:29.932678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:29.938642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 253/534] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:29.938642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0660b0d-7529-410b-aa10-d8f2dffda3df None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:30.050152 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5b2e8-b17a-4461-85b5-a4a8fc872b1c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:30.061731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0660b0d-7529-410b-aa10-d8f2dffda3df None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:30.062946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:30.091929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6e703-b043-4b84-9371-b544a03137ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:30.092753 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6e703-b043-4b84-9371-b544a03137ef None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:30.093142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6e703-b043-4b84-9371-b544a03137ef None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:30.093525 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6e703-b043-4b84-9371-b544a03137ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:30.094424 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6e703-b043-4b84-9371-b544a03137ef None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=b2c5059aacc149deb6cdb86d3341e78b) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:30.094851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6e703-b043-4b84-9371-b544a03137ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:30.096420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6e703-b043-4b84-9371-b544a03137ef None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:30.105752 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 282/535] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:29 2022] GET /identity/v3/role_assignments?user.id=b2c5059aacc149deb6cdb86d3341e78b&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:30.106873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6e703-b043-4b84-9371-b544a03137ef None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:30.118738 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678e30d-814d-43af-ac06-bea574ba061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:30.119625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678e30d-814d-43af-ac06-bea574ba061b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:30.120221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678e30d-814d-43af-ac06-bea574ba061b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:30.120650 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678e30d-814d-43af-ac06-bea574ba061b None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:30.123712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678e30d-814d-43af-ac06-bea574ba061b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:30.128987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678e30d-814d-43af-ac06-bea574ba061b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:30.131358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678e30d-814d-43af-ac06-bea574ba061b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:30.150210 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 254/536] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:30.160075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678e30d-814d-43af-ac06-bea574ba061b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:30.249477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6e703-b043-4b84-9371-b544a03137ef None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:30.292408 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:30.294677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7a3a6-d255-4250-a496-aefa88743203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:30.295325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a3a6-d255-4250-a496-aefa88743203 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:30.295609 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a3a6-d255-4250-a496-aefa88743203 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:30.295885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a3a6-d255-4250-a496-aefa88743203 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:30.296939 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7a3a6-d255-4250-a496-aefa88743203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:30.297255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7a3a6-d255-4250-a496-aefa88743203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:30.300433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7a3a6-d255-4250-a496-aefa88743203 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:30.325187 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 283/537] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:30.332653 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7a3a6-d255-4250-a496-aefa88743203 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:30.381338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678e30d-814d-43af-ac06-bea574ba061b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:30.410386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:30.441994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c9eea-c420-4116-ac44-e950a3e7b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:30.441994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9eea-c420-4116-ac44-e950a3e7b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:30.442761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9eea-c420-4116-ac44-e950a3e7b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:30.443265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9eea-c420-4116-ac44-e950a3e7b0e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:30.453687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c9eea-c420-4116-ac44-e950a3e7b0e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:30.455738 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c9eea-c420-4116-ac44-e950a3e7b0e8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-5d2c9eea-c420-4116-ac44-e950a3e7b0e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:30.478401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:30.479308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:30.480640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:30.480640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:30.480640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:30.480640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:30.480640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:30.480640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:30.480640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:30.480640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:30.480640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 255/538] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:30.481551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40e27-f330-4430-978a-2df7dd14002e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:30.481718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40e27-f330-4430-978a-2df7dd14002e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:30.482000 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40e27-f330-4430-978a-2df7dd14002e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:30.484055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 256/539] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:30.489161 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b40e27-f330-4430-978a-2df7dd14002e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:30.516842 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7a3a6-d255-4250-a496-aefa88743203 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:30.556431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09100a-d79e-4cc2-bc13-702cbd05d284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:30.557388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09100a-d79e-4cc2-bc13-702cbd05d284 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:30.558086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09100a-d79e-4cc2-bc13-702cbd05d284 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:30.558714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09100a-d79e-4cc2-bc13-702cbd05d284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:30.560257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09100a-d79e-4cc2-bc13-702cbd05d284 None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=27e0b08a946b43f08028c5da415d4e8c) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:30.560757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09100a-d79e-4cc2-bc13-702cbd05d284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:30.562452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09100a-d79e-4cc2-bc13-702cbd05d284 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:30.569038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 284/540] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:30 2022] GET /identity/v3/role_assignments?user.id=27e0b08a946b43f08028c5da415d4e8c&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:30.573686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf9972-3301-425e-addd-d1237cf394fb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:30.573977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf9972-3301-425e-addd-d1237cf394fb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:30.575013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf9972-3301-425e-addd-d1237cf394fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:30.593645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-74bf9972-3301-425e-addd-d1237cf394fb None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:30.594965 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-74bf9972-3301-425e-addd-d1237cf394fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:30.602582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b40e27-f330-4430-978a-2df7dd14002e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:30.610881 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:30.644884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd5b90-0b72-4589-93dc-4adfd2557741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:30.645468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd5b90-0b72-4589-93dc-4adfd2557741 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:30.646409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd5b90-0b72-4589-93dc-4adfd2557741 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:30.646739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd5b90-0b72-4589-93dc-4adfd2557741 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:30.647527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd5b90-0b72-4589-93dc-4adfd2557741 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:30.647844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd5b90-0b72-4589-93dc-4adfd2557741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:30.649921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd5b90-0b72-4589-93dc-4adfd2557741 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:30.667658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 257/541] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:30.669834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709a498-58b4-4ed3-8540-074506789beb None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:30.670130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709a498-58b4-4ed3-8540-074506789beb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:30.670414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709a498-58b4-4ed3-8540-074506789beb None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:30.672313 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 258/542] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:30.673561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709a498-58b4-4ed3-8540-074506789beb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:30.685793 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 285/543] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:30.687226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae8539-3a31-4e59-99d5-5c964ab8bdcd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:30.687587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae8539-3a31-4e59-99d5-5c964ab8bdcd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:30.687871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae8539-3a31-4e59-99d5-5c964ab8bdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:30.709689 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-06ae8539-3a31-4e59-99d5-5c964ab8bdcd None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:30.710915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-06ae8539-3a31-4e59-99d5-5c964ab8bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:30.743037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:30.799219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 286/544] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:30.800738 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae8539-3a31-4e59-99d5-5c964ab8bdcd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:30.852357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709a498-58b4-4ed3-8540-074506789beb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:30.897023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468c369-959e-4b77-b951-0a336c747afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:30.897568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468c369-959e-4b77-b951-0a336c747afa None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:30.897847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468c369-959e-4b77-b951-0a336c747afa None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:30.898118 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468c369-959e-4b77-b951-0a336c747afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:30.899085 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468c369-959e-4b77-b951-0a336c747afa None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=c9162dcfb8d542679c7217fae8f5c185) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:30.899438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468c369-959e-4b77-b951-0a336c747afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:30.901580 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468c369-959e-4b77-b951-0a336c747afa None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:30.909997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 259/545] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:30 2022] GET /identity/v3/role_assignments?user.id=c9162dcfb8d542679c7217fae8f5c185&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:30.911138 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468c369-959e-4b77-b951-0a336c747afa None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:30.935057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae8539-3a31-4e59-99d5-5c964ab8bdcd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:30.955526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:30.983014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b46064-8340-4256-9461-333dbbd72b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:30.984104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b46064-8340-4256-9461-333dbbd72b44 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:30.984878 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b46064-8340-4256-9461-333dbbd72b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:30.985336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b46064-8340-4256-9461-333dbbd72b44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:31.000523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b46064-8340-4256-9461-333dbbd72b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-40b46064-8340-4256-9461-333dbbd72b44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:31.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:31.007474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:31.009295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:31.009295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:31.009295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:31.009295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:31.009295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:31.009295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:31.009295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:31.009295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:31.009295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:31.009295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:31.009295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:31.009295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:31.010469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 287/546] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:31.018566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b46064-8340-4256-9461-333dbbd72b44 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:31.049932 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468c369-959e-4b77-b951-0a336c747afa None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:31.059769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:31.116930 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a98aca-2d43-47b3-a8a8-526a35ce550d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:31.118218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a98aca-2d43-47b3-a8a8-526a35ce550d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:31.118578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a98aca-2d43-47b3-a8a8-526a35ce550d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:31.118578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a98aca-2d43-47b3-a8a8-526a35ce550d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:31.153015 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a98aca-2d43-47b3-a8a8-526a35ce550d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:31.158738 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b46064-8340-4256-9461-333dbbd72b44 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c1a98aca-2d43-47b3-a8a8-526a35ce550d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:31.169044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:31.170092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:31.170883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 260/547] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:31.178078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a98aca-2d43-47b3-a8a8-526a35ce550d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:31.203671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3f64f-6848-4b2e-8c3d-c7b4e5e5c6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:31.204443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3f64f-6848-4b2e-8c3d-c7b4e5e5c6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:31.205107 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3f64f-6848-4b2e-8c3d-c7b4e5e5c6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:31.205397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3f64f-6848-4b2e-8c3d-c7b4e5e5c6e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:31.206185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3f64f-6848-4b2e-8c3d-c7b4e5e5c6e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:31.206500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3f64f-6848-4b2e-8c3d-c7b4e5e5c6e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:31.208017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3f64f-6848-4b2e-8c3d-c7b4e5e5c6e6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:31.220601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 288/548] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:31.229011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3f64f-6848-4b2e-8c3d-c7b4e5e5c6e6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:31.331733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:31.367193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:31.378122 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a98aca-2d43-47b3-a8a8-526a35ce550d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:31.380351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3f64f-6848-4b2e-8c3d-c7b4e5e5c6e6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:31.422238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3e1ef-d3b5-4ae0-9223-644b45bf8fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:31.422799 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3e1ef-d3b5-4ae0-9223-644b45bf8fbc None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:31.423076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3e1ef-d3b5-4ae0-9223-644b45bf8fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:31.423347 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3e1ef-d3b5-4ae0-9223-644b45bf8fbc None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:31.424073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3e1ef-d3b5-4ae0-9223-644b45bf8fbc None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:31.424405 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3e1ef-d3b5-4ae0-9223-644b45bf8fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:31.425790 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3e1ef-d3b5-4ae0-9223-644b45bf8fbc None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:31.440688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 261/549] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:31.442117 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3e1ef-d3b5-4ae0-9223-644b45bf8fbc None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:31.470777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8148a-94a6-4a2b-bcd3-74b3654cc31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:31.471878 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8148a-94a6-4a2b-bcd3-74b3654cc31f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:31.472426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8148a-94a6-4a2b-bcd3-74b3654cc31f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:31.472921 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8148a-94a6-4a2b-bcd3-74b3654cc31f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:31.493471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8148a-94a6-4a2b-bcd3-74b3654cc31f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:31.494944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8148a-94a6-4a2b-bcd3-74b3654cc31f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-acd8148a-94a6-4a2b-bcd3-74b3654cc31f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:31.521905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:31.523388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:31.524417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:31.524417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:31.524417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:31.524417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:31.524417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 289/550] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:31.530831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8148a-94a6-4a2b-bcd3-74b3654cc31f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:31.550868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3e1ef-d3b5-4ae0-9223-644b45bf8fbc None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:31.589523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5acd5-215c-49d1-82e0-05e2c1b388ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:31.590167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5acd5-215c-49d1-82e0-05e2c1b388ae None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:31.590449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5acd5-215c-49d1-82e0-05e2c1b388ae None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:31.590724 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5acd5-215c-49d1-82e0-05e2c1b388ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:31.604730 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5acd5-215c-49d1-82e0-05e2c1b388ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:31.606784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5acd5-215c-49d1-82e0-05e2c1b388ae None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-ccb5acd5-215c-49d1-82e0-05e2c1b388ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:31.624069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:31.624999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:31.625991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:31.625991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:31.625991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:31.625991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:31.625991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 262/551] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:40:31.630987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5acd5-215c-49d1-82e0-05e2c1b388ae None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:31.636453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:31.744037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5acd5-215c-49d1-82e0-05e2c1b388ae None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:31.781099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3516a1-8516-4362-bcde-d3a99b6c7923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:31.781853 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3516a1-8516-4362-bcde-d3a99b6c7923 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:31.782137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3516a1-8516-4362-bcde-d3a99b6c7923 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:31.782414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3516a1-8516-4362-bcde-d3a99b6c7923 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:31.783107 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3516a1-8516-4362-bcde-d3a99b6c7923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:31.783412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3516a1-8516-4362-bcde-d3a99b6c7923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:31.784816 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3516a1-8516-4362-bcde-d3a99b6c7923 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:31.798123 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8148a-94a6-4a2b-bcd3-74b3654cc31f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:31.799394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 263/552] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:31.806523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3516a1-8516-4362-bcde-d3a99b6c7923 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:31.880989 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:31.888525 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876c1fe-1c1d-4269-89b8-ac6396e2304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:31.889228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876c1fe-1c1d-4269-89b8-ac6396e2304e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:31.889515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876c1fe-1c1d-4269-89b8-ac6396e2304e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:31.889793 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876c1fe-1c1d-4269-89b8-ac6396e2304e None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:31.890493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876c1fe-1c1d-4269-89b8-ac6396e2304e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:31.890806 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876c1fe-1c1d-4269-89b8-ac6396e2304e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:31.892229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876c1fe-1c1d-4269-89b8-ac6396e2304e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:31.901858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:31.925631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 290/553] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:31.928786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876c1fe-1c1d-4269-89b8-ac6396e2304e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:31.973663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3516a1-8516-4362-bcde-d3a99b6c7923 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:32.057861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6969bb-24dd-49f2-9f32-550b481f418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:32.058653 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6969bb-24dd-49f2-9f32-550b481f418b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:32.058945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6969bb-24dd-49f2-9f32-550b481f418b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:32.059225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6969bb-24dd-49f2-9f32-550b481f418b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:32.075069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6969bb-24dd-49f2-9f32-550b481f418b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:32.076582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6969bb-24dd-49f2-9f32-550b481f418b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-bd6969bb-24dd-49f2-9f32-550b481f418b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:32.101081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:32.102739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:32.103696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:32.103696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:32.103696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:32.103696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:32.103696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:32.103696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:32.103696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:32.103696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:32.103696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:40:32.103696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:32.106993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 264/554] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:32.114958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876c1fe-1c1d-4269-89b8-ac6396e2304e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:32.121812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6969bb-24dd-49f2-9f32-550b481f418b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:32.184791 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5c09-6818-4f68-88b1-21c5441b8ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:32.187565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5c09-6818-4f68-88b1-21c5441b8ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:32.187849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5c09-6818-4f68-88b1-21c5441b8ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:32.188147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5c09-6818-4f68-88b1-21c5441b8ef9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:32.204094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f5c09-6818-4f68-88b1-21c5441b8ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:32.205603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f5c09-6818-4f68-88b1-21c5441b8ef9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-0e4f5c09-6818-4f68-88b1-21c5441b8ef9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:32.228737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:32.230940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:32.233723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:32.233723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:32.233723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:32.233723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:32.233723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:32.233723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:32.233723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:32.233723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:32.233723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:40:32.233723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:32.233723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 291/555] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Aug 2 08:40:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:32.241409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5c09-6818-4f68-88b1-21c5441b8ef9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:32.306109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6969bb-24dd-49f2-9f32-550b481f418b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:32.338962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:32.349769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:32.373220 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c34727-4cb5-4a3f-92a6-c36662add7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:32.373923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c34727-4cb5-4a3f-92a6-c36662add7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:32.374207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c34727-4cb5-4a3f-92a6-c36662add7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:32.374479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c34727-4cb5-4a3f-92a6-c36662add7d8 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:32.375285 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c34727-4cb5-4a3f-92a6-c36662add7d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:32.375589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c34727-4cb5-4a3f-92a6-c36662add7d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:32.377044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c34727-4cb5-4a3f-92a6-c36662add7d8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:32.413940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 265/556] 10.222.0.17 () {56 vars in 1135 bytes} [Tue Aug 2 08:40:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:32.420160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c34727-4cb5-4a3f-92a6-c36662add7d8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:32.426832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5c09-6818-4f68-88b1-21c5441b8ef9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:32.478590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2ecac-1f85-48fe-a6ee-047d2d282aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:32.479210 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2ecac-1f85-48fe-a6ee-047d2d282aec None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:32.479560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2ecac-1f85-48fe-a6ee-047d2d282aec None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:32.479835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2ecac-1f85-48fe-a6ee-047d2d282aec None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:32.480661 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2ecac-1f85-48fe-a6ee-047d2d282aec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:32.480970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2ecac-1f85-48fe-a6ee-047d2d282aec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:32.482647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2ecac-1f85-48fe-a6ee-047d2d282aec None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:32.502979 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 292/557] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Aug 2 08:40:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:32.504473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188983b6-9a00-461a-899e-028ceb736bd9 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:32.504775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188983b6-9a00-461a-899e-028ceb736bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:32.505055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188983b6-9a00-461a-899e-028ceb736bd9 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:32.510742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 293/558] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:32.510742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188983b6-9a00-461a-899e-028ceb736bd9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:32.566707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c34727-4cb5-4a3f-92a6-c36662add7d8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:32.616673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365465af-a855-43e6-9d6b-aa22c9f95c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:32.618034 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365465af-a855-43e6-9d6b-aa22c9f95c2b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:32.618458 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365465af-a855-43e6-9d6b-aa22c9f95c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:32.618841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188983b6-9a00-461a-899e-028ceb736bd9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:32.619145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365465af-a855-43e6-9d6b-aa22c9f95c2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:32.631310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:32.658310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349399b-e706-4e28-ba1d-5273be381f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:32.659088 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349399b-e706-4e28-ba1d-5273be381f6d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:32.659439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349399b-e706-4e28-ba1d-5273be381f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:32.659786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349399b-e706-4e28-ba1d-5273be381f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:32.673670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349399b-e706-4e28-ba1d-5273be381f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:32.675139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349399b-e706-4e28-ba1d-5273be381f6d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:32.682413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7349399b-e706-4e28-ba1d-5273be381f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:32.698364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:32.699288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:32.700208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:32.700208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:32.700208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:32.700208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:32.706621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 294/559] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:32.706621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655ca1f-a437-4e31-9264-33a985613fa5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:32.706621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655ca1f-a437-4e31-9264-33a985613fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:32.706621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655ca1f-a437-4e31-9264-33a985613fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:32.708999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365465af-a855-43e6-9d6b-aa22c9f95c2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:32.710517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365465af-a855-43e6-9d6b-aa22c9f95c2b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:32.732301 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b655ca1f-a437-4e31-9264-33a985613fa5 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:32.734187 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b655ca1f-a437-4e31-9264-33a985613fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:32.822358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 295/560] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:32.824074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655ca1f-a437-4e31-9264-33a985613fa5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:32.851287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 266/561] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:32.856495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ef3d-45fb-40f6-8bab-c1139ebfd98c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:32.856803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ef3d-45fb-40f6-8bab-c1139ebfd98c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:32.857148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ef3d-45fb-40f6-8bab-c1139ebfd98c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:32.858649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 267/562] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:32.860222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720ef3d-45fb-40f6-8bab-c1139ebfd98c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:32.928991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:32.939597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655ca1f-a437-4e31-9264-33a985613fa5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:32.952983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:32.974284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720ef3d-45fb-40f6-8bab-c1139ebfd98c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:32.978241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb563c-0f13-4806-aac1-3e45dc667e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:32.978921 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb563c-0f13-4806-aac1-3e45dc667e66 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:32.979206 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb563c-0f13-4806-aac1-3e45dc667e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:32.979482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb563c-0f13-4806-aac1-3e45dc667e66 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:32.980269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb563c-0f13-4806-aac1-3e45dc667e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:32.980575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb563c-0f13-4806-aac1-3e45dc667e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:32.981955 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb563c-0f13-4806-aac1-3e45dc667e66 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:32.998029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 296/563] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:32.999255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb563c-0f13-4806-aac1-3e45dc667e66 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:33.014034 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3620f-0ceb-4deb-b40d-a42a9bd256bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:33.014675 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3620f-0ceb-4deb-b40d-a42a9bd256bc None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.014952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3620f-0ceb-4deb-b40d-a42a9bd256bc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.015227 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3620f-0ceb-4deb-b40d-a42a9bd256bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.028405 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3620f-0ceb-4deb-b40d-a42a9bd256bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-96e3620f-0ceb-4deb-b40d-a42a9bd256bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:33.033382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:33.034319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:33.035180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 268/564] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:33.035849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db53eb-feb7-4432-ae77-37a4fb44f8b8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.036791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db53eb-feb7-4432-ae77-37a4fb44f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.036791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db53eb-feb7-4432-ae77-37a4fb44f8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.057659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c2db53eb-feb7-4432-ae77-37a4fb44f8b8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:33.059343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c2db53eb-feb7-4432-ae77-37a4fb44f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:33.115439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb563c-0f13-4806-aac1-3e45dc667e66 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:33.140482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 269/565] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:33.142032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db53eb-feb7-4432-ae77-37a4fb44f8b8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:33.156156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec912b-df26-4ffb-8180-f329e1974120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:33.156811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec912b-df26-4ffb-8180-f329e1974120 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.157096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec912b-df26-4ffb-8180-f329e1974120 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.157380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec912b-df26-4ffb-8180-f329e1974120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.170515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec912b-df26-4ffb-8180-f329e1974120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:33.172095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec912b-df26-4ffb-8180-f329e1974120 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f4ec912b-df26-4ffb-8180-f329e1974120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:33.187619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:33.189103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:33.190056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:33.190056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:33.190056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:33.190056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:33.190056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 297/566] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:33.190056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec912b-df26-4ffb-8180-f329e1974120 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:33.193909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:33.229902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:33.261938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db53eb-feb7-4432-ae77-37a4fb44f8b8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:33.296892 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb818451-5a9e-4137-ae53-572e825966ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:33.297530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb818451-5a9e-4137-ae53-572e825966ce None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.297809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb818451-5a9e-4137-ae53-572e825966ce None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.298083 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb818451-5a9e-4137-ae53-572e825966ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.301073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec912b-df26-4ffb-8180-f329e1974120 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:33.307780 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb818451-5a9e-4137-ae53-572e825966ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:33.309803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb818451-5a9e-4137-ae53-572e825966ce None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-cb818451-5a9e-4137-ae53-572e825966ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:33.323871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:33.324815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:33.326435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:33.326435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:33.326435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:33.326435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:33.326435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:33.326435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:33.326435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:33.326435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:33.326435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 270/567] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:33.326435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb818451-5a9e-4137-ae53-572e825966ce None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:33.345997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4354d-e219-48eb-afdb-b003cc41b06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:33.346775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4354d-e219-48eb-afdb-b003cc41b06b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.347104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4354d-e219-48eb-afdb-b003cc41b06b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.347714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4354d-e219-48eb-afdb-b003cc41b06b None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.348470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4354d-e219-48eb-afdb-b003cc41b06b None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:33.348781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4354d-e219-48eb-afdb-b003cc41b06b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:33.350636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4354d-e219-48eb-afdb-b003cc41b06b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:33.359770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 298/568] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:33.360622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4354d-e219-48eb-afdb-b003cc41b06b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:33.425258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:33.433231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb818451-5a9e-4137-ae53-572e825966ce None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:33.462550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4354d-e219-48eb-afdb-b003cc41b06b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:33.462720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:33.468199 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb914-7348-4b0e-9495-66cd22010347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:33.468837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb914-7348-4b0e-9495-66cd22010347 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.469121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb914-7348-4b0e-9495-66cd22010347 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.469402 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb914-7348-4b0e-9495-66cd22010347 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.479695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efb914-7348-4b0e-9495-66cd22010347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-28efb914-7348-4b0e-9495-66cd22010347 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:33.485745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:33.486719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:33.487548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 271/569] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:33.488252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb914-7348-4b0e-9495-66cd22010347 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:33.501344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff6a5c-54ae-42f9-ad6b-07c3d1d9eb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:33.501969 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff6a5c-54ae-42f9-ad6b-07c3d1d9eb5b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.502256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff6a5c-54ae-42f9-ad6b-07c3d1d9eb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.502540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff6a5c-54ae-42f9-ad6b-07c3d1d9eb5b None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.503235 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff6a5c-54ae-42f9-ad6b-07c3d1d9eb5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:33.503548 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff6a5c-54ae-42f9-ad6b-07c3d1d9eb5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:33.504952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff6a5c-54ae-42f9-ad6b-07c3d1d9eb5b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:33.520209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 299/570] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:33.521452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb9f1e-ab77-4763-8c61-a1f3a42b3243 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.521818 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb9f1e-ab77-4763-8c61-a1f3a42b3243 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.522103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb9f1e-ab77-4763-8c61-a1f3a42b3243 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.525517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 300/571] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:33.525517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb9f1e-ab77-4763-8c61-a1f3a42b3243 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:33.599954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb914-7348-4b0e-9495-66cd22010347 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:33.636743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be802a-96ec-4f30-a73a-ee34ab437a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:33.637366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be802a-96ec-4f30-a73a-ee34ab437a8c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.637648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be802a-96ec-4f30-a73a-ee34ab437a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.637952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be802a-96ec-4f30-a73a-ee34ab437a8c None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.638713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be802a-96ec-4f30-a73a-ee34ab437a8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:33.639022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be802a-96ec-4f30-a73a-ee34ab437a8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:33.640497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be802a-96ec-4f30-a73a-ee34ab437a8c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:33.642677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb9f1e-ab77-4763-8c61-a1f3a42b3243 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:33.653535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 272/572] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:33.654745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be802a-96ec-4f30-a73a-ee34ab437a8c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:33.668308 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:33.677243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a3deb-7538-4e0f-9156-51ce294817d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:33.677877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a3deb-7538-4e0f-9156-51ce294817d5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.678161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a3deb-7538-4e0f-9156-51ce294817d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.678434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a3deb-7538-4e0f-9156-51ce294817d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.689066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a3deb-7538-4e0f-9156-51ce294817d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:33.690513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a3deb-7538-4e0f-9156-51ce294817d5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-5f1a3deb-7538-4e0f-9156-51ce294817d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:33.704748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:33.705800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:33.706994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:33.706994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:33.706994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:33.706994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:33.708279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 301/573] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:33.709674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a3deb-7538-4e0f-9156-51ce294817d5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:33.712331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:33.761000 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be802a-96ec-4f30-a73a-ee34ab437a8c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:33.796601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a027ad-2894-4f46-bbd5-51fca6b13b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:33.797240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a027ad-2894-4f46-bbd5-51fca6b13b4c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.797556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a027ad-2894-4f46-bbd5-51fca6b13b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.797824 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a027ad-2894-4f46-bbd5-51fca6b13b4c None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.798558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a027ad-2894-4f46-bbd5-51fca6b13b4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:33.798888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a027ad-2894-4f46-bbd5-51fca6b13b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:33.800332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a027ad-2894-4f46-bbd5-51fca6b13b4c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:33.809715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 273/574] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:33.811100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe94c3a-b698-4186-862f-eb96bb1ba57d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.811389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe94c3a-b698-4186-862f-eb96bb1ba57d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.811668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe94c3a-b698-4186-862f-eb96bb1ba57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.814625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a3deb-7538-4e0f-9156-51ce294817d5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:33.829692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5fe94c3a-b698-4186-862f-eb96bb1ba57d None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:33.831190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5fe94c3a-b698-4186-862f-eb96bb1ba57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:33.852308 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63b1df-7db2-4622-8166-b1bb604d8206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:33.852965 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63b1df-7db2-4622-8166-b1bb604d8206 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:33.853254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63b1df-7db2-4622-8166-b1bb604d8206 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:33.853535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63b1df-7db2-4622-8166-b1bb604d8206 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:33.860522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63b1df-7db2-4622-8166-b1bb604d8206 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:33.861980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63b1df-7db2-4622-8166-b1bb604d8206 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-3f63b1df-7db2-4622-8166-b1bb604d8206 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:33.875166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:33.876317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:33.877326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:33.877326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:33.877326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:33.877326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:33.877326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:33.877326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:33.877326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:33.877326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:33.877326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 302/575] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:33.877326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63b1df-7db2-4622-8166-b1bb604d8206 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:33.909628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 274/576] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:33.910492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe94c3a-b698-4186-862f-eb96bb1ba57d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:33.921055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:33.963875 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:33.984231 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63b1df-7db2-4622-8166-b1bb604d8206 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:34.018224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6400a-5de8-4704-8601-43935dc37ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:34.018820 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6400a-5de8-4704-8601-43935dc37ded None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:34.019105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6400a-5de8-4704-8601-43935dc37ded None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:34.019239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe94c3a-b698-4186-862f-eb96bb1ba57d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:34.019386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6400a-5de8-4704-8601-43935dc37ded None admin] PATH_INFO: `/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/e1de289ba7ae4140a421127b8f18901f/roles/508a2d8d86e0445e83f4adfdbe4c1b43` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:34.033872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6400a-5de8-4704-8601-43935dc37ded None admin] RBAC: Authorizing `identity:create_grant(project_id=7e1649f32d3d494682dc06e05ae34f3d, user_id=e1de289ba7ae4140a421127b8f18901f, role_id=508a2d8d86e0445e83f4adfdbe4c1b43)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:34.035311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6400a-5de8-4704-8601-43935dc37ded None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:34.048303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 303/577] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:40:33 2022] PUT /identity/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/e1de289ba7ae4140a421127b8f18901f/roles/508a2d8d86e0445e83f4adfdbe4c1b43 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:40:34.049095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6400a-5de8-4704-8601-43935dc37ded None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:34.067091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb44f0-6142-454e-b9c5-62ead206082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:34.068164 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb44f0-6142-454e-b9c5-62ead206082b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:34.068164 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb44f0-6142-454e-b9c5-62ead206082b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:34.068449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb44f0-6142-454e-b9c5-62ead206082b None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:34.070195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb44f0-6142-454e-b9c5-62ead206082b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:34.070195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb44f0-6142-454e-b9c5-62ead206082b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:34.071105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb44f0-6142-454e-b9c5-62ead206082b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:34.089385 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 275/578] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:34.089385 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb44f0-6142-454e-b9c5-62ead206082b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:34.156759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:34.179573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6400a-5de8-4704-8601-43935dc37ded None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:34.219638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb44f0-6142-454e-b9c5-62ead206082b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:34.228033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:34.235454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb56c3-c3a7-4236-8ed8-bdea9744f3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:34.236147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb56c3-c3a7-4236-8ed8-bdea9744f3ef None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:34.238616 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb56c3-c3a7-4236-8ed8-bdea9744f3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:34.238927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb56c3-c3a7-4236-8ed8-bdea9744f3ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:34.251615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb56c3-c3a7-4236-8ed8-bdea9744f3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:34.253129 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb56c3-c3a7-4236-8ed8-bdea9744f3ef None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-d3bb56c3-c3a7-4236-8ed8-bdea9744f3ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:34.270394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:34.271488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:34.272510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:34.272510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:34.272510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:34.272510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:34.272510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 304/579] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:34.272510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb56c3-c3a7-4236-8ed8-bdea9744f3ef None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:34.274666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8eb55-266d-4173-ab0b-0b600a2cb198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:34.275394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8eb55-266d-4173-ab0b-0b600a2cb198 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:34.275920 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8eb55-266d-4173-ab0b-0b600a2cb198 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:34.281039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8eb55-266d-4173-ab0b-0b600a2cb198 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:34.281039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8eb55-266d-4173-ab0b-0b600a2cb198 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:34.281039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8eb55-266d-4173-ab0b-0b600a2cb198 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:34.281039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8eb55-266d-4173-ab0b-0b600a2cb198 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:34.296416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 276/580] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:34.297504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8eb55-266d-4173-ab0b-0b600a2cb198 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:34.391031 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb56c3-c3a7-4236-8ed8-bdea9744f3ef None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:34.408141 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8eb55-266d-4173-ab0b-0b600a2cb198 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:34.427858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bd515-2b76-4683-8afd-6839e5fc9ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:34.428668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bd515-2b76-4683-8afd-6839e5fc9ebe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:34.429025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bd515-2b76-4683-8afd-6839e5fc9ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:34.429371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bd515-2b76-4683-8afd-6839e5fc9ebe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:34.438123 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:34.442064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bd515-2b76-4683-8afd-6839e5fc9ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:34.443551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47733dff-4301-4e8d-b4ce-fca8fc5ecd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:34.444303 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47733dff-4301-4e8d-b4ce-fca8fc5ecd48 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:34.444657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47733dff-4301-4e8d-b4ce-fca8fc5ecd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:34.445003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47733dff-4301-4e8d-b4ce-fca8fc5ecd48 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-387bd515-2b76-4683-8afd-6839e5fc9ebe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:34.448084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:34.449279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:34.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:34.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:34.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:34.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:34.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:34.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:34.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:34.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:34.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:34.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:34.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:34.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:34.457360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 305/581] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:34.457360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bd515-2b76-4683-8afd-6839e5fc9ebe None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:34.457608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47733dff-4301-4e8d-b4ce-fca8fc5ecd48 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:34.458468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47733dff-4301-4e8d-b4ce-fca8fc5ecd48 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-47733dff-4301-4e8d-b4ce-fca8fc5ecd48 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:34.471572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:34.472764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:34.473928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:34.473928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:34.473928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:34.473928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:34.473928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:34.473928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:34.473928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:34.473928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:34.473928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:40:34.473928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:34.474950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 277/582] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:34.475617 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47733dff-4301-4e8d-b4ce-fca8fc5ecd48 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:34.503309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:34.573248 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bd515-2b76-4683-8afd-6839e5fc9ebe None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:34.608571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47733dff-4301-4e8d-b4ce-fca8fc5ecd48 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:34.613640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c8fb1-e808-4795-a612-be3a6c4bbdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:34.614251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8fb1-e808-4795-a612-be3a6c4bbdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:34.614532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8fb1-e808-4795-a612-be3a6c4bbdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:34.614807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8fb1-e808-4795-a612-be3a6c4bbdc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:34.615499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c8fb1-e808-4795-a612-be3a6c4bbdc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:34.615801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c8fb1-e808-4795-a612-be3a6c4bbdc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:34.617246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c8fb1-e808-4795-a612-be3a6c4bbdc6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:34.629991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 306/583] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:34.635380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c8fb1-e808-4795-a612-be3a6c4bbdc6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:34.646348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01077db2-7a7a-4478-a204-8f819256fe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:34.647220 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01077db2-7a7a-4478-a204-8f819256fe2e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:34.647650 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01077db2-7a7a-4478-a204-8f819256fe2e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:34.648071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01077db2-7a7a-4478-a204-8f819256fe2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:34.649605 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01077db2-7a7a-4478-a204-8f819256fe2e None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=d182c7050f0040559f69a231bee6dccf) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:34.650081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01077db2-7a7a-4478-a204-8f819256fe2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:34.651645 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01077db2-7a7a-4478-a204-8f819256fe2e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:34.658310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 278/584] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:34 2022] GET /identity/v3/role_assignments?user.id=d182c7050f0040559f69a231bee6dccf&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:34.659530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01077db2-7a7a-4478-a204-8f819256fe2e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:34.711682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:34.773025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c8fb1-e808-4795-a612-be3a6c4bbdc6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:34.788430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:34.804353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01077db2-7a7a-4478-a204-8f819256fe2e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:34.817950 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc2f48-be41-457d-a5f4-804906b78b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:34.818904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc2f48-be41-457d-a5f4-804906b78b67 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:34.819353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc2f48-be41-457d-a5f4-804906b78b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:34.819776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc2f48-be41-457d-a5f4-804906b78b67 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:34.820848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc2f48-be41-457d-a5f4-804906b78b67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:34.821304 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc2f48-be41-457d-a5f4-804906b78b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:34.822837 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc2f48-be41-457d-a5f4-804906b78b67 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:34.832867 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 307/585] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:34.834182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc2f48-be41-457d-a5f4-804906b78b67 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:34.849800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d9ee9-d812-4af6-8331-617b1f7c6462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:34.850432 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d9ee9-d812-4af6-8331-617b1f7c6462 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:34.850721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d9ee9-d812-4af6-8331-617b1f7c6462 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:34.850995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d9ee9-d812-4af6-8331-617b1f7c6462 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:34.852502 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d9ee9-d812-4af6-8331-617b1f7c6462 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:34.852810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d9ee9-d812-4af6-8331-617b1f7c6462 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:34.854429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d9ee9-d812-4af6-8331-617b1f7c6462 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:34.877954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 279/586] 10.222.0.17 () {56 vars in 1137 bytes} [Tue Aug 2 08:40:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:34.878977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d9ee9-d812-4af6-8331-617b1f7c6462 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:34.963734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc2f48-be41-457d-a5f4-804906b78b67 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:34.994321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:34.995165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d9ee9-d812-4af6-8331-617b1f7c6462 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:35.012530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b7d41-8f91-42a6-9666-30ed6d36ff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:35.013711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b7d41-8f91-42a6-9666-30ed6d36ff2f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:35.014563 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b7d41-8f91-42a6-9666-30ed6d36ff2f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:35.015024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b7d41-8f91-42a6-9666-30ed6d36ff2f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:35.028349 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b7d41-8f91-42a6-9666-30ed6d36ff2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:35.030208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b7d41-8f91-42a6-9666-30ed6d36ff2f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:35.031923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762d4a-2057-4d27-9b3b-771034357801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:35.032696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762d4a-2057-4d27-9b3b-771034357801 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:35.033009 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762d4a-2057-4d27-9b3b-771034357801 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:35.033292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762d4a-2057-4d27-9b3b-771034357801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:35.046765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762d4a-2057-4d27-9b3b-771034357801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7a0b7d41-8f91-42a6-9666-30ed6d36ff2f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:35.047382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:35.048312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:35.049253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:35.049253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:35.049253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:35.049253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:35.049253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:35.049253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:35.049253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:35.049253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:35.049253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:40:35.049253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:35.049811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762d4a-2057-4d27-9b3b-771034357801 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:35.052216 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 308/587] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:35.053184 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b7d41-8f91-42a6-9666-30ed6d36ff2f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:35.057719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-aa762d4a-2057-4d27-9b3b-771034357801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:35.067121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:35.068363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:35.069495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:35.069495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:35.069495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:35.069495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:35.071338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 280/588] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:35.072545 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762d4a-2057-4d27-9b3b-771034357801 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:35.171645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b7d41-8f91-42a6-9666-30ed6d36ff2f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:35.184790 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762d4a-2057-4d27-9b3b-771034357801 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:35.209767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64ffdb-21e3-4390-a4dd-84f3ce53d339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:35.210666 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ffdb-21e3-4390-a4dd-84f3ce53d339 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:35.211648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ffdb-21e3-4390-a4dd-84f3ce53d339 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:35.212169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ffdb-21e3-4390-a4dd-84f3ce53d339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:35.224107 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64ffdb-21e3-4390-a4dd-84f3ce53d339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:35.224447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeec706-452d-4bee-bebd-de52794050a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:35.225200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeec706-452d-4bee-bebd-de52794050a4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:35.225584 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeec706-452d-4bee-bebd-de52794050a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:35.225962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeec706-452d-4bee-bebd-de52794050a4 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:35.227373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64ffdb-21e3-4390-a4dd-84f3ce53d339 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:35.227500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeec706-452d-4bee-bebd-de52794050a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:35.227886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeec706-452d-4bee-bebd-de52794050a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:35.229459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeec706-452d-4bee-bebd-de52794050a4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ff64ffdb-21e3-4390-a4dd-84f3ce53d339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:35.243854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:35.244975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:35.246076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:35.246076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:35.246076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:35.246076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:35.252929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 309/589] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:35.254869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64ffdb-21e3-4390-a4dd-84f3ce53d339 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:35.259588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 281/590] 10.222.0.17 () {56 vars in 1137 bytes} [Tue Aug 2 08:40:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:35.260654 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeec706-452d-4bee-bebd-de52794050a4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:35.296009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:35.323922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:35.374050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64ffdb-21e3-4390-a4dd-84f3ce53d339 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:35.374283 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeec706-452d-4bee-bebd-de52794050a4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:35.410838 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec6090-2fbe-4193-a401-fd26868ca6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:35.411340 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47daea08-f902-436f-b4eb-fdba06dee728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:35.411913 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec6090-2fbe-4193-a401-fd26868ca6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:35.412190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daea08-f902-436f-b4eb-fdba06dee728 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:35.412556 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec6090-2fbe-4193-a401-fd26868ca6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:35.412679 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daea08-f902-436f-b4eb-fdba06dee728 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:35.413031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daea08-f902-436f-b4eb-fdba06dee728 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:35.413245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec6090-2fbe-4193-a401-fd26868ca6c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:35.413927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47daea08-f902-436f-b4eb-fdba06dee728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:35.414805 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec6090-2fbe-4193-a401-fd26868ca6c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:35.414941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47daea08-f902-436f-b4eb-fdba06dee728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:35.415455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec6090-2fbe-4193-a401-fd26868ca6c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:35.416479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47daea08-f902-436f-b4eb-fdba06dee728 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:35.417181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec6090-2fbe-4193-a401-fd26868ca6c8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:35.429159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 282/591] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:35.430710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47daea08-f902-436f-b4eb-fdba06dee728 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:35.431430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 310/592] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:35.437290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec6090-2fbe-4193-a401-fd26868ca6c8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:35.543776 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47daea08-f902-436f-b4eb-fdba06dee728 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:35.544584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:35.552736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec6090-2fbe-4193-a401-fd26868ca6c8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:35.564788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:35.586809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ea371-b59f-42be-8b54-271176b5187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:35.587696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ea371-b59f-42be-8b54-271176b5187b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:35.588070 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ea371-b59f-42be-8b54-271176b5187b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:35.588495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ea371-b59f-42be-8b54-271176b5187b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:35.593933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420a226-34cd-4a61-ab5f-b12049be616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:35.594819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420a226-34cd-4a61-ab5f-b12049be616c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:35.595256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420a226-34cd-4a61-ab5f-b12049be616c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:35.595687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420a226-34cd-4a61-ab5f-b12049be616c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:35.600656 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ea371-b59f-42be-8b54-271176b5187b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:35.602270 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ea371-b59f-42be-8b54-271176b5187b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:35.604087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420a226-34cd-4a61-ab5f-b12049be616c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:35.605889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420a226-34cd-4a61-ab5f-b12049be616c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-fa7ea371-b59f-42be-8b54-271176b5187b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:35.626692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:35.627991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:35.629792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:35.629792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:35.629792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:35.629792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:35.630762 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 283/593] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:35.631846 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ea371-b59f-42be-8b54-271176b5187b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6420a226-34cd-4a61-ab5f-b12049be616c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:35.635359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:35.636586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:35.638219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:35.638219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:35.638219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:35.638219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:35.638219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:35.638219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:35.638219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:35.638219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:35.638219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:40:35.638219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:35.640919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 311/594] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:35.641954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420a226-34cd-4a61-ab5f-b12049be616c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:35.746691 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ea371-b59f-42be-8b54-271176b5187b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:35.752709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420a226-34cd-4a61-ab5f-b12049be616c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:35.784901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38039c76-ace7-4f78-a1e6-09df6e07fea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:35.785785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38039c76-ace7-4f78-a1e6-09df6e07fea9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:35.786174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38039c76-ace7-4f78-a1e6-09df6e07fea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:35.786621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38039c76-ace7-4f78-a1e6-09df6e07fea9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:35.791095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b454f6-f232-4964-b0cf-0d91fac7c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:35.791981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b454f6-f232-4964-b0cf-0d91fac7c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:35.792455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b454f6-f232-4964-b0cf-0d91fac7c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:35.792891 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b454f6-f232-4964-b0cf-0d91fac7c3a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:35.793743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b454f6-f232-4964-b0cf-0d91fac7c3a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:35.794209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b454f6-f232-4964-b0cf-0d91fac7c3a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:35.794818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38039c76-ace7-4f78-a1e6-09df6e07fea9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:35.795996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b454f6-f232-4964-b0cf-0d91fac7c3a6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:35.796510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38039c76-ace7-4f78-a1e6-09df6e07fea9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-38039c76-ace7-4f78-a1e6-09df6e07fea9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:35.810492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:35.811587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:35.812710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:35.812710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:35.812710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:35.812710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:35.812710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:35.812710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:35.812710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:35.812710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:35.814142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 312/595] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:35.818935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 284/596] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:35.819092 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b454f6-f232-4964-b0cf-0d91fac7c3a6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:35.820409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38039c76-ace7-4f78-a1e6-09df6e07fea9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:35.836874 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:35.854556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:35.938921 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b454f6-f232-4964-b0cf-0d91fac7c3a6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:35.939564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38039c76-ace7-4f78-a1e6-09df6e07fea9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:35.976456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc4c9a-d448-4f3b-a220-bd0205d2b909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:35.977907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4c9a-d448-4f3b-a220-bd0205d2b909 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:35.978189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4c9a-d448-4f3b-a220-bd0205d2b909 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:35.978460 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4c9a-d448-4f3b-a220-bd0205d2b909 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:35.978821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ebeb6-ca26-4e2c-ab67-df1f5d9e346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:35.979258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc4c9a-d448-4f3b-a220-bd0205d2b909 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:35.979566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc4c9a-d448-4f3b-a220-bd0205d2b909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:35.980160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ebeb6-ca26-4e2c-ab67-df1f5d9e346c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:35.980650 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ebeb6-ca26-4e2c-ab67-df1f5d9e346c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:35.981131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc4c9a-d448-4f3b-a220-bd0205d2b909 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:35.981447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ebeb6-ca26-4e2c-ab67-df1f5d9e346c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:35.990632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ebeb6-ca26-4e2c-ab67-df1f5d9e346c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:35.992930 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ebeb6-ca26-4e2c-ab67-df1f5d9e346c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:36.000866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 313/597] 10.222.0.17 () {56 vars in 1139 bytes} [Tue Aug 2 08:40:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:36.001655 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc4c9a-d448-4f3b-a220-bd0205d2b909 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-696ebeb6-ca26-4e2c-ab67-df1f5d9e346c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:36.006796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:36.007672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:36.008632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:36.008632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:36.008632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:36.008632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:36.008632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:36.008632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:36.008632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:36.008632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:36.010684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 285/598] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:40:36.011756 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ebeb6-ca26-4e2c-ab67-df1f5d9e346c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:36.077125 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:36.110677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc4c9a-d448-4f3b-a220-bd0205d2b909 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:36.111355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:36.127320 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ebeb6-ca26-4e2c-ab67-df1f5d9e346c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:36.150821 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1d109-a2fe-4f91-868d-3e6230d50ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:36.151443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1d109-a2fe-4f91-868d-3e6230d50ebd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:36.151725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1d109-a2fe-4f91-868d-3e6230d50ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:36.151999 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1d109-a2fe-4f91-868d-3e6230d50ebd None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:36.152793 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1d109-a2fe-4f91-868d-3e6230d50ebd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:36.153430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1d109-a2fe-4f91-868d-3e6230d50ebd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:36.154522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1d109-a2fe-4f91-868d-3e6230d50ebd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:36.166279 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733beb-865c-4e46-9179-e857cfc2de6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:36.166881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 314/599] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:36.167031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733beb-865c-4e46-9179-e857cfc2de6d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:36.167376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733beb-865c-4e46-9179-e857cfc2de6d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:36.167737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733beb-865c-4e46-9179-e857cfc2de6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:36.172326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1d109-a2fe-4f91-868d-3e6230d50ebd None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:36.179182 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733beb-865c-4e46-9179-e857cfc2de6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:36.181307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733beb-865c-4e46-9179-e857cfc2de6d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-65733beb-865c-4e46-9179-e857cfc2de6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:36.197851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:36.198821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:36.199960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:36.199960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:36.199960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:36.199960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:36.203640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 286/600] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:36.204944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba73686-47f9-4001-a069-d56005968684 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:36.205235 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba73686-47f9-4001-a069-d56005968684 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:36.205516 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba73686-47f9-4001-a069-d56005968684 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:36.207024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 287/601] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:36.207713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba73686-47f9-4001-a069-d56005968684 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:36.289937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1d109-a2fe-4f91-868d-3e6230d50ebd None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:36.318761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba73686-47f9-4001-a069-d56005968684 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:36.323158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:36.329532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2c6ad-93d9-4d30-85be-abc6293fedf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:36.330196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2c6ad-93d9-4d30-85be-abc6293fedf1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:36.330499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2c6ad-93d9-4d30-85be-abc6293fedf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:36.330759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2c6ad-93d9-4d30-85be-abc6293fedf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:36.331496 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2c6ad-93d9-4d30-85be-abc6293fedf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:36.331806 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2c6ad-93d9-4d30-85be-abc6293fedf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:36.333367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2c6ad-93d9-4d30-85be-abc6293fedf1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:36.352595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 315/602] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:36.353499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2c6ad-93d9-4d30-85be-abc6293fedf1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:36.359236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d74ac-e3d3-4609-96e7-0cbf4846b082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:36.359986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d74ac-e3d3-4609-96e7-0cbf4846b082 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:36.360374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d74ac-e3d3-4609-96e7-0cbf4846b082 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:36.360722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d74ac-e3d3-4609-96e7-0cbf4846b082 None admin] PATH_INFO: `/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/b2c5059aacc149deb6cdb86d3341e78b/roles/508a2d8d86e0445e83f4adfdbe4c1b43` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:36.372397 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:36.377381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d74ac-e3d3-4609-96e7-0cbf4846b082 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e1649f32d3d494682dc06e05ae34f3d, user_id=b2c5059aacc149deb6cdb86d3341e78b, role_id=508a2d8d86e0445e83f4adfdbe4c1b43)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:36.379263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d74ac-e3d3-4609-96e7-0cbf4846b082 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:36.400152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 288/603] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:40:36 2022] PUT /identity/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/b2c5059aacc149deb6cdb86d3341e78b/roles/508a2d8d86e0445e83f4adfdbe4c1b43 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:40:36.400152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a6e45-a412-42ec-bc9e-b99ca0f684f8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:36.400152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a6e45-a412-42ec-bc9e-b99ca0f684f8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:36.400152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a6e45-a412-42ec-bc9e-b99ca0f684f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:36.424861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-609a6e45-a412-42ec-bc9e-b99ca0f684f8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:36.426768 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-609a6e45-a412-42ec-bc9e-b99ca0f684f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:36.504992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2c6ad-93d9-4d30-85be-abc6293fedf1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:36.591482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 289/604] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:36.593108 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a6e45-a412-42ec-bc9e-b99ca0f684f8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:36.605429 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7593a4-c9e4-4336-8aa4-f364178acef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:36.606074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7593a4-c9e4-4336-8aa4-f364178acef7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:36.606365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7593a4-c9e4-4336-8aa4-f364178acef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:36.606648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7593a4-c9e4-4336-8aa4-f364178acef7 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:36.607358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7593a4-c9e4-4336-8aa4-f364178acef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:36.607670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7593a4-c9e4-4336-8aa4-f364178acef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:36.609091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7593a4-c9e4-4336-8aa4-f364178acef7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:36.635785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 316/605] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:36.636842 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7593a4-c9e4-4336-8aa4-f364178acef7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:36.710314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:36.783232 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a6e45-a412-42ec-bc9e-b99ca0f684f8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:36.796250 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7593a4-c9e4-4336-8aa4-f364178acef7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:36.825312 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:36.847269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232bd58-e0b3-4427-9348-ad5b89812fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:36.847878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232bd58-e0b3-4427-9348-ad5b89812fdb None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:36.848714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232bd58-e0b3-4427-9348-ad5b89812fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:36.848714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232bd58-e0b3-4427-9348-ad5b89812fdb None admin] PATH_INFO: `/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/27e0b08a946b43f08028c5da415d4e8c/roles/508a2d8d86e0445e83f4adfdbe4c1b43` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:36.856738 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7803ceb-d640-497a-9e44-2996b33ef3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:36.857401 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7803ceb-d640-497a-9e44-2996b33ef3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:36.858014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7803ceb-d640-497a-9e44-2996b33ef3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:36.858598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7803ceb-d640-497a-9e44-2996b33ef3a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:36.866787 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232bd58-e0b3-4427-9348-ad5b89812fdb None admin] RBAC: Authorizing `identity:create_grant(project_id=7e1649f32d3d494682dc06e05ae34f3d, user_id=27e0b08a946b43f08028c5da415d4e8c, role_id=508a2d8d86e0445e83f4adfdbe4c1b43)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:36.869230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232bd58-e0b3-4427-9348-ad5b89812fdb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:36.874347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7803ceb-d640-497a-9e44-2996b33ef3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f7803ceb-d640-497a-9e44-2996b33ef3a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:36.885242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:36.886172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:36.887016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 317/606] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:36.888332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7803ceb-d640-497a-9e44-2996b33ef3a1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:36.896321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 290/607] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:40:36 2022] PUT /identity/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/27e0b08a946b43f08028c5da415d4e8c/roles/508a2d8d86e0445e83f4adfdbe4c1b43 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:40:36.897347 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b756b0f-f52d-4167-b815-5b408dcbd69d None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:36.897634 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b756b0f-f52d-4167-b815-5b408dcbd69d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:36.897911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b756b0f-f52d-4167-b815-5b408dcbd69d None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:36.907052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 291/608] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:36.907052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b756b0f-f52d-4167-b815-5b408dcbd69d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:37.041400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7803ceb-d640-497a-9e44-2996b33ef3a1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:37.048553 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b756b0f-f52d-4167-b815-5b408dcbd69d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:37.059495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:37.087622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e5532-94bd-475a-a76b-6523e42a0122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:37.088316 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e5532-94bd-475a-a76b-6523e42a0122 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:37.088603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e5532-94bd-475a-a76b-6523e42a0122 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:37.088876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e5532-94bd-475a-a76b-6523e42a0122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:37.095913 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76941f-6814-4594-8dd0-038896282adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:37.096474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e5532-94bd-475a-a76b-6523e42a0122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:37.097046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76941f-6814-4594-8dd0-038896282adb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:37.097536 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76941f-6814-4594-8dd0-038896282adb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:37.097965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76941f-6814-4594-8dd0-038896282adb None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:37.098080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e5532-94bd-475a-a76b-6523e42a0122 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:37.098947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76941f-6814-4594-8dd0-038896282adb None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:37.099418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76941f-6814-4594-8dd0-038896282adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:37.100936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76941f-6814-4594-8dd0-038896282adb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b54e5532-94bd-475a-a76b-6523e42a0122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:37.112057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:37.113037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:37.113912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:37.113912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:37.113912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:37.113912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:37.113912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:37.113912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:37.113912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:37.113912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:37.114352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 292/609] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:37.114424 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 318/610] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:37.114490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb29e02-7bf4-4f54-9671-90bd5cee953b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:37.114490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb29e02-7bf4-4f54-9671-90bd5cee953b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:37.114630 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb29e02-7bf4-4f54-9671-90bd5cee953b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:37.120048 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e5532-94bd-475a-a76b-6523e42a0122 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:37.136348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1bb29e02-7bf4-4f54-9671-90bd5cee953b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:37.137579 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1bb29e02-7bf4-4f54-9671-90bd5cee953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:37.164466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:37.228144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 293/611] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:37.228144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb29e02-7bf4-4f54-9671-90bd5cee953b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:37.245048 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e5532-94bd-475a-a76b-6523e42a0122 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:37.293915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6fc78-3479-4d93-b935-98fb02968557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:37.294843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6fc78-3479-4d93-b935-98fb02968557 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:37.295151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6fc78-3479-4d93-b935-98fb02968557 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:37.295869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6fc78-3479-4d93-b935-98fb02968557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:37.311540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6fc78-3479-4d93-b935-98fb02968557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:37.313602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6fc78-3479-4d93-b935-98fb02968557 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6fa6fc78-3479-4d93-b935-98fb02968557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:37.335246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:37.336312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:37.337372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:37.337372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:37.337372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:37.337372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:37.337372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 319/612] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:37.337651 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6fc78-3479-4d93-b935-98fb02968557 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:37.348232 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb29e02-7bf4-4f54-9671-90bd5cee953b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:37.370510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:37.396596 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2056d-9515-411c-a4bc-02ebf8dde17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:37.397475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2056d-9515-411c-a4bc-02ebf8dde17e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:37.397766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2056d-9515-411c-a4bc-02ebf8dde17e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:37.398042 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2056d-9515-411c-a4bc-02ebf8dde17e None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:37.399274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2056d-9515-411c-a4bc-02ebf8dde17e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:37.399590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2056d-9515-411c-a4bc-02ebf8dde17e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:37.401072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2056d-9515-411c-a4bc-02ebf8dde17e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:37.417522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 294/613] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:37.418628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2056d-9515-411c-a4bc-02ebf8dde17e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:37.454951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:37.463005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6fc78-3479-4d93-b935-98fb02968557 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:37.502453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cc32c-a268-43b2-ab21-8ea5200d0cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:37.503107 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cc32c-a268-43b2-ab21-8ea5200d0cda None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:37.503579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cc32c-a268-43b2-ab21-8ea5200d0cda None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:37.503964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cc32c-a268-43b2-ab21-8ea5200d0cda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:37.516500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cc32c-a268-43b2-ab21-8ea5200d0cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-811cc32c-a268-43b2-ab21-8ea5200d0cda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:37.521922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:37.523110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:37.524109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 320/614] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:37.524977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cc32c-a268-43b2-ab21-8ea5200d0cda None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:37.563825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2056d-9515-411c-a4bc-02ebf8dde17e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:37.609525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2a728-78fd-45bd-9eb0-23620e52ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:37.610969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2a728-78fd-45bd-9eb0-23620e52ffd1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:37.611405 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2a728-78fd-45bd-9eb0-23620e52ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:37.611847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2a728-78fd-45bd-9eb0-23620e52ffd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:37.613193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2a728-78fd-45bd-9eb0-23620e52ffd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:37.613659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2a728-78fd-45bd-9eb0-23620e52ffd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:37.615876 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2a728-78fd-45bd-9eb0-23620e52ffd1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:37.621011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:37.635127 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 295/615] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:37.636390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2a728-78fd-45bd-9eb0-23620e52ffd1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:37.639905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cc32c-a268-43b2-ab21-8ea5200d0cda None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:37.685944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf348-afed-4115-a0ca-d98e35061639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:37.686939 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf348-afed-4115-a0ca-d98e35061639 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:37.687432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf348-afed-4115-a0ca-d98e35061639 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:37.687882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf348-afed-4115-a0ca-d98e35061639 None admin] PATH_INFO: `/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/c9162dcfb8d542679c7217fae8f5c185/roles/508a2d8d86e0445e83f4adfdbe4c1b43` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:37.710513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecf348-afed-4115-a0ca-d98e35061639 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e1649f32d3d494682dc06e05ae34f3d, user_id=c9162dcfb8d542679c7217fae8f5c185, role_id=508a2d8d86e0445e83f4adfdbe4c1b43)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:37.713295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecf348-afed-4115-a0ca-d98e35061639 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:37.738717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 321/616] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:40:37 2022] PUT /identity/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/c9162dcfb8d542679c7217fae8f5c185/roles/508a2d8d86e0445e83f4adfdbe4c1b43 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:40:37.740635 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:37.741855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf348-afed-4115-a0ca-d98e35061639 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:37.764398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2a728-78fd-45bd-9eb0-23620e52ffd1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:37.817113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420571a-f662-46f6-b586-938a49bbcc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:37.817739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420571a-f662-46f6-b586-938a49bbcc0c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:37.818017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420571a-f662-46f6-b586-938a49bbcc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:37.818423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420571a-f662-46f6-b586-938a49bbcc0c None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:37.819072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420571a-f662-46f6-b586-938a49bbcc0c None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:37.819428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420571a-f662-46f6-b586-938a49bbcc0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:37.821042 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420571a-f662-46f6-b586-938a49bbcc0c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:37.830405 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 296/617] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:37.837076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420571a-f662-46f6-b586-938a49bbcc0c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:37.902157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf348-afed-4115-a0ca-d98e35061639 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:37.974711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d3004-0ec5-43da-a7a2-869972fd2d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:37.975630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d3004-0ec5-43da-a7a2-869972fd2d18 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:37.976341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d3004-0ec5-43da-a7a2-869972fd2d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:37.977332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d3004-0ec5-43da-a7a2-869972fd2d18 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:37.981222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:37.990509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d3004-0ec5-43da-a7a2-869972fd2d18 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:37.992775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d3004-0ec5-43da-a7a2-869972fd2d18 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-649d3004-0ec5-43da-a7a2-869972fd2d18 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:38.012804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:38.014119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:38.015314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:38.015314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:38.015314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:38.015314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:38.015314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:38.015314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:38.015314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:38.015314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:38.015314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:40:38.015314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:38.017849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 322/618] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Aug 2 08:40:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:38.018356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420571a-f662-46f6-b586-938a49bbcc0c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:38.025877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d3004-0ec5-43da-a7a2-869972fd2d18 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:38.076916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c980662-4f2e-40da-b5a2-724647d4c5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:38.077911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c980662-4f2e-40da-b5a2-724647d4c5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:38.078436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c980662-4f2e-40da-b5a2-724647d4c5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:38.078887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c980662-4f2e-40da-b5a2-724647d4c5f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:38.091573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c980662-4f2e-40da-b5a2-724647d4c5f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:38.093379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c980662-4f2e-40da-b5a2-724647d4c5f6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:38.100964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-2c980662-4f2e-40da-b5a2-724647d4c5f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:38.122883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:38.123807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:38.124861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:38.124861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:38.124861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:38.124861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:38.127238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 297/619] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:38.142173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d3004-0ec5-43da-a7a2-869972fd2d18 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:38.144325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c980662-4f2e-40da-b5a2-724647d4c5f6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:38.179415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa576a86-b523-4dba-9bdd-331df7de9529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:38.180094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa576a86-b523-4dba-9bdd-331df7de9529 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:38.180470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa576a86-b523-4dba-9bdd-331df7de9529 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:38.180813 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa576a86-b523-4dba-9bdd-331df7de9529 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:38.181678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa576a86-b523-4dba-9bdd-331df7de9529 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:38.182052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa576a86-b523-4dba-9bdd-331df7de9529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:38.183589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa576a86-b523-4dba-9bdd-331df7de9529 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:38.209848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 323/620] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Aug 2 08:40:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:38.217239 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa576a86-b523-4dba-9bdd-331df7de9529 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:38.294187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c980662-4f2e-40da-b5a2-724647d4c5f6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:38.301807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:38.344488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a33c45-e5c4-4b82-ae8b-838d3de1d170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:38.345761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a33c45-e5c4-4b82-ae8b-838d3de1d170 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:38.346046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a33c45-e5c4-4b82-ae8b-838d3de1d170 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:38.346320 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a33c45-e5c4-4b82-ae8b-838d3de1d170 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:38.347018 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a33c45-e5c4-4b82-ae8b-838d3de1d170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:38.347322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a33c45-e5c4-4b82-ae8b-838d3de1d170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:38.348722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a33c45-e5c4-4b82-ae8b-838d3de1d170 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:38.362952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 298/621] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:38.368782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a33c45-e5c4-4b82-ae8b-838d3de1d170 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:38.381390 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa576a86-b523-4dba-9bdd-331df7de9529 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:38.441953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70336ad4-3c33-4cec-95bd-a6d45a69ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:38.442504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70336ad4-3c33-4cec-95bd-a6d45a69ab1f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:38.442792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70336ad4-3c33-4cec-95bd-a6d45a69ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:38.443074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70336ad4-3c33-4cec-95bd-a6d45a69ab1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:38.459436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:38.543099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a33c45-e5c4-4b82-ae8b-838d3de1d170 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:38.585699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d4348-5aa2-4213-b09a-94b9252bbe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:38.586411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d4348-5aa2-4213-b09a-94b9252bbe16 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:38.586699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d4348-5aa2-4213-b09a-94b9252bbe16 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:38.589427 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d4348-5aa2-4213-b09a-94b9252bbe16 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:38.602798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70336ad4-3c33-4cec-95bd-a6d45a69ab1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:38.604308 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70336ad4-3c33-4cec-95bd-a6d45a69ab1f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:38.607214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d4348-5aa2-4213-b09a-94b9252bbe16 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:38.608704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d4348-5aa2-4213-b09a-94b9252bbe16 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-4e0d4348-5aa2-4213-b09a-94b9252bbe16 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:38.635358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:38.636388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:38.637935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:38.637935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:38.637935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:38.637935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:38.637935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:38.637935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:38.637935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:38.637935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:38.637935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:40:38.637935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:38.637935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 299/622] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:38.642192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d4348-5aa2-4213-b09a-94b9252bbe16 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:38.695308 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:38.751500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 324/623] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:38.752888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494abb6-208e-43a4-b0d6-5147f691c6cf None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:38.753178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494abb6-208e-43a4-b0d6-5147f691c6cf None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:38.753448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494abb6-208e-43a4-b0d6-5147f691c6cf None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:38.754934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 325/624] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:38.756688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494abb6-208e-43a4-b0d6-5147f691c6cf None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:38.792200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d4348-5aa2-4213-b09a-94b9252bbe16 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:38.813805 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:38.829374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a4bd2-8e8b-42ed-9bbb-684dc12abbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:38.830002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a4bd2-8e8b-42ed-9bbb-684dc12abbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:38.830288 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a4bd2-8e8b-42ed-9bbb-684dc12abbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:38.830566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a4bd2-8e8b-42ed-9bbb-684dc12abbf3 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:38.831370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a4bd2-8e8b-42ed-9bbb-684dc12abbf3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:38.831682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a4bd2-8e8b-42ed-9bbb-684dc12abbf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:38.833240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a4bd2-8e8b-42ed-9bbb-684dc12abbf3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:38.856414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 300/625] 10.222.0.17 () {56 vars in 1135 bytes} [Tue Aug 2 08:40:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:38.857800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ab94e-3c17-4784-9747-67f3ff0a3720 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:38.858102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ab94e-3c17-4784-9747-67f3ff0a3720 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:38.858383 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ab94e-3c17-4784-9747-67f3ff0a3720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:38.877861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-356ab94e-3c17-4784-9747-67f3ff0a3720 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:38.879121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-356ab94e-3c17-4784-9747-67f3ff0a3720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:38.886170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494abb6-208e-43a4-b0d6-5147f691c6cf None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:38.924334 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3b310-30ad-4cf1-9da1-5c76c070ca78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:38.925316 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3b310-30ad-4cf1-9da1-5c76c070ca78 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:38.925771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3b310-30ad-4cf1-9da1-5c76c070ca78 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:38.926196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3b310-30ad-4cf1-9da1-5c76c070ca78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:38.938165 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3b310-30ad-4cf1-9da1-5c76c070ca78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:38.939895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3b310-30ad-4cf1-9da1-5c76c070ca78 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-5df3b310-30ad-4cf1-9da1-5c76c070ca78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:38.957894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:38.959385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:38.960400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:38.960400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:38.960400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:38.960400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:38.962198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 301/627] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:38.966954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 326/627] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:38.968181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3b310-30ad-4cf1-9da1-5c76c070ca78 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:38.968305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ab94e-3c17-4784-9747-67f3ff0a3720 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:38.972339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:39.096109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3b310-30ad-4cf1-9da1-5c76c070ca78 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:39.100523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ab94e-3c17-4784-9747-67f3ff0a3720 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:39.103492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:39.139735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68941603-a0f6-4c2c-9214-883253c5f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:39.139983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae23520-92d2-4331-ab2d-8ac7aa4672e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:39.140579 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae23520-92d2-4331-ab2d-8ac7aa4672e6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:39.140860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae23520-92d2-4331-ab2d-8ac7aa4672e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:39.141138 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae23520-92d2-4331-ab2d-8ac7aa4672e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:39.141382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68941603-a0f6-4c2c-9214-883253c5f248 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:39.141841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68941603-a0f6-4c2c-9214-883253c5f248 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:39.142281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68941603-a0f6-4c2c-9214-883253c5f248 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:39.143643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68941603-a0f6-4c2c-9214-883253c5f248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:39.144205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68941603-a0f6-4c2c-9214-883253c5f248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:39.145747 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68941603-a0f6-4c2c-9214-883253c5f248 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:39.151833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae23520-92d2-4331-ab2d-8ac7aa4672e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:39.153329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae23520-92d2-4331-ab2d-8ac7aa4672e6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:39.164543 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 327/628] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:39.165654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68941603-a0f6-4c2c-9214-883253c5f248 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-3ae23520-92d2-4331-ab2d-8ac7aa4672e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:39.169351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:39.170250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:39.171129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:39.171129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:39.171129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:39.171129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:39.171129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 302/629] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:39.171603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae23520-92d2-4331-ab2d-8ac7aa4672e6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:39.237728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:39.280422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae23520-92d2-4331-ab2d-8ac7aa4672e6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:39.281615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68941603-a0f6-4c2c-9214-883253c5f248 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:39.318378 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b217734-0488-4d19-ba66-93b75c86dfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:39.318699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570df81b-484d-4bbd-ae47-6801bbfbdc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:39.319024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b217734-0488-4d19-ba66-93b75c86dfec None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:39.319307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b217734-0488-4d19-ba66-93b75c86dfec None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:39.319569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df81b-484d-4bbd-ae47-6801bbfbdc0e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:39.319667 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b217734-0488-4d19-ba66-93b75c86dfec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:39.320041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df81b-484d-4bbd-ae47-6801bbfbdc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:39.320457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df81b-484d-4bbd-ae47-6801bbfbdc0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:39.330084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b217734-0488-4d19-ba66-93b75c86dfec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:39.330201 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570df81b-484d-4bbd-ae47-6801bbfbdc0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:39.332881 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570df81b-484d-4bbd-ae47-6801bbfbdc0e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6b217734-0488-4d19-ba66-93b75c86dfec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:39.335668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:39.337352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:39.338159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:39.338159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:39.338159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:39.338159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:39.338159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:39.338159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:39.338159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:39.338159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:39.338159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:39.338159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:39.338159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:39.338159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:39.340475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 328/630] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:39.342142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b217734-0488-4d19-ba66-93b75c86dfec None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-570df81b-484d-4bbd-ae47-6801bbfbdc0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:39.353571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:39.355116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:39.356084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:39.356084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:39.356084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:39.356084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:39.356084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:39.356084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:39.356084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:39.356084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:39.356084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 303/631] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:39.356642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d690b3-4529-4616-98da-9cbe5d60de4c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:39.356977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d690b3-4529-4616-98da-9cbe5d60de4c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:39.357267 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d690b3-4529-4616-98da-9cbe5d60de4c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:39.362892 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 304/632] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:39.362892 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d690b3-4529-4616-98da-9cbe5d60de4c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:39.380971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:39.457227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b217734-0488-4d19-ba66-93b75c86dfec None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:39.475066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d690b3-4529-4616-98da-9cbe5d60de4c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:39.482521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:39.498746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56859030-4b6f-46bf-8f57-7b462e888650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:39.499713 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56859030-4b6f-46bf-8f57-7b462e888650 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:39.499995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56859030-4b6f-46bf-8f57-7b462e888650 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:39.500451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56859030-4b6f-46bf-8f57-7b462e888650 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:39.501279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56859030-4b6f-46bf-8f57-7b462e888650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:39.501637 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56859030-4b6f-46bf-8f57-7b462e888650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:39.503761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56859030-4b6f-46bf-8f57-7b462e888650 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:39.513313 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca6ac0-a572-483f-8575-148ddd13ba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:39.513989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca6ac0-a572-483f-8575-148ddd13ba02 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:39.514279 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca6ac0-a572-483f-8575-148ddd13ba02 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:39.514559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca6ac0-a572-483f-8575-148ddd13ba02 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:39.515276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca6ac0-a572-483f-8575-148ddd13ba02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:39.515592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca6ac0-a572-483f-8575-148ddd13ba02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:39.516985 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca6ac0-a572-483f-8575-148ddd13ba02 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:39.522256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 329/633] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:39.522256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56859030-4b6f-46bf-8f57-7b462e888650 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:39.534595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 305/634] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:39.534595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ed4cb-c5c3-444b-b399-86b2e1a34175 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:39.534595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ed4cb-c5c3-444b-b399-86b2e1a34175 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:39.534595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ed4cb-c5c3-444b-b399-86b2e1a34175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:39.554238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6d9ed4cb-c5c3-444b-b399-86b2e1a34175 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:39.555478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6d9ed4cb-c5c3-444b-b399-86b2e1a34175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:39.622862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 306/635] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:39.623720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ed4cb-c5c3-444b-b399-86b2e1a34175 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:39.642164 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:39.644364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56859030-4b6f-46bf-8f57-7b462e888650 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:39.686873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab34f4-3f56-403d-a175-209db58b7015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:39.688641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab34f4-3f56-403d-a175-209db58b7015 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:39.688930 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab34f4-3f56-403d-a175-209db58b7015 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:39.689213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab34f4-3f56-403d-a175-209db58b7015 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:39.689968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab34f4-3f56-403d-a175-209db58b7015 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:39.690277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab34f4-3f56-403d-a175-209db58b7015 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:39.691717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab34f4-3f56-403d-a175-209db58b7015 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:39.711456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 330/636] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:39.711456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab34f4-3f56-403d-a175-209db58b7015 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:39.754432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:39.759974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ed4cb-c5c3-444b-b399-86b2e1a34175 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:39.797130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5307f-553d-4c39-8bde-578778461b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:39.797898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5307f-553d-4c39-8bde-578778461b3a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:39.798189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5307f-553d-4c39-8bde-578778461b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:39.798470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5307f-553d-4c39-8bde-578778461b3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:39.810931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5307f-553d-4c39-8bde-578778461b3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:39.812419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5307f-553d-4c39-8bde-578778461b3a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:39.818757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab34f4-3f56-403d-a175-209db58b7015 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a3e5307f-553d-4c39-8bde-578778461b3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:39.824595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:39.825483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:39.826365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:39.826365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:39.826365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:39.826365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:39.826365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:39.826365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:39.826365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:39.826365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:39.828433 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 307/637] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:39.829916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5307f-553d-4c39-8bde-578778461b3a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:39.856592 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853c68a-e8ad-4d1b-b8cd-1bb40194d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:39.857305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853c68a-e8ad-4d1b-b8cd-1bb40194d312 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:39.857595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853c68a-e8ad-4d1b-b8cd-1bb40194d312 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:39.858008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853c68a-e8ad-4d1b-b8cd-1bb40194d312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:39.868677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853c68a-e8ad-4d1b-b8cd-1bb40194d312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:39.870157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853c68a-e8ad-4d1b-b8cd-1bb40194d312 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-d853c68a-e8ad-4d1b-b8cd-1bb40194d312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:39.885480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:39.886394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:39.887270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:39.887270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:39.887270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:39.887270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:39.887270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 331/638] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:39.887539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853c68a-e8ad-4d1b-b8cd-1bb40194d312 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:39.906967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:39.945381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5307f-553d-4c39-8bde-578778461b3a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:39.981706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69ee83-0a04-4c0f-a69f-c0af8d655863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:39.982637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69ee83-0a04-4c0f-a69f-c0af8d655863 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:39.983109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69ee83-0a04-4c0f-a69f-c0af8d655863 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:39.983585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69ee83-0a04-4c0f-a69f-c0af8d655863 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:39.990413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:39.997081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69ee83-0a04-4c0f-a69f-c0af8d655863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:39.997702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853c68a-e8ad-4d1b-b8cd-1bb40194d312 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-6e69ee83-0a04-4c0f-a69f-c0af8d655863 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:40.003237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:40.004249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:40.005344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:40.005344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:40.005344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:40.005344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:40.005344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:40.005344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:40.005344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:40.005344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:40.005344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:40.005344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:40.005344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:40.005344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:40.012408 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 308/639] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:40.013238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69ee83-0a04-4c0f-a69f-c0af8d655863 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:40.036581 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e4b46-ed42-468f-a144-15cc26f4af42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:40.037199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e4b46-ed42-468f-a144-15cc26f4af42 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:40.037485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e4b46-ed42-468f-a144-15cc26f4af42 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:40.037765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e4b46-ed42-468f-a144-15cc26f4af42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:40.038554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e4b46-ed42-468f-a144-15cc26f4af42 None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=e1de289ba7ae4140a421127b8f18901f) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:40.038871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e4b46-ed42-468f-a144-15cc26f4af42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:40.040887 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e4b46-ed42-468f-a144-15cc26f4af42 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:40.046757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 332/640] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:39 2022] GET /identity/v3/role_assignments?user.id=e1de289ba7ae4140a421127b8f18901f&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:40.047474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e4b46-ed42-468f-a144-15cc26f4af42 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:40.133284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69ee83-0a04-4c0f-a69f-c0af8d655863 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:40.166512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:40.173556 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e4b46-ed42-468f-a144-15cc26f4af42 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:40.175813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5e329-453b-4442-a58b-9e32e9448e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:40.177014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e329-453b-4442-a58b-9e32e9448e5b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:40.177014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e329-453b-4442-a58b-9e32e9448e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:40.177014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e329-453b-4442-a58b-9e32e9448e5b None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:40.177788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5e329-453b-4442-a58b-9e32e9448e5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:40.178114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5e329-453b-4442-a58b-9e32e9448e5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:40.179616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5e329-453b-4442-a58b-9e32e9448e5b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:40.198322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 309/641] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:40.198322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5e329-453b-4442-a58b-9e32e9448e5b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:40.217317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a1009-5fcf-465c-8860-5ee782002969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:40.217948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a1009-5fcf-465c-8860-5ee782002969 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:40.218262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a1009-5fcf-465c-8860-5ee782002969 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:40.218538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a1009-5fcf-465c-8860-5ee782002969 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:40.219234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a1009-5fcf-465c-8860-5ee782002969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:40.219545 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a1009-5fcf-465c-8860-5ee782002969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:40.221682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a1009-5fcf-465c-8860-5ee782002969 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:40.235579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 333/642] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:40.236855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e7dd-4d0a-4230-b2f3-d432c8caaff8 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:40.237148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e7dd-4d0a-4230-b2f3-d432c8caaff8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:40.237427 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e7dd-4d0a-4230-b2f3-d432c8caaff8 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:40.238799 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 334/643] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:40.239313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6e7dd-4d0a-4230-b2f3-d432c8caaff8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:40.268209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:40.321109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5e329-453b-4442-a58b-9e32e9448e5b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:40.361257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6e7dd-4d0a-4230-b2f3-d432c8caaff8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:40.361720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c6071-9aad-4221-998b-2c6a179758e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:40.362343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c6071-9aad-4221-998b-2c6a179758e6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:40.362747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c6071-9aad-4221-998b-2c6a179758e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:40.363027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c6071-9aad-4221-998b-2c6a179758e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:40.363751 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c6071-9aad-4221-998b-2c6a179758e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:40.364062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c6071-9aad-4221-998b-2c6a179758e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:40.365478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c6071-9aad-4221-998b-2c6a179758e6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:40.377937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 310/644] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:40.377937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c6071-9aad-4221-998b-2c6a179758e6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:40.407651 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b42c4f-cafc-4c94-a32b-f74d43e550d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:40.408355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b42c4f-cafc-4c94-a32b-f74d43e550d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:40.408704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b42c4f-cafc-4c94-a32b-f74d43e550d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:40.408901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b42c4f-cafc-4c94-a32b-f74d43e550d7 None admin] PATH_INFO: `/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/d182c7050f0040559f69a231bee6dccf/roles/508a2d8d86e0445e83f4adfdbe4c1b43` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:40.424825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b42c4f-cafc-4c94-a32b-f74d43e550d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e1649f32d3d494682dc06e05ae34f3d, user_id=d182c7050f0040559f69a231bee6dccf, role_id=508a2d8d86e0445e83f4adfdbe4c1b43)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:40.426290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b42c4f-cafc-4c94-a32b-f74d43e550d7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:40.437537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:40.448170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 335/645] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:40:40 2022] PUT /identity/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/d182c7050f0040559f69a231bee6dccf/roles/508a2d8d86e0445e83f4adfdbe4c1b43 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:40:40.448170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d0141-7899-4ae7-b094-6fd67fbc2aeb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:40.448170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d0141-7899-4ae7-b094-6fd67fbc2aeb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:40.448170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d0141-7899-4ae7-b094-6fd67fbc2aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:40.461241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a08d0141-7899-4ae7-b094-6fd67fbc2aeb None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:40.462506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a08d0141-7899-4ae7-b094-6fd67fbc2aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:40.517252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c6071-9aad-4221-998b-2c6a179758e6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:40.538856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:40.545369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 336/646] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:40.546389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d0141-7899-4ae7-b094-6fd67fbc2aeb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:40.580688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a2e36-d0d7-4899-a4c2-1a8d8e8e9a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:40.581348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a2e36-d0d7-4899-a4c2-1a8d8e8e9a36 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:40.581632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a2e36-d0d7-4899-a4c2-1a8d8e8e9a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:40.581904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a2e36-d0d7-4899-a4c2-1a8d8e8e9a36 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:40.591171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a2e36-d0d7-4899-a4c2-1a8d8e8e9a36 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:40.592723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a2e36-d0d7-4899-a4c2-1a8d8e8e9a36 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a46a2e36-d0d7-4899-a4c2-1a8d8e8e9a36 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:40.605615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:40.606866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:40.608331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:40.608331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:40.608331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:40.608331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:40.608331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:40.608331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:40.608331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:40.608331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:40.608331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:40:40.608331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:40.608331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 311/647] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:40.608331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a2e36-d0d7-4899-a4c2-1a8d8e8e9a36 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:40.676024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d0141-7899-4ae7-b094-6fd67fbc2aeb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:40.717728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015c1e5-b716-40ba-bf8f-43ff990e5414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:40.718381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015c1e5-b716-40ba-bf8f-43ff990e5414 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:40.718673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015c1e5-b716-40ba-bf8f-43ff990e5414 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:40.718954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015c1e5-b716-40ba-bf8f-43ff990e5414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:40.729911 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015c1e5-b716-40ba-bf8f-43ff990e5414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:40.731391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015c1e5-b716-40ba-bf8f-43ff990e5414 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:40.740291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a2e36-d0d7-4899-a4c2-1a8d8e8e9a36 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b015c1e5-b716-40ba-bf8f-43ff990e5414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:40.748784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:40.749734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:40.751056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:40.751056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:40.751056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:40.751056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:40.751056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 337/648] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:40.751352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015c1e5-b716-40ba-bf8f-43ff990e5414 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:40.758215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:40.790930 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529afe1-eff0-4640-ac40-1162d5c4107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:40.791965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529afe1-eff0-4640-ac40-1162d5c4107a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:40.792615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529afe1-eff0-4640-ac40-1162d5c4107a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:40.793876 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529afe1-eff0-4640-ac40-1162d5c4107a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:40.817692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:40.818255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529afe1-eff0-4640-ac40-1162d5c4107a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8529afe1-eff0-4640-ac40-1162d5c4107a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:40.826112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:40.827027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:40.827852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:40.827852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:40.827852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:40.827852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:40.827852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:40.827852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:40.827852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:40.827852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:40.827852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:40.827852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:40.827852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:40.827852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:40.829632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 312/649] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:40.830240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529afe1-eff0-4640-ac40-1162d5c4107a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:40.868832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015c1e5-b716-40ba-bf8f-43ff990e5414 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:40.905602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685332f7-cd79-4114-9c7f-7f9e29c6019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:40.906288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685332f7-cd79-4114-9c7f-7f9e29c6019e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:40.906732 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685332f7-cd79-4114-9c7f-7f9e29c6019e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:40.907021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685332f7-cd79-4114-9c7f-7f9e29c6019e None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:40.907833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685332f7-cd79-4114-9c7f-7f9e29c6019e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:40.908212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685332f7-cd79-4114-9c7f-7f9e29c6019e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:40.909905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685332f7-cd79-4114-9c7f-7f9e29c6019e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:40.932761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 338/650] 10.222.0.17 () {56 vars in 1137 bytes} [Tue Aug 2 08:40:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:40.932761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685332f7-cd79-4114-9c7f-7f9e29c6019e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:40.983580 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529afe1-eff0-4640-ac40-1162d5c4107a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:41.030003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9815d-786e-47c5-b2a1-3d236512a2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:41.031381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9815d-786e-47c5-b2a1-3d236512a2bd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:41.031889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9815d-786e-47c5-b2a1-3d236512a2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:41.032638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9815d-786e-47c5-b2a1-3d236512a2bd None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:41.033692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9815d-786e-47c5-b2a1-3d236512a2bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:41.034513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9815d-786e-47c5-b2a1-3d236512a2bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:41.036412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9815d-786e-47c5-b2a1-3d236512a2bd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:41.036940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685332f7-cd79-4114-9c7f-7f9e29c6019e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:41.048594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:41.058317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 313/651] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:41.059480 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9815d-786e-47c5-b2a1-3d236512a2bd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:41.082026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fa9c2-a971-4ce8-a4d0-23f524ba5323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:41.083315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fa9c2-a971-4ce8-a4d0-23f524ba5323 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:41.084005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fa9c2-a971-4ce8-a4d0-23f524ba5323 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:41.084478 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fa9c2-a971-4ce8-a4d0-23f524ba5323 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:41.085651 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fa9c2-a971-4ce8-a4d0-23f524ba5323 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:41.086619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fa9c2-a971-4ce8-a4d0-23f524ba5323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:41.088834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fa9c2-a971-4ce8-a4d0-23f524ba5323 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:41.093525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:41.100976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 339/652] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:41.102624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fa9c2-a971-4ce8-a4d0-23f524ba5323 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:41.171449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9815d-786e-47c5-b2a1-3d236512a2bd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:41.208991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87aaf4-fec0-4e04-b67e-fab17adaad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:41.209850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87aaf4-fec0-4e04-b67e-fab17adaad66 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:41.210220 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87aaf4-fec0-4e04-b67e-fab17adaad66 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:41.210550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87aaf4-fec0-4e04-b67e-fab17adaad66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:41.234986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fa9c2-a971-4ce8-a4d0-23f524ba5323 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:41.284815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a05bc0-39f1-48f5-af49-ea138eddf30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:41.285725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a05bc0-39f1-48f5-af49-ea138eddf30f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:41.286179 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a05bc0-39f1-48f5-af49-ea138eddf30f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:41.286597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a05bc0-39f1-48f5-af49-ea138eddf30f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:41.291896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87aaf4-fec0-4e04-b67e-fab17adaad66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:41.293670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87aaf4-fec0-4e04-b67e-fab17adaad66 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:41.298907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a05bc0-39f1-48f5-af49-ea138eddf30f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:41.300573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a05bc0-39f1-48f5-af49-ea138eddf30f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-33a05bc0-39f1-48f5-af49-ea138eddf30f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:41.316274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:41.317446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:41.318411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:41.318411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:41.318411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:41.318411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:41.318411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:41.318411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:41.318411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:41.318411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:41.318411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:40:41.318411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:41.322857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 340/653] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:41.323778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a05bc0-39f1-48f5-af49-ea138eddf30f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:41.337711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:41.369261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:41.420642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 314/654] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:41.421151 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87aaf4-fec0-4e04-b67e-fab17adaad66 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:41.459604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a05bc0-39f1-48f5-af49-ea138eddf30f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:41.498026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5471b94-5a3b-46dc-abe4-a823098cdc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:41.498849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5471b94-5a3b-46dc-abe4-a823098cdc91 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:41.499437 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5471b94-5a3b-46dc-abe4-a823098cdc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:41.499437 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5471b94-5a3b-46dc-abe4-a823098cdc91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:41.510825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5471b94-5a3b-46dc-abe4-a823098cdc91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:41.512314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5471b94-5a3b-46dc-abe4-a823098cdc91 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b5471b94-5a3b-46dc-abe4-a823098cdc91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:41.530091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:41.530995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:41.532332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:41.532332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:41.532332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:41.532332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:41.532332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 341/655] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:41.532774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5471b94-5a3b-46dc-abe4-a823098cdc91 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:41.563557 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87aaf4-fec0-4e04-b67e-fab17adaad66 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:41.594374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:41.601796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b424e9-be7d-49ab-b6fa-507a242133f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:41.602417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b424e9-be7d-49ab-b6fa-507a242133f0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:41.602704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b424e9-be7d-49ab-b6fa-507a242133f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:41.602984 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b424e9-be7d-49ab-b6fa-507a242133f0 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:41.603988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b424e9-be7d-49ab-b6fa-507a242133f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:41.604097 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b424e9-be7d-49ab-b6fa-507a242133f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:41.605532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b424e9-be7d-49ab-b6fa-507a242133f0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:41.628596 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 315/656] 10.222.0.17 () {56 vars in 1137 bytes} [Tue Aug 2 08:40:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:41.630193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b424e9-be7d-49ab-b6fa-507a242133f0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:41.640843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:41.661947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5471b94-5a3b-46dc-abe4-a823098cdc91 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:41.708974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3090c4-a203-4a62-850e-f1ba155d38ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:41.710222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3090c4-a203-4a62-850e-f1ba155d38ad None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:41.710731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3090c4-a203-4a62-850e-f1ba155d38ad None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:41.711255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3090c4-a203-4a62-850e-f1ba155d38ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:41.725761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3090c4-a203-4a62-850e-f1ba155d38ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:41.728027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3090c4-a203-4a62-850e-f1ba155d38ad None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-3f3090c4-a203-4a62-850e-f1ba155d38ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:41.744996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:41.745932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:41.746787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:41.746787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:41.746787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:41.746787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:41.750913 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 342/657] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:41.751858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3090c4-a203-4a62-850e-f1ba155d38ad None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:41.761442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b424e9-be7d-49ab-b6fa-507a242133f0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:41.797866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c063698-627d-495c-b34c-61d06c317e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:41.798348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c063698-627d-495c-b34c-61d06c317e1c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:41.798643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c063698-627d-495c-b34c-61d06c317e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:41.798916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c063698-627d-495c-b34c-61d06c317e1c None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:41.799612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c063698-627d-495c-b34c-61d06c317e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:41.799924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c063698-627d-495c-b34c-61d06c317e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:41.801339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c063698-627d-495c-b34c-61d06c317e1c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:41.822893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 316/658] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:41.824365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c063698-627d-495c-b34c-61d06c317e1c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:41.887535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3090c4-a203-4a62-850e-f1ba155d38ad None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:41.893190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:41.933024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd742a-8996-4bc9-8d92-8fac70bfee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:41.933653 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd742a-8996-4bc9-8d92-8fac70bfee0b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:41.933945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd742a-8996-4bc9-8d92-8fac70bfee0b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:41.934485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd742a-8996-4bc9-8d92-8fac70bfee0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:41.939438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:41.958889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c063698-627d-495c-b34c-61d06c317e1c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:41.999095 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ad79-b34d-40a9-a38b-b43e1f14b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:41.999991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ad79-b34d-40a9-a38b-b43e1f14b515 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:42.000453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ad79-b34d-40a9-a38b-b43e1f14b515 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:42.000883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ad79-b34d-40a9-a38b-b43e1f14b515 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:42.001806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ad79-b34d-40a9-a38b-b43e1f14b515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:42.002265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ad79-b34d-40a9-a38b-b43e1f14b515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:42.003785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ad79-b34d-40a9-a38b-b43e1f14b515 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:42.020155 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd742a-8996-4bc9-8d92-8fac70bfee0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:42.020636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 317/659] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:42.021351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd742a-8996-4bc9-8d92-8fac70bfee0b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:42.021889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ad79-b34d-40a9-a38b-b43e1f14b515 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:42.128851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ad79-b34d-40a9-a38b-b43e1f14b515 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:42.140073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 343/660] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:42.140073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd742a-8996-4bc9-8d92-8fac70bfee0b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:42.144812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:42.172274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e8e77-4106-4ad7-9e06-fed3127a6eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:42.173227 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e8e77-4106-4ad7-9e06-fed3127a6eff None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:42.173663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e8e77-4106-4ad7-9e06-fed3127a6eff None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:42.174091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e8e77-4106-4ad7-9e06-fed3127a6eff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:42.175084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:42.182966 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e8e77-4106-4ad7-9e06-fed3127a6eff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:42.184777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e8e77-4106-4ad7-9e06-fed3127a6eff None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d60e8e77-4106-4ad7-9e06-fed3127a6eff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:42.198523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:42.199715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:42.200813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:42.200813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:42.200813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:42.200813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:42.200813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:42.200813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:42.200813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:42.200813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:42.200813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:40:42.200813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:42.203135 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 318/661] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:42.204106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e8e77-4106-4ad7-9e06-fed3127a6eff None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:42.249571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd742a-8996-4bc9-8d92-8fac70bfee0b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:42.293871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72287b-3b50-407b-a652-1d01f82b2ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:42.294628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72287b-3b50-407b-a652-1d01f82b2ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:42.294971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72287b-3b50-407b-a652-1d01f82b2ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:42.295374 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72287b-3b50-407b-a652-1d01f82b2ed5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:42.302030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72287b-3b50-407b-a652-1d01f82b2ed5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:42.303461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72287b-3b50-407b-a652-1d01f82b2ed5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:42.313786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e8e77-4106-4ad7-9e06-fed3127a6eff None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-be72287b-3b50-407b-a652-1d01f82b2ed5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:42.315247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:42.316111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:42.317314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:42.317314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:42.317314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:42.317314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:42.317314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:42.317314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:42.317314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:42.317314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:42.317314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 344/662] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:42.317314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72287b-3b50-407b-a652-1d01f82b2ed5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:42.358815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ccb40-5cd7-429d-9677-9857e7c9a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:42.359460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ccb40-5cd7-429d-9677-9857e7c9a337 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:42.359740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ccb40-5cd7-429d-9677-9857e7c9a337 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:42.360016 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ccb40-5cd7-429d-9677-9857e7c9a337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:42.371512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ccb40-5cd7-429d-9677-9857e7c9a337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:42.372990 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ccb40-5cd7-429d-9677-9857e7c9a337 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c49ccb40-5cd7-429d-9677-9857e7c9a337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:42.390923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:42.391807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:42.397954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:42.397954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:42.397954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:42.397954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:42.397954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 319/663] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:42.397954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be620-36fd-42cd-a2e2-5f2cd12e1ba5 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:42.397954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be620-36fd-42cd-a2e2-5f2cd12e1ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:42.397954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be620-36fd-42cd-a2e2-5f2cd12e1ba5 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:42.400150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 320/664] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:42.401021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462be620-36fd-42cd-a2e2-5f2cd12e1ba5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:42.424627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:42.431851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:42.438448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72287b-3b50-407b-a652-1d01f82b2ed5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:42.482298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc389b60-1d8b-4fac-91d8-602611ce545c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:42.483036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc389b60-1d8b-4fac-91d8-602611ce545c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:42.483378 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc389b60-1d8b-4fac-91d8-602611ce545c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:42.483702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc389b60-1d8b-4fac-91d8-602611ce545c None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:42.484535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc389b60-1d8b-4fac-91d8-602611ce545c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:42.484849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc389b60-1d8b-4fac-91d8-602611ce545c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:42.486574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc389b60-1d8b-4fac-91d8-602611ce545c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:42.506132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 345/665] 10.222.0.17 () {56 vars in 1139 bytes} [Tue Aug 2 08:40:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:42.511923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc389b60-1d8b-4fac-91d8-602611ce545c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:42.520828 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462be620-36fd-42cd-a2e2-5f2cd12e1ba5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:42.558413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed2b15-66d1-47da-9ba1-cc378fb2fa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:42.559139 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed2b15-66d1-47da-9ba1-cc378fb2fa26 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:42.559424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed2b15-66d1-47da-9ba1-cc378fb2fa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:42.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed2b15-66d1-47da-9ba1-cc378fb2fa26 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:42.560539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed2b15-66d1-47da-9ba1-cc378fb2fa26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:42.560848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed2b15-66d1-47da-9ba1-cc378fb2fa26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:42.562520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed2b15-66d1-47da-9ba1-cc378fb2fa26 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:42.582348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 321/666] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:42.582348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10384f6-ce81-4ee7-8058-9aab8f905cd6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:42.582348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10384f6-ce81-4ee7-8058-9aab8f905cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:42.582348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10384f6-ce81-4ee7-8058-9aab8f905cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:42.598444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e10384f6-ce81-4ee7-8058-9aab8f905cd6 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:42.599622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e10384f6-ce81-4ee7-8058-9aab8f905cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:42.618300 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc389b60-1d8b-4fac-91d8-602611ce545c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:42.656507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff7e2e-965a-4e7b-8f62-2564b93e3ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:42.656927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff7e2e-965a-4e7b-8f62-2564b93e3ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:42.657218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff7e2e-965a-4e7b-8f62-2564b93e3ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:42.657492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff7e2e-965a-4e7b-8f62-2564b93e3ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:42.658176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff7e2e-965a-4e7b-8f62-2564b93e3ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:42.658487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff7e2e-965a-4e7b-8f62-2564b93e3ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:42.659867 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff7e2e-965a-4e7b-8f62-2564b93e3ed3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:42.672654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 346/667] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:42.673470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff7e2e-965a-4e7b-8f62-2564b93e3ed3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:42.688372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 322/668] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:42.688372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10384f6-ce81-4ee7-8058-9aab8f905cd6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:42.690385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:42.700382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:42.775429 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff7e2e-965a-4e7b-8f62-2564b93e3ed3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:42.790033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10384f6-ce81-4ee7-8058-9aab8f905cd6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:42.809979 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d6045-3d52-4f1b-99bf-41839d2bf74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:42.810604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d6045-3d52-4f1b-99bf-41839d2bf74e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:42.810889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d6045-3d52-4f1b-99bf-41839d2bf74e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:42.811169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d6045-3d52-4f1b-99bf-41839d2bf74e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:42.827530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38873018-254e-4302-99b5-11a48e35ff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:42.828172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38873018-254e-4302-99b5-11a48e35ff49 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:42.828463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38873018-254e-4302-99b5-11a48e35ff49 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:42.828743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38873018-254e-4302-99b5-11a48e35ff49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:42.829532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38873018-254e-4302-99b5-11a48e35ff49 None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=b2c5059aacc149deb6cdb86d3341e78b) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:42.829844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38873018-254e-4302-99b5-11a48e35ff49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:42.831279 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38873018-254e-4302-99b5-11a48e35ff49 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:42.838019 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 323/669] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:42 2022] GET /identity/v3/role_assignments?user.id=b2c5059aacc149deb6cdb86d3341e78b&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:42.839195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb37d3b-c4e9-44a1-a9e4-7359afe72bbd None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:42.839481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb37d3b-c4e9-44a1-a9e4-7359afe72bbd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:42.839760 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb37d3b-c4e9-44a1-a9e4-7359afe72bbd None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:42.841000 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 324/670] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:42.841698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb37d3b-c4e9-44a1-a9e4-7359afe72bbd None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:42.910110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d6045-3d52-4f1b-99bf-41839d2bf74e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:42.911525 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d6045-3d52-4f1b-99bf-41839d2bf74e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:42.928562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:42.932074 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:42.963263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb37d3b-c4e9-44a1-a9e4-7359afe72bbd None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:43.004982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe17ffd-7551-449c-b452-ff8cb404bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:43.005659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe17ffd-7551-449c-b452-ff8cb404bb6a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:43.005944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe17ffd-7551-449c-b452-ff8cb404bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:43.006222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe17ffd-7551-449c-b452-ff8cb404bb6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:43.016647 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe17ffd-7551-449c-b452-ff8cb404bb6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:43.018286 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe17ffd-7551-449c-b452-ff8cb404bb6a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:43.031437 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 347/671] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-0fe17ffd-7551-449c-b452-ff8cb404bb6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:43.032102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:43.033065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:43.033979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:43.033979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:43.033979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:43.033979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:43.033979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:43.033979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:43.033979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:43.033979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:43.034411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d6045-3d52-4f1b-99bf-41839d2bf74e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:43.038021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 325/672] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:43.039264 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f64509-ad8b-4a05-b192-7bc418ea6720 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:43.039556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f64509-ad8b-4a05-b192-7bc418ea6720 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:43.039832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f64509-ad8b-4a05-b192-7bc418ea6720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:43.060380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-68f64509-ad8b-4a05-b192-7bc418ea6720 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:43.061584 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-68f64509-ad8b-4a05-b192-7bc418ea6720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:43.130778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 326/673] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:43.131908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f64509-ad8b-4a05-b192-7bc418ea6720 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:43.149744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d6045-3d52-4f1b-99bf-41839d2bf74e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:43.165596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:43.188221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261a5ad-df49-486d-a4a9-a68e67b4f91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:43.188871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a5ad-df49-486d-a4a9-a68e67b4f91d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:43.189160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a5ad-df49-486d-a4a9-a68e67b4f91d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:43.189531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a5ad-df49-486d-a4a9-a68e67b4f91d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:43.201737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261a5ad-df49-486d-a4a9-a68e67b4f91d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:43.204819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7261a5ad-df49-486d-a4a9-a68e67b4f91d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:43.206987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:43.208012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:43.209170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 348/674] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:43.209854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261a5ad-df49-486d-a4a9-a68e67b4f91d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:43.250536 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f64509-ad8b-4a05-b192-7bc418ea6720 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:43.289168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4b0cb-ec91-427a-a454-541c3c3bbf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:43.289814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b0cb-ec91-427a-a454-541c3c3bbf68 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:43.290100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b0cb-ec91-427a-a454-541c3c3bbf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:43.290380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b0cb-ec91-427a-a454-541c3c3bbf68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:43.305521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4b0cb-ec91-427a-a454-541c3c3bbf68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:43.307750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4b0cb-ec91-427a-a454-541c3c3bbf68 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:43.318559 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261a5ad-df49-486d-a4a9-a68e67b4f91d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-41b4b0cb-ec91-427a-a454-541c3c3bbf68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:43.328415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:43.329297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:43.330179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:43.330179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:43.330179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:43.330179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:43.332144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 327/675] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:43.332144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4b0cb-ec91-427a-a454-541c3c3bbf68 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:43.358240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a702f27-054d-41a2-ac32-817b6496524b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:43.358865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a702f27-054d-41a2-ac32-817b6496524b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:43.359150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a702f27-054d-41a2-ac32-817b6496524b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:43.359428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a702f27-054d-41a2-ac32-817b6496524b None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:43.360201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a702f27-054d-41a2-ac32-817b6496524b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:43.360519 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a702f27-054d-41a2-ac32-817b6496524b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:43.361948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a702f27-054d-41a2-ac32-817b6496524b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:43.374108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 349/676] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:43.374940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a702f27-054d-41a2-ac32-817b6496524b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:43.415071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:43.443793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4b0cb-ec91-427a-a454-541c3c3bbf68 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:43.461650 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:43.479341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf18d13-de41-4997-801c-e954e7f4224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:43.479983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf18d13-de41-4997-801c-e954e7f4224e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:43.480324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf18d13-de41-4997-801c-e954e7f4224e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:43.480607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf18d13-de41-4997-801c-e954e7f4224e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:43.485511 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a702f27-054d-41a2-ac32-817b6496524b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:43.492785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf18d13-de41-4997-801c-e954e7f4224e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-fbf18d13-de41-4997-801c-e954e7f4224e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:43.498280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:43.499188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 328/677] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:43.500825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf18d13-de41-4997-801c-e954e7f4224e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:43.526655 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fa788-34ea-44db-9be8-daf78d8eb047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:43.527282 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fa788-34ea-44db-9be8-daf78d8eb047 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:43.527573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fa788-34ea-44db-9be8-daf78d8eb047 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:43.527881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fa788-34ea-44db-9be8-daf78d8eb047 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:43.528633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fa788-34ea-44db-9be8-daf78d8eb047 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:43.528948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fa788-34ea-44db-9be8-daf78d8eb047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:43.530323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fa788-34ea-44db-9be8-daf78d8eb047 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:43.540230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 350/678] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:43.541058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fa788-34ea-44db-9be8-daf78d8eb047 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:43.609975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf18d13-de41-4997-801c-e954e7f4224e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:43.647376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2ac9e-6911-4824-aaa3-834cc6482063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:43.647990 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2ac9e-6911-4824-aaa3-834cc6482063 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:43.648331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2ac9e-6911-4824-aaa3-834cc6482063 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:43.648699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2ac9e-6911-4824-aaa3-834cc6482063 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:43.649164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:43.649448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2ac9e-6911-4824-aaa3-834cc6482063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:43.649621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2ac9e-6911-4824-aaa3-834cc6482063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:43.650972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2ac9e-6911-4824-aaa3-834cc6482063 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:43.655994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fa788-34ea-44db-9be8-daf78d8eb047 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:43.668154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 329/679] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:43.668154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2ac9e-6911-4824-aaa3-834cc6482063 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:43.696784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652a447-6d3c-404b-b42a-71ec6704704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:43.697487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652a447-6d3c-404b-b42a-71ec6704704b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:43.697801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652a447-6d3c-404b-b42a-71ec6704704b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:43.698078 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652a447-6d3c-404b-b42a-71ec6704704b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:43.699074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652a447-6d3c-404b-b42a-71ec6704704b None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=27e0b08a946b43f08028c5da415d4e8c) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:43.699392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652a447-6d3c-404b-b42a-71ec6704704b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:43.701154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652a447-6d3c-404b-b42a-71ec6704704b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:43.704486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:43.716559 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 351/680] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:43 2022] GET /identity/v3/role_assignments?user.id=27e0b08a946b43f08028c5da415d4e8c&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:43.717556 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652a447-6d3c-404b-b42a-71ec6704704b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:43.805067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2ac9e-6911-4824-aaa3-834cc6482063 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:43.865062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f44e28-6652-4231-af01-46db14cbca83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:43.865521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44e28-6652-4231-af01-46db14cbca83 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:43.865749 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44e28-6652-4231-af01-46db14cbca83 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:43.866029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44e28-6652-4231-af01-46db14cbca83 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:43.867236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f44e28-6652-4231-af01-46db14cbca83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:43.867236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f44e28-6652-4231-af01-46db14cbca83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:43.869936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f44e28-6652-4231-af01-46db14cbca83 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:43.877140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652a447-6d3c-404b-b42a-71ec6704704b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:43.880231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 330/681] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:43.880563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f44e28-6652-4231-af01-46db14cbca83 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:43.930881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a791bd7-660d-4be3-8f88-be42f1990290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:43.931531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a791bd7-660d-4be3-8f88-be42f1990290 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:43.931812 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a791bd7-660d-4be3-8f88-be42f1990290 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:43.932083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a791bd7-660d-4be3-8f88-be42f1990290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:43.943659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a791bd7-660d-4be3-8f88-be42f1990290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:43.945208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a791bd7-660d-4be3-8f88-be42f1990290 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-5a791bd7-660d-4be3-8f88-be42f1990290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:43.962028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:43.962920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:43.963811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:43.963811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:43.963811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:43.963811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:43.963811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 352/682] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:43.964219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a791bd7-660d-4be3-8f88-be42f1990290 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:43.983140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:44.010483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:44.016610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f44e28-6652-4231-af01-46db14cbca83 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:44.061857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97028bc0-47f2-4b2f-8d05-614aada51463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:44.062532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97028bc0-47f2-4b2f-8d05-614aada51463 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:44.062809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97028bc0-47f2-4b2f-8d05-614aada51463 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:44.063078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97028bc0-47f2-4b2f-8d05-614aada51463 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:44.070030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97028bc0-47f2-4b2f-8d05-614aada51463 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:44.071911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97028bc0-47f2-4b2f-8d05-614aada51463 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-97028bc0-47f2-4b2f-8d05-614aada51463 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:44.085641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:44.087096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:44.088238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:44.088238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:44.088238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:44.088238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:44.088238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:44.088238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:44.088238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:44.088238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:44.092335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 331/683] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:44.093277 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97028bc0-47f2-4b2f-8d05-614aada51463 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:44.094717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a791bd7-660d-4be3-8f88-be42f1990290 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:44.144499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f209738-79f8-49b1-9d9e-dec2ed26c426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:44.145448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f209738-79f8-49b1-9d9e-dec2ed26c426 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:44.146116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f209738-79f8-49b1-9d9e-dec2ed26c426 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:44.146958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f209738-79f8-49b1-9d9e-dec2ed26c426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:44.163239 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f209738-79f8-49b1-9d9e-dec2ed26c426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:44.165883 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f209738-79f8-49b1-9d9e-dec2ed26c426 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7f209738-79f8-49b1-9d9e-dec2ed26c426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:44.185639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:44.186567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:44.187453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:44.187453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:44.187453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:44.187453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:44.194321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 353/684] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:44.194321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f209738-79f8-49b1-9d9e-dec2ed26c426 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:44.207822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97028bc0-47f2-4b2f-8d05-614aada51463 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:44.251524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3e2a7-335f-4acd-9004-767ee71aa0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:44.252686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3e2a7-335f-4acd-9004-767ee71aa0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:44.253147 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3e2a7-335f-4acd-9004-767ee71aa0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:44.253867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3e2a7-335f-4acd-9004-767ee71aa0b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:44.255203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3e2a7-335f-4acd-9004-767ee71aa0b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:44.255696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3e2a7-335f-4acd-9004-767ee71aa0b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:44.258391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3e2a7-335f-4acd-9004-767ee71aa0b4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:44.271927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:44.275740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 332/685] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:44.277114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3e2a7-335f-4acd-9004-767ee71aa0b4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:44.300851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:44.321389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f209738-79f8-49b1-9d9e-dec2ed26c426 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:44.361340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955474a9-b9f3-42e9-9533-541f0820756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:44.362122 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955474a9-b9f3-42e9-9533-541f0820756f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:44.362499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955474a9-b9f3-42e9-9533-541f0820756f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:44.362888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955474a9-b9f3-42e9-9533-541f0820756f None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:44.363738 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955474a9-b9f3-42e9-9533-541f0820756f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:44.364178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955474a9-b9f3-42e9-9533-541f0820756f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:44.366009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955474a9-b9f3-42e9-9533-541f0820756f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:44.385013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 354/686] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:44.386041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955474a9-b9f3-42e9-9533-541f0820756f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:44.408506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3e2a7-335f-4acd-9004-767ee71aa0b4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:44.455109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5a010-6718-4320-b208-94ed5dd052d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:44.456722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5a010-6718-4320-b208-94ed5dd052d2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:44.457424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5a010-6718-4320-b208-94ed5dd052d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:44.457981 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5a010-6718-4320-b208-94ed5dd052d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:44.459716 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5a010-6718-4320-b208-94ed5dd052d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:44.460205 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5a010-6718-4320-b208-94ed5dd052d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:44.462956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5a010-6718-4320-b208-94ed5dd052d2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:44.484036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 333/687] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:44.485190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5a010-6718-4320-b208-94ed5dd052d2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:44.519766 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955474a9-b9f3-42e9-9533-541f0820756f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:44.547027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:44.560637 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea8a32-e41d-4148-ad60-d117687b5f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:44.561629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8a32-e41d-4148-ad60-d117687b5f2d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:44.562255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8a32-e41d-4148-ad60-d117687b5f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:44.562764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8a32-e41d-4148-ad60-d117687b5f2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:44.571580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea8a32-e41d-4148-ad60-d117687b5f2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:44.572176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:44.574897 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea8a32-e41d-4148-ad60-d117687b5f2d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-5eea8a32-e41d-4148-ad60-d117687b5f2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:44.590785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:44.591787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:44.592741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:44.592741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:44.592741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:44.592741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:44.592741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:44.592741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:44.592741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:44.592741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:44.592741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:40:44.592741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:44.595476 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 355/688] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Aug 2 08:40:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:44.595830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5a010-6718-4320-b208-94ed5dd052d2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:44.596873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea8a32-e41d-4148-ad60-d117687b5f2d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:44.633559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf73b-3b4e-422f-9002-2a592a35c06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:44.634159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf73b-3b4e-422f-9002-2a592a35c06f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:44.634442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf73b-3b4e-422f-9002-2a592a35c06f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:44.634721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf73b-3b4e-422f-9002-2a592a35c06f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:44.635508 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf73b-3b4e-422f-9002-2a592a35c06f None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=c9162dcfb8d542679c7217fae8f5c185) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:44.635820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf73b-3b4e-422f-9002-2a592a35c06f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:44.637311 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf73b-3b4e-422f-9002-2a592a35c06f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:44.643781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 334/689] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:44 2022] GET /identity/v3/role_assignments?user.id=c9162dcfb8d542679c7217fae8f5c185&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:44.644709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf73b-3b4e-422f-9002-2a592a35c06f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:44.722468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea8a32-e41d-4148-ad60-d117687b5f2d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:44.754296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf73b-3b4e-422f-9002-2a592a35c06f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:44.763778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c88a43-c68d-41d3-9f04-2cf18e270da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:44.764950 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c88a43-c68d-41d3-9f04-2cf18e270da4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:44.765499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c88a43-c68d-41d3-9f04-2cf18e270da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:44.766007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c88a43-c68d-41d3-9f04-2cf18e270da4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:44.775531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c88a43-c68d-41d3-9f04-2cf18e270da4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:44.777489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c88a43-c68d-41d3-9f04-2cf18e270da4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:44.791563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22323e6-7363-4e59-97b7-bfd878c07789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:44.792231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22323e6-7363-4e59-97b7-bfd878c07789 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:44.792519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22323e6-7363-4e59-97b7-bfd878c07789 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:44.792798 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22323e6-7363-4e59-97b7-bfd878c07789 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-34c88a43-c68d-41d3-9f04-2cf18e270da4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:44.793144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:44.794038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:44.795284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:44.795284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:44.795284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:44.795284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:44.795284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:44.795284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:44.795284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:44.795284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:44.795284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:40:44.795284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:44.795850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22323e6-7363-4e59-97b7-bfd878c07789 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:44.795850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22323e6-7363-4e59-97b7-bfd878c07789 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:44.795850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22323e6-7363-4e59-97b7-bfd878c07789 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:44.803661 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 356/690] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:44.813139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c88a43-c68d-41d3-9f04-2cf18e270da4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:44.814410 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:44.823840 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 335/691] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Aug 2 08:40:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:44.824860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22323e6-7363-4e59-97b7-bfd878c07789 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:44.901396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:44.984103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22323e6-7363-4e59-97b7-bfd878c07789 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:44.994074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c88a43-c68d-41d3-9f04-2cf18e270da4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:45.028175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806a92-8994-4647-9585-34207d2bb73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:45.028816 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806a92-8994-4647-9585-34207d2bb73b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:45.029107 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806a92-8994-4647-9585-34207d2bb73b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:45.029387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806a92-8994-4647-9585-34207d2bb73b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:45.045320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0b738-f67e-47b5-810e-651c3517a041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:45.053544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0b738-f67e-47b5-810e-651c3517a041 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:45.054169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0b738-f67e-47b5-810e-651c3517a041 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:45.054664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0b738-f67e-47b5-810e-651c3517a041 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:45.055803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0b738-f67e-47b5-810e-651c3517a041 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:45.056330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0b738-f67e-47b5-810e-651c3517a041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:45.058860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0b738-f67e-47b5-810e-651c3517a041 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:45.085938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 357/692] 10.222.0.17 () {56 vars in 1135 bytes} [Tue Aug 2 08:40:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:45.087520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18fb5-5779-4d5b-ac4f-783c4d31e4b7 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:45.088091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18fb5-5779-4d5b-ac4f-783c4d31e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:45.088568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18fb5-5779-4d5b-ac4f-783c4d31e4b7 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:45.090316 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 358/693] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:45.095121 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18fb5-5779-4d5b-ac4f-783c4d31e4b7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:45.110909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:45.113669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5806a92-8994-4647-9585-34207d2bb73b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:45.115397 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5806a92-8994-4647-9585-34207d2bb73b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:45.215281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18fb5-5779-4d5b-ac4f-783c4d31e4b7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:45.217351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:45.235663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 336/694] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:45.237237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4f04-070a-4c74-93dc-435304ee4267 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:45.237537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4f04-070a-4c74-93dc-435304ee4267 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:45.237821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4f04-070a-4c74-93dc-435304ee4267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:45.255743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ce506-a3b9-47f0-81fa-370781f6d99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:45.256745 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ce506-a3b9-47f0-81fa-370781f6d99d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:45.257150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-af4b4f04-070a-4c74-93dc-435304ee4267 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:45.257541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ce506-a3b9-47f0-81fa-370781f6d99d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:45.258331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ce506-a3b9-47f0-81fa-370781f6d99d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:45.258635 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-af4b4f04-070a-4c74-93dc-435304ee4267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:45.334741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ce506-a3b9-47f0-81fa-370781f6d99d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:45.337415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ce506-a3b9-47f0-81fa-370781f6d99d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:45.338309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 337/695] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:45.339266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4f04-070a-4c74-93dc-435304ee4267 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:45.385231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:45.451038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 359/696] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:40:45.452257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ce506-a3b9-47f0-81fa-370781f6d99d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:45.456109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:45.472418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4f04-070a-4c74-93dc-435304ee4267 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:45.514234 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aa4cb-5495-4660-9d14-c92114dca558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:45.515200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aa4cb-5495-4660-9d14-c92114dca558 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:45.515697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aa4cb-5495-4660-9d14-c92114dca558 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:45.516163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aa4cb-5495-4660-9d14-c92114dca558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:45.528848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318aa4cb-5495-4660-9d14-c92114dca558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:45.530777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318aa4cb-5495-4660-9d14-c92114dca558 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-318aa4cb-5495-4660-9d14-c92114dca558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:45.548748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:45.549782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:45.550688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:45.550688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:45.550688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:45.550688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:45.557341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 338/697] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:45.558642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aa4cb-5495-4660-9d14-c92114dca558 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:45.567360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ce506-a3b9-47f0-81fa-370781f6d99d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:45.605416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7fb95-0ea6-4a30-81a2-e840c01393fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:45.606171 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7fb95-0ea6-4a30-81a2-e840c01393fe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:45.606544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7fb95-0ea6-4a30-81a2-e840c01393fe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:45.606899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7fb95-0ea6-4a30-81a2-e840c01393fe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:45.607640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7fb95-0ea6-4a30-81a2-e840c01393fe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:45.609172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7fb95-0ea6-4a30-81a2-e840c01393fe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f8b7fb95-0ea6-4a30-81a2-e840c01393fe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:45.620976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:45.621966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:40:45.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:45.627246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 360/698] 10.222.0.17 () {56 vars in 1129 bytes} [Tue Aug 2 08:40:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:45.628239 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7fb95-0ea6-4a30-81a2-e840c01393fe None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:45.674833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aa4cb-5495-4660-9d14-c92114dca558 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:45.688582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:45.716636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f48789-a6d1-434a-92ad-05049c2e0bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:45.717613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f48789-a6d1-434a-92ad-05049c2e0bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:45.718085 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f48789-a6d1-434a-92ad-05049c2e0bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:45.718577 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f48789-a6d1-434a-92ad-05049c2e0bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:45.731949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f48789-a6d1-434a-92ad-05049c2e0bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:45.733859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f48789-a6d1-434a-92ad-05049c2e0bb5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e9f48789-a6d1-434a-92ad-05049c2e0bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:45.750576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:45.751574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:45.752511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:45.752511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:45.752511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:45.752511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:45.755222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 339/699] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:45.756425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f48789-a6d1-434a-92ad-05049c2e0bb5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:45.828656 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:45.869407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7fb95-0ea6-4a30-81a2-e840c01393fe None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:45.874158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f48789-a6d1-434a-92ad-05049c2e0bb5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:45.905556 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dca36c-93f4-4e70-847c-f1b27f92ad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:45.906306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dca36c-93f4-4e70-847c-f1b27f92ad61 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:45.906870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dca36c-93f4-4e70-847c-f1b27f92ad61 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:45.907123 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dca36c-93f4-4e70-847c-f1b27f92ad61 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:45.907909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dca36c-93f4-4e70-847c-f1b27f92ad61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:45.908317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dca36c-93f4-4e70-847c-f1b27f92ad61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:45.909759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dca36c-93f4-4e70-847c-f1b27f92ad61 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:45.912839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a73c9-5a4d-4ae5-a1e2-cf523ad8bfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:45.913740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a73c9-5a4d-4ae5-a1e2-cf523ad8bfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:45.914846 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a73c9-5a4d-4ae5-a1e2-cf523ad8bfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:45.915309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a73c9-5a4d-4ae5-a1e2-cf523ad8bfd9 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:45.916300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a73c9-5a4d-4ae5-a1e2-cf523ad8bfd9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:45.916819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a73c9-5a4d-4ae5-a1e2-cf523ad8bfd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:45.918618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a73c9-5a4d-4ae5-a1e2-cf523ad8bfd9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:45.920379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:45.925302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 340/700] 10.222.0.17 () {56 vars in 1124 bytes} [Tue Aug 2 08:40:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:45.926574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a73c9-5a4d-4ae5-a1e2-cf523ad8bfd9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:45.930767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 361/701] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:45.932200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dca36c-93f4-4e70-847c-f1b27f92ad61 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:46.041915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dca36c-93f4-4e70-847c-f1b27f92ad61 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:46.042882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a73c9-5a4d-4ae5-a1e2-cf523ad8bfd9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:46.070209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:46.079558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775426f-bc83-4f49-8d16-8db9cf33c822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:46.080229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775426f-bc83-4f49-8d16-8db9cf33c822 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.080506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775426f-bc83-4f49-8d16-8db9cf33c822 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.080783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775426f-bc83-4f49-8d16-8db9cf33c822 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:46.081460 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775426f-bc83-4f49-8d16-8db9cf33c822 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:46.081767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775426f-bc83-4f49-8d16-8db9cf33c822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:46.082809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775b9e0-938e-43a4-a4a8-9a70f4b5fc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:46.083130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775426f-bc83-4f49-8d16-8db9cf33c822 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:46.084145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775b9e0-938e-43a4-a4a8-9a70f4b5fc74 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.084733 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775b9e0-938e-43a4-a4a8-9a70f4b5fc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.085212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775b9e0-938e-43a4-a4a8-9a70f4b5fc74 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:46.086620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775b9e0-938e-43a4-a4a8-9a70f4b5fc74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:46.087201 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775b9e0-938e-43a4-a4a8-9a70f4b5fc74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:46.088844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775b9e0-938e-43a4-a4a8-9a70f4b5fc74 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:46.092418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 362/702] 10.222.0.17 () {56 vars in 1124 bytes} [Tue Aug 2 08:40:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:46.093370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775426f-bc83-4f49-8d16-8db9cf33c822 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:46.107158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 341/703] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:46.109084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f55c1-9f95-4865-9601-29abe663b868 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.109637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f55c1-9f95-4865-9601-29abe663b868 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.110126 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f55c1-9f95-4865-9601-29abe663b868 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:46.112540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 342/704] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:46.113682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f55c1-9f95-4865-9601-29abe663b868 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:46.183925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:46.238120 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f55c1-9f95-4865-9601-29abe663b868 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:46.246486 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775426f-bc83-4f49-8d16-8db9cf33c822 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:46.279961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194ba92-9f8d-4e81-8ef8-c4b201e20b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:46.281665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194ba92-9f8d-4e81-8ef8-c4b201e20b4d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.282175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194ba92-9f8d-4e81-8ef8-c4b201e20b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.282664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194ba92-9f8d-4e81-8ef8-c4b201e20b4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:46.289612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1e0f4-44f4-47ca-ad1b-fb67c8870ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:46.290259 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1e0f4-44f4-47ca-ad1b-fb67c8870ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.290540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1e0f4-44f4-47ca-ad1b-fb67c8870ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.290815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1e0f4-44f4-47ca-ad1b-fb67c8870ad3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:46.293400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194ba92-9f8d-4e81-8ef8-c4b201e20b4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:46.294996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194ba92-9f8d-4e81-8ef8-c4b201e20b4d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:46.302976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1e0f4-44f4-47ca-ad1b-fb67c8870ad3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:46.305449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1e0f4-44f4-47ca-ad1b-fb67c8870ad3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-6194ba92-9f8d-4e81-8ef8-c4b201e20b4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:46.309935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:46.310868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:46.311732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:46.311732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:46.311732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:46.311732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:46.311732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:46.311732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:46.311732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:46.311732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:46.311732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 343/705] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:46.312705 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b822a-7018-412e-941d-3fe859765b65 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.312855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b822a-7018-412e-941d-3fe859765b65 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.317439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b822a-7018-412e-941d-3fe859765b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-77f1e0f4-44f4-47ca-ad1b-fb67c8870ad3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:46.318081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:46.318951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:46.319841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:46.319841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:46.319841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:46.319841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:46.319841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:46.319841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:46.319841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:46.319841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:46.319841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 363/706] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:46.324747 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1e0f4-44f4-47ca-ad1b-fb67c8870ad3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:46.396540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:46.443958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1e0f4-44f4-47ca-ad1b-fb67c8870ad3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:46.461502 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-406b822a-7018-412e-941d-3fe859765b65 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:46.463067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-406b822a-7018-412e-941d-3fe859765b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:46.480416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13875e8-91e3-4f6c-a105-fde276f2af9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:46.481043 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13875e8-91e3-4f6c-a105-fde276f2af9b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.481328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13875e8-91e3-4f6c-a105-fde276f2af9b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.481615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13875e8-91e3-4f6c-a105-fde276f2af9b None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:46.482421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13875e8-91e3-4f6c-a105-fde276f2af9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:46.482733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13875e8-91e3-4f6c-a105-fde276f2af9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:46.484264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13875e8-91e3-4f6c-a105-fde276f2af9b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:46.501981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 364/707] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:46.501981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13875e8-91e3-4f6c-a105-fde276f2af9b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:46.548464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 344/708] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:46.549994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b822a-7018-412e-941d-3fe859765b65 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:46.608207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13875e8-91e3-4f6c-a105-fde276f2af9b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:46.619095 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:46.619959 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:46.650312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea164d-a840-4fba-bc1b-3f80d919b8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:46.651044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea164d-a840-4fba-bc1b-3f80d919b8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.651870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea164d-a840-4fba-bc1b-3f80d919b8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.652270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea164d-a840-4fba-bc1b-3f80d919b8c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:46.653152 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea164d-a840-4fba-bc1b-3f80d919b8c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:46.654044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea164d-a840-4fba-bc1b-3f80d919b8c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:46.656414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea164d-a840-4fba-bc1b-3f80d919b8c8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:46.676201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 365/709] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:46.677349 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea164d-a840-4fba-bc1b-3f80d919b8c8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:46.686392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b822a-7018-412e-941d-3fe859765b65 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:46.734678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95539935-c1b5-4116-8afa-d5d05b16ef0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:46.735341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95539935-c1b5-4116-8afa-d5d05b16ef0e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.735693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95539935-c1b5-4116-8afa-d5d05b16ef0e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.736048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95539935-c1b5-4116-8afa-d5d05b16ef0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:46.736944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95539935-c1b5-4116-8afa-d5d05b16ef0e None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=d182c7050f0040559f69a231bee6dccf) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:46.737330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95539935-c1b5-4116-8afa-d5d05b16ef0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:46.739714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95539935-c1b5-4116-8afa-d5d05b16ef0e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:46.756154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 345/710] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:46 2022] GET /identity/v3/role_assignments?user.id=d182c7050f0040559f69a231bee6dccf&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:46.756154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95539935-c1b5-4116-8afa-d5d05b16ef0e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:46.844708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea164d-a840-4fba-bc1b-3f80d919b8c8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:46.883698 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fb4f2-2823-4528-b429-b8c1b8d05e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:46.884013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fb4f2-2823-4528-b429-b8c1b8d05e9b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.884324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fb4f2-2823-4528-b429-b8c1b8d05e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.884608 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fb4f2-2823-4528-b429-b8c1b8d05e9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:46.899748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fb4f2-2823-4528-b429-b8c1b8d05e9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:46.901004 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fb4f2-2823-4528-b429-b8c1b8d05e9b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6a0fb4f2-2823-4528-b429-b8c1b8d05e9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:46.918007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:46.918981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:46.919862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:46.919862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:46.919862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:46.919862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:46.924397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 366/711] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:46.925798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5750a-f164-4a19-bf06-7c781263446d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.926089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5750a-f164-4a19-bf06-7c781263446d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.926372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5750a-f164-4a19-bf06-7c781263446d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:46.927442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95539935-c1b5-4116-8afa-d5d05b16ef0e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:46.932264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 367/712] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:46.933198 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5750a-f164-4a19-bf06-7c781263446d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:46.945362 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:46.964614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:46.978726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d87e71-13f0-45e9-8a93-d66be7c047b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:46.979640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87e71-13f0-45e9-8a93-d66be7c047b3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.980026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87e71-13f0-45e9-8a93-d66be7c047b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.980628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87e71-13f0-45e9-8a93-d66be7c047b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:46.982368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d87e71-13f0-45e9-8a93-d66be7c047b3 None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=e1de289ba7ae4140a421127b8f18901f) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:46.982748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d87e71-13f0-45e9-8a93-d66be7c047b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:46.985059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d87e71-13f0-45e9-8a93-d66be7c047b3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:46.993346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 346/713] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:46 2022] GET /identity/v3/role_assignments?user.id=e1de289ba7ae4140a421127b8f18901f&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:46.994387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da050e-e73c-42ce-80be-b27e74dc9343 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:46.994681 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da050e-e73c-42ce-80be-b27e74dc9343 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:46.994965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da050e-e73c-42ce-80be-b27e74dc9343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:47.023866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-14da050e-e73c-42ce-80be-b27e74dc9343 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:47.026313 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-14da050e-e73c-42ce-80be-b27e74dc9343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:47.069229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5750a-f164-4a19-bf06-7c781263446d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:47.115862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c624f-e322-4d87-928f-709cd48272aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:47.116788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c624f-e322-4d87-928f-709cd48272aa None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:47.117211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c624f-e322-4d87-928f-709cd48272aa None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:47.117620 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c624f-e322-4d87-928f-709cd48272aa None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:47.120067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c624f-e322-4d87-928f-709cd48272aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:47.120528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c624f-e322-4d87-928f-709cd48272aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:47.122309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c624f-e322-4d87-928f-709cd48272aa None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:47.128394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 347/714] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:47.149757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da050e-e73c-42ce-80be-b27e74dc9343 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:47.153790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 368/715] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:47.167106 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c624f-e322-4d87-928f-709cd48272aa None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:47.272800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da050e-e73c-42ce-80be-b27e74dc9343 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:47.282180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:47.287561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:47.311821 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c624f-e322-4d87-928f-709cd48272aa None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:47.312007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e304f1-52d8-4b16-a11e-e9d899dc99fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:47.312594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e304f1-52d8-4b16-a11e-e9d899dc99fb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:47.312883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e304f1-52d8-4b16-a11e-e9d899dc99fb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:47.313160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e304f1-52d8-4b16-a11e-e9d899dc99fb None admin] PATH_INFO: `/v3/services/network` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:47.313789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e304f1-52d8-4b16-a11e-e9d899dc99fb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:47.315162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e304f1-52d8-4b16-a11e-e9d899dc99fb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-24e304f1-52d8-4b16-a11e-e9d899dc99fb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:47.327329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:47.328418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:47.329527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 348/716] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:47 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:47.341225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e304f1-52d8-4b16-a11e-e9d899dc99fb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:47.366356 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6063680-1f9a-43fb-9380-d6ae90323499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:47.367036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6063680-1f9a-43fb-9380-d6ae90323499 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:47.367373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6063680-1f9a-43fb-9380-d6ae90323499 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:47.367652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6063680-1f9a-43fb-9380-d6ae90323499 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:47.368399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6063680-1f9a-43fb-9380-d6ae90323499 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:47.369887 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6063680-1f9a-43fb-9380-d6ae90323499 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:47.422505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 369/717] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:40:47 2022] POST /identity/v3/users => generated 254 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:40:47.500834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e304f1-52d8-4b16-a11e-e9d899dc99fb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:47.541124 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ccf4b-aada-4fa0-ab73-92b18ee95fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:47.541865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ccf4b-aada-4fa0-ab73-92b18ee95fcd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:47.542150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ccf4b-aada-4fa0-ab73-92b18ee95fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:47.542428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ccf4b-aada-4fa0-ab73-92b18ee95fcd None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:47.543145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ccf4b-aada-4fa0-ab73-92b18ee95fcd None admin] RBAC: Adding query filter params (name=network) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:47.543457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ccf4b-aada-4fa0-ab73-92b18ee95fcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:47.545027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ccf4b-aada-4fa0-ab73-92b18ee95fcd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:47.550662 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 349/718] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:40:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:47.557137 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6063680-1f9a-43fb-9380-d6ae90323499 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:47.671512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6063680-1f9a-43fb-9380-d6ae90323499 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:47.707753 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e30a85-cd5a-433a-a514-14a08a28cc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:47.708411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e30a85-cd5a-433a-a514-14a08a28cc34 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:47.708943 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e30a85-cd5a-433a-a514-14a08a28cc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:47.709216 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e30a85-cd5a-433a-a514-14a08a28cc34 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:47.709898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e30a85-cd5a-433a-a514-14a08a28cc34 None admin] RBAC: Adding query filter params (type=network) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:47.710202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e30a85-cd5a-433a-a514-14a08a28cc34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:47.711680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e30a85-cd5a-433a-a514-14a08a28cc34 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:47.719079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 370/719] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:40:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:48.406623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a771f66-e684-4328-a1b0-055a90ac4cab None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:48.407032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a771f66-e684-4328-a1b0-055a90ac4cab None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:48.407210 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a771f66-e684-4328-a1b0-055a90ac4cab None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:48.408861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 350/720] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:48.415100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92097f1-3512-4d45-ba3a-10018acd37ab None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:48.415501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92097f1-3512-4d45-ba3a-10018acd37ab None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:48.415898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92097f1-3512-4d45-ba3a-10018acd37ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:48.423053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:48.441949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e92097f1-3512-4d45-ba3a-10018acd37ab None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:48.443173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e92097f1-3512-4d45-ba3a-10018acd37ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:48.532910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 371/721] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:48.565413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a771f66-e684-4328-a1b0-055a90ac4cab None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:48.613797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:48.709515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a771f66-e684-4328-a1b0-055a90ac4cab None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:48.759570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abcc3e-7592-4015-9f7f-7bc79c019145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:48.760218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abcc3e-7592-4015-9f7f-7bc79c019145 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:48.760500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abcc3e-7592-4015-9f7f-7bc79c019145 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:48.760768 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abcc3e-7592-4015-9f7f-7bc79c019145 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:48.761460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abcc3e-7592-4015-9f7f-7bc79c019145 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:48.762980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abcc3e-7592-4015-9f7f-7bc79c019145 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:48.787869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 351/722] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:40:48 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:40:49.317788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa240d2-1c21-4bb3-8472-b2f2797ea2e0 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:49.318523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa240d2-1c21-4bb3-8472-b2f2797ea2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:49.319055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa240d2-1c21-4bb3-8472-b2f2797ea2e0 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:49.321484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 372/723] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:49.326811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bb95d-4ead-45e5-abec-03c60e13e6ff None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:49.327432 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bb95d-4ead-45e5-abec-03c60e13e6ff None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:49.327912 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bb95d-4ead-45e5-abec-03c60e13e6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:49.357190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4d1bb95d-4ead-45e5-abec-03c60e13e6ff None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:49.358749 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4d1bb95d-4ead-45e5-abec-03c60e13e6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:49.462329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 352/724] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:49.502609 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa240d2-1c21-4bb3-8472-b2f2797ea2e0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:49.525737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef841fd7-bcaa-4eff-a7f5-6b3aab3746fc None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:49.526396 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef841fd7-bcaa-4eff-a7f5-6b3aab3746fc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:49.526897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef841fd7-bcaa-4eff-a7f5-6b3aab3746fc None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:49.528481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 353/725] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:49.551673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb113ab8-fcee-4a44-a494-1b4305f85b6c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:49.552377 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb113ab8-fcee-4a44-a494-1b4305f85b6c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:49.552864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb113ab8-fcee-4a44-a494-1b4305f85b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:49.583403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fb113ab8-fcee-4a44-a494-1b4305f85b6c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:49.587201 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fb113ab8-fcee-4a44-a494-1b4305f85b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:49.613390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:49.698164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa240d2-1c21-4bb3-8472-b2f2797ea2e0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:49.722944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 354/726] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:40:49.743058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:49.754445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc278337-e50d-4906-b107-8892893429f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:49.755126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278337-e50d-4906-b107-8892893429f9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:49.755433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278337-e50d-4906-b107-8892893429f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:49.755728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278337-e50d-4906-b107-8892893429f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:49.767026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb113ab8-fcee-4a44-a494-1b4305f85b6c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:49.784245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc278337-e50d-4906-b107-8892893429f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-fc278337-e50d-4906-b107-8892893429f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:49.792621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:49.794117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:49.795582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 373/727] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:49.803182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc278337-e50d-4906-b107-8892893429f9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:49.993979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb113ab8-fcee-4a44-a494-1b4305f85b6c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:50.011699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc278337-e50d-4906-b107-8892893429f9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:50.066997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040f85-52da-4065-bebe-1f32c2e905b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:50.068370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040f85-52da-4065-bebe-1f32c2e905b2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.069342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040f85-52da-4065-bebe-1f32c2e905b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.070795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6c3f1-76df-4f8f-8b90-ef155ce99c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:50.071391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040f85-52da-4065-bebe-1f32c2e905b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.072712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6c3f1-76df-4f8f-8b90-ef155ce99c3b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.073376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6c3f1-76df-4f8f-8b90-ef155ce99c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.074954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6c3f1-76df-4f8f-8b90-ef155ce99c3b None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.075877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6c3f1-76df-4f8f-8b90-ef155ce99c3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:50.076632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6c3f1-76df-4f8f-8b90-ef155ce99c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:50.078844 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6c3f1-76df-4f8f-8b90-ef155ce99c3b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:50.093387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a040f85-52da-4065-bebe-1f32c2e905b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-6a040f85-52da-4065-bebe-1f32c2e905b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:50.099429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:50.100387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:50.101296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:50.101296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:50.101296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:50.101296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:50.101296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:50.101296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:50.101296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:50.101296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:50.101296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:50.101296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:50.101296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:50.101296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:50.102030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 374/728] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:50.104113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 355/729] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:50.105128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6c3f1-76df-4f8f-8b90-ef155ce99c3b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:50.110645 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040f85-52da-4065-bebe-1f32c2e905b2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:50.133477 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:50.222975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:50.276845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040f85-52da-4065-bebe-1f32c2e905b2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:50.290061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6c3f1-76df-4f8f-8b90-ef155ce99c3b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:50.321324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61722b60-9667-4c31-b2cd-7ecbdb16f7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:50.321944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61722b60-9667-4c31-b2cd-7ecbdb16f7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.322307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61722b60-9667-4c31-b2cd-7ecbdb16f7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.322596 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61722b60-9667-4c31-b2cd-7ecbdb16f7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.323781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61722b60-9667-4c31-b2cd-7ecbdb16f7c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:50.323781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61722b60-9667-4c31-b2cd-7ecbdb16f7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:50.324924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61722b60-9667-4c31-b2cd-7ecbdb16f7c5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:50.329394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfcf48-af15-4c47-a8b3-e38d9f414a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:50.330029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfcf48-af15-4c47-a8b3-e38d9f414a2d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.330767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfcf48-af15-4c47-a8b3-e38d9f414a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.331061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfcf48-af15-4c47-a8b3-e38d9f414a2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.333932 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 356/730] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:50.335144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc6c55-8a2c-430f-b130-3f9f029129a0 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.336793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc6c55-8a2c-430f-b130-3f9f029129a0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.337065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc6c55-8a2c-430f-b130-3f9f029129a0 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.342889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 357/731] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:50.342889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0448b-594d-45e8-b06c-f002629e7f2f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.342889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0448b-594d-45e8-b06c-f002629e7f2f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.342889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0448b-594d-45e8-b06c-f002629e7f2f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.342889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 358/732] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:50.342889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0448b-594d-45e8-b06c-f002629e7f2f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:50.352282 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfcf48-af15-4c47-a8b3-e38d9f414a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:50.353846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfcf48-af15-4c47-a8b3-e38d9f414a2d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-82dfcf48-af15-4c47-a8b3-e38d9f414a2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:50.370830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:50.376859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:50.377892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:50.377892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:50.377892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:50.377892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:50.377892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 375/733] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:50.377892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e722c2-8d77-413b-98d7-5f4ea0588c60 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.377892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e722c2-8d77-413b-98d7-5f4ea0588c60 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.377892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e722c2-8d77-413b-98d7-5f4ea0588c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.393385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-09e722c2-8d77-413b-98d7-5f4ea0588c60 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:50.394593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-09e722c2-8d77-413b-98d7-5f4ea0588c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:50.425649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:50.460547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0448b-594d-45e8-b06c-f002629e7f2f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:50.480151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 376/734] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:50.480151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658019-fa2c-4c25-8869-b16d18dcb5d3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.480151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658019-fa2c-4c25-8869-b16d18dcb5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.480151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658019-fa2c-4c25-8869-b16d18dcb5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.498014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cd658019-fa2c-4c25-8869-b16d18dcb5d3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:50.498887 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cd658019-fa2c-4c25-8869-b16d18dcb5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:50.513531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d92f-5e39-4cbb-b372-72795fd25c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:50.514256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d92f-5e39-4cbb-b372-72795fd25c55 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.514613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d92f-5e39-4cbb-b372-72795fd25c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.514784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d92f-5e39-4cbb-b372-72795fd25c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.526230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d92f-5e39-4cbb-b372-72795fd25c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:50.527717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d92f-5e39-4cbb-b372-72795fd25c55 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:50.535875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-4650d92f-5e39-4cbb-b372-72795fd25c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:50.543148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:50.544335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:50.545512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:50.545512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:50.545512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:50.545512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:50.545761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 359/735] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:50.546381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d92f-5e39-4cbb-b372-72795fd25c55 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:50.584573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 377/736] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:40:50.586172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658019-fa2c-4c25-8869-b16d18dcb5d3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:50.664329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d92f-5e39-4cbb-b372-72795fd25c55 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:50.688833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:50.699585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658019-fa2c-4c25-8869-b16d18dcb5d3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:50.699926 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52d49d-150b-4643-b8a0-8f125bc2287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:50.700594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52d49d-150b-4643-b8a0-8f125bc2287f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.700873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52d49d-150b-4643-b8a0-8f125bc2287f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.701151 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52d49d-150b-4643-b8a0-8f125bc2287f None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.701847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52d49d-150b-4643-b8a0-8f125bc2287f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:50.702191 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52d49d-150b-4643-b8a0-8f125bc2287f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:50.703518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52d49d-150b-4643-b8a0-8f125bc2287f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:50.716166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 360/737] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:50.721434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52d49d-150b-4643-b8a0-8f125bc2287f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:50.747920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e7414-715f-45d4-aab3-a7ccb779bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:50.748574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e7414-715f-45d4-aab3-a7ccb779bde3 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.748853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e7414-715f-45d4-aab3-a7ccb779bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.749127 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e7414-715f-45d4-aab3-a7ccb779bde3 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.749965 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e7414-715f-45d4-aab3-a7ccb779bde3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:50.751330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e7414-715f-45d4-aab3-a7ccb779bde3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:50.780238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 378/738] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:40:50 2022] POST /identity/v3/services => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:40:50.780238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e7414-715f-45d4-aab3-a7ccb779bde3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:50.811689 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:50.861292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52d49d-150b-4643-b8a0-8f125bc2287f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:50.906294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b15d0d-b3a2-4ab9-a0e8-d01da1214fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:50.906957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b15d0d-b3a2-4ab9-a0e8-d01da1214fbe None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.907342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b15d0d-b3a2-4ab9-a0e8-d01da1214fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.907628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b15d0d-b3a2-4ab9-a0e8-d01da1214fbe None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.908267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e7414-715f-45d4-aab3-a7ccb779bde3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:50.908377 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b15d0d-b3a2-4ab9-a0e8-d01da1214fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:50.908655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b15d0d-b3a2-4ab9-a0e8-d01da1214fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:50.910054 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b15d0d-b3a2-4ab9-a0e8-d01da1214fbe None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:50.925534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 361/739] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:50.926430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b15d0d-b3a2-4ab9-a0e8-d01da1214fbe None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:50.956274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7894c4-9b3a-45a4-8b15-08f2ef0be6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:50.956955 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7894c4-9b3a-45a4-8b15-08f2ef0be6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:50.957506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7894c4-9b3a-45a4-8b15-08f2ef0be6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:50.957915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7894c4-9b3a-45a4-8b15-08f2ef0be6b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:50.973869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:50.974774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7894c4-9b3a-45a4-8b15-08f2ef0be6b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-2e7894c4-9b3a-45a4-8b15-08f2ef0be6b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:50.981089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:50.982050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:50.982904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 379/740] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:50.983629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7894c4-9b3a-45a4-8b15-08f2ef0be6b1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:51.044405 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b15d0d-b3a2-4ab9-a0e8-d01da1214fbe None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:51.082006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a346b-ca96-4edd-835b-4d1c32822e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:51.082749 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a346b-ca96-4edd-835b-4d1c32822e44 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:51.083110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a346b-ca96-4edd-835b-4d1c32822e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:51.083774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a346b-ca96-4edd-835b-4d1c32822e44 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:51.092353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a346b-ca96-4edd-835b-4d1c32822e44 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:51.093980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a346b-ca96-4edd-835b-4d1c32822e44 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:51.095977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-027a346b-ca96-4edd-835b-4d1c32822e44 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:51.107830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:51.108826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:51.109785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:51.109785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:51.109785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:51.109785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:51.109785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:51.109785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:51.109785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:51.109785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:51.109785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:40:51.109785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:51.111907 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 362/741] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Aug 2 08:40:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:51.112862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a346b-ca96-4edd-835b-4d1c32822e44 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:51.119022 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7894c4-9b3a-45a4-8b15-08f2ef0be6b1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:51.159201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd810f7e-a3b7-414f-87df-98d9cc021b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:51.160054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd810f7e-a3b7-414f-87df-98d9cc021b23 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:51.160496 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd810f7e-a3b7-414f-87df-98d9cc021b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:51.160900 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd810f7e-a3b7-414f-87df-98d9cc021b23 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:51.170352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd810f7e-a3b7-414f-87df-98d9cc021b23 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:51.172014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd810f7e-a3b7-414f-87df-98d9cc021b23 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-fd810f7e-a3b7-414f-87df-98d9cc021b23 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:51.185395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:51.186549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:51.187731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:51.187731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:51.187731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:51.187731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:51.187731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:51.187731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:51.187731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:51.187731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:51.187731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:40:51.187731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:51.189610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 380/742] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:51.190495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd810f7e-a3b7-414f-87df-98d9cc021b23 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:51.222405 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:51.225494 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a346b-ca96-4edd-835b-4d1c32822e44 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:51.261248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6ea87-bd6c-49f3-b957-56770c3c58ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:51.262108 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6ea87-bd6c-49f3-b957-56770c3c58ed None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:51.262566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6ea87-bd6c-49f3-b957-56770c3c58ed None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:51.263171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6ea87-bd6c-49f3-b957-56770c3c58ed None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:51.264044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6ea87-bd6c-49f3-b957-56770c3c58ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:51.264514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6ea87-bd6c-49f3-b957-56770c3c58ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:51.266032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6ea87-bd6c-49f3-b957-56770c3c58ed None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:51.276257 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 363/743] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:51.277398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6ea87-bd6c-49f3-b957-56770c3c58ed None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:51.308237 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd810f7e-a3b7-414f-87df-98d9cc021b23 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:51.345580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d67fa9-9bb5-49cb-bab2-3665d9183041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:51.346410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d67fa9-9bb5-49cb-bab2-3665d9183041 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:51.346595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d67fa9-9bb5-49cb-bab2-3665d9183041 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:51.346844 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d67fa9-9bb5-49cb-bab2-3665d9183041 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:51.347639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d67fa9-9bb5-49cb-bab2-3665d9183041 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:51.348011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d67fa9-9bb5-49cb-bab2-3665d9183041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:51.349409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d67fa9-9bb5-49cb-bab2-3665d9183041 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:51.368574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 381/744] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Aug 2 08:40:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:51.369421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d67fa9-9bb5-49cb-bab2-3665d9183041 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:51.375002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:51.396805 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6ea87-bd6c-49f3-b957-56770c3c58ed None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:51.436533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff310f7-3f79-4563-93f6-2cc516276f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:51.437950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff310f7-3f79-4563-93f6-2cc516276f2f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:51.438485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff310f7-3f79-4563-93f6-2cc516276f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:51.438868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff310f7-3f79-4563-93f6-2cc516276f2f None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:51.439672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff310f7-3f79-4563-93f6-2cc516276f2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:51.440006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff310f7-3f79-4563-93f6-2cc516276f2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:51.441445 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff310f7-3f79-4563-93f6-2cc516276f2f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:51.459873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 364/745] 10.222.0.17 () {56 vars in 1135 bytes} [Tue Aug 2 08:40:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:51.465672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfb54d-6158-4006-97f9-e08bbd08316d None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:51.465962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfb54d-6158-4006-97f9-e08bbd08316d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:51.466243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfb54d-6158-4006-97f9-e08bbd08316d None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:51.467523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 365/746] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:51.468263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfb54d-6158-4006-97f9-e08bbd08316d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:51.488850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d67fa9-9bb5-49cb-bab2-3665d9183041 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:51.492419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:51.529041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cffd7b-7b6d-4e1d-9a67-ac9d2f772aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:51.529682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cffd7b-7b6d-4e1d-9a67-ac9d2f772aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:51.529960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cffd7b-7b6d-4e1d-9a67-ac9d2f772aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:51.530232 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cffd7b-7b6d-4e1d-9a67-ac9d2f772aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:51.541583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cffd7b-7b6d-4e1d-9a67-ac9d2f772aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:51.543156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cffd7b-7b6d-4e1d-9a67-ac9d2f772aa3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-92cffd7b-7b6d-4e1d-9a67-ac9d2f772aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:51.558776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:51.559695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:51.560721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:51.560721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:51.560721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:51.560721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:51.560721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 382/747] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:51.560721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cffd7b-7b6d-4e1d-9a67-ac9d2f772aa3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:51.588236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfb54d-6158-4006-97f9-e08bbd08316d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:51.621551 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:51.626860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda72c25-c0d4-4f8d-8691-7f61406c4e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:51.627506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda72c25-c0d4-4f8d-8691-7f61406c4e27 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:51.627784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda72c25-c0d4-4f8d-8691-7f61406c4e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:51.628060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda72c25-c0d4-4f8d-8691-7f61406c4e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:51.639302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda72c25-c0d4-4f8d-8691-7f61406c4e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:51.640771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda72c25-c0d4-4f8d-8691-7f61406c4e27 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-eda72c25-c0d4-4f8d-8691-7f61406c4e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:51.656325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:51.657239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:51.663037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:51.663037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:51.663037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:51.663037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:51.663037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 366/748] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:51.663037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f98a1-e458-4323-a3c7-780c12e719ed None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:51.663037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f98a1-e458-4323-a3c7-780c12e719ed None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:51.663037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f98a1-e458-4323-a3c7-780c12e719ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:51.677354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-058f98a1-e458-4323-a3c7-780c12e719ed None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:51.677944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cffd7b-7b6d-4e1d-9a67-ac9d2f772aa3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:51.678523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-058f98a1-e458-4323-a3c7-780c12e719ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:51.717153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a10203-8cc8-4c6b-84b1-b91e808cbee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:51.717778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a10203-8cc8-4c6b-84b1-b91e808cbee9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:51.718067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a10203-8cc8-4c6b-84b1-b91e808cbee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:51.718351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a10203-8cc8-4c6b-84b1-b91e808cbee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:51.752195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 367/749] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:40:51.752195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f98a1-e458-4323-a3c7-780c12e719ed None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:51.752902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:51.797932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a10203-8cc8-4c6b-84b1-b91e808cbee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:51.801559 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a10203-8cc8-4c6b-84b1-b91e808cbee9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:51.867328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:51.877804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f98a1-e458-4323-a3c7-780c12e719ed None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:51.916886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc6ab-cdbf-477b-ab7b-cd8e0e479918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:51.917515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc6ab-cdbf-477b-ab7b-cd8e0e479918 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:51.917859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc6ab-cdbf-477b-ab7b-cd8e0e479918 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:51.918135 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc6ab-cdbf-477b-ab7b-cd8e0e479918 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:51.918853 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfc6ab-cdbf-477b-ab7b-cd8e0e479918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:51.924244 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfc6ab-cdbf-477b-ab7b-cd8e0e479918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:51.924386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 383/750] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:40:51.924386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a10203-8cc8-4c6b-84b1-b91e808cbee9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:51.924571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfc6ab-cdbf-477b-ab7b-cd8e0e479918 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:51.936157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 368/751] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:51.936956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc6ab-cdbf-477b-ab7b-cd8e0e479918 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:52.002366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:52.043165 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a10203-8cc8-4c6b-84b1-b91e808cbee9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:52.047126 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc6ab-cdbf-477b-ab7b-cd8e0e479918 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:52.082464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32d9de-a932-4b5a-8c73-818bf9312da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:52.083128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32d9de-a932-4b5a-8c73-818bf9312da7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:52.083411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32d9de-a932-4b5a-8c73-818bf9312da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:52.083800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becec0b-46df-4dfe-86d9-4268c0550f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:52.083951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32d9de-a932-4b5a-8c73-818bf9312da7 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:52.084358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becec0b-46df-4dfe-86d9-4268c0550f4c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:52.084642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becec0b-46df-4dfe-86d9-4268c0550f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:52.084737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32d9de-a932-4b5a-8c73-818bf9312da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:52.084919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becec0b-46df-4dfe-86d9-4268c0550f4c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:52.085027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32d9de-a932-4b5a-8c73-818bf9312da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:52.085577 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becec0b-46df-4dfe-86d9-4268c0550f4c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:52.086418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32d9de-a932-4b5a-8c73-818bf9312da7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:52.086924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becec0b-46df-4dfe-86d9-4268c0550f4c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9becec0b-46df-4dfe-86d9-4268c0550f4c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:52.096873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:52.098056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:40:52.099094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:52.102964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 384/752] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:52.103424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 369/753] 10.222.0.17 () {56 vars in 1129 bytes} [Tue Aug 2 08:40:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:52.103882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32d9de-a932-4b5a-8c73-818bf9312da7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:52.104398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becec0b-46df-4dfe-86d9-4268c0550f4c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:52.127156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:52.211571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becec0b-46df-4dfe-86d9-4268c0550f4c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:52.216457 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32d9de-a932-4b5a-8c73-818bf9312da7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:52.239754 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:52.251108 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577535-406b-4c1e-9d54-7662d9148f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:52.251896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577535-406b-4c1e-9d54-7662d9148f26 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:52.252226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577535-406b-4c1e-9d54-7662d9148f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:52.252515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577535-406b-4c1e-9d54-7662d9148f26 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:52.253567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b00a3-af95-4117-aa62-dae981dbcf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:52.254361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b00a3-af95-4117-aa62-dae981dbcf34 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:52.254471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b00a3-af95-4117-aa62-dae981dbcf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:52.254736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b00a3-af95-4117-aa62-dae981dbcf34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:52.260766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9577535-406b-4c1e-9d54-7662d9148f26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:52.262196 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9577535-406b-4c1e-9d54-7662d9148f26 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:52.266131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b00a3-af95-4117-aa62-dae981dbcf34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:52.267555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b00a3-af95-4117-aa62-dae981dbcf34 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d9577535-406b-4c1e-9d54-7662d9148f26 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:52.275228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:52.276404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:52.277636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:52.277636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:52.277636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:52.277636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:52.277636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:52.277636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:52.277636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:52.277636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:52.277636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:40:52.277636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:52.277636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 370/754] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Aug 2 08:40:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:52.278385 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577535-406b-4c1e-9d54-7662d9148f26 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-852b00a3-af95-4117-aa62-dae981dbcf34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:52.286681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:52.287783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:52.288817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:52.288817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:52.288817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:52.288817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:52.292625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 385/755] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:52.293391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b00a3-af95-4117-aa62-dae981dbcf34 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:52.365336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:52.396170 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577535-406b-4c1e-9d54-7662d9148f26 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:52.402884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b00a3-af95-4117-aa62-dae981dbcf34 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:52.432931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c76f9-fffa-46c8-8903-97ebca933c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:52.433795 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c76f9-fffa-46c8-8903-97ebca933c77 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:52.434082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c76f9-fffa-46c8-8903-97ebca933c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:52.434543 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c76f9-fffa-46c8-8903-97ebca933c77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:52.439613 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b6548-17ce-4451-b7e8-82dd45615e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:52.440256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b6548-17ce-4451-b7e8-82dd45615e1e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:52.440538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b6548-17ce-4451-b7e8-82dd45615e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:52.440806 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b6548-17ce-4451-b7e8-82dd45615e1e None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:52.441479 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b6548-17ce-4451-b7e8-82dd45615e1e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:52.441740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c76f9-fffa-46c8-8903-97ebca933c77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:52.441841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b6548-17ce-4451-b7e8-82dd45615e1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:52.443132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b6548-17ce-4451-b7e8-82dd45615e1e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:52.443243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c76f9-fffa-46c8-8903-97ebca933c77 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:52.452577 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 386/756] 10.222.0.17 () {56 vars in 1124 bytes} [Tue Aug 2 08:40:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:52.452577 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b6548-17ce-4451-b7e8-82dd45615e1e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-198c76f9-fffa-46c8-8903-97ebca933c77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:52.458448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:52.459613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:52.461163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:52.461163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:52.461163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:52.461163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:52.461163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:52.461163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:52.461163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:52.461163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:52.461163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 371/757] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:52.465337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c76f9-fffa-46c8-8903-97ebca933c77 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:52.516027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:52.569534 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b6548-17ce-4451-b7e8-82dd45615e1e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:52.579014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c76f9-fffa-46c8-8903-97ebca933c77 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:52.600508 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:52.607579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05289bc-0633-4c43-8e10-f9d264fa48df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:52.608250 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05289bc-0633-4c43-8e10-f9d264fa48df None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:52.608535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05289bc-0633-4c43-8e10-f9d264fa48df None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:52.608807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05289bc-0633-4c43-8e10-f9d264fa48df None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:52.609598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05289bc-0633-4c43-8e10-f9d264fa48df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:52.609903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05289bc-0633-4c43-8e10-f9d264fa48df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:52.611325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05289bc-0633-4c43-8e10-f9d264fa48df None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:52.616710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4a820-ca6b-4d18-81bb-9f37d871c4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:52.617909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4a820-ca6b-4d18-81bb-9f37d871c4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:52.618190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4a820-ca6b-4d18-81bb-9f37d871c4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:52.618466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4a820-ca6b-4d18-81bb-9f37d871c4c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:52.619329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4a820-ca6b-4d18-81bb-9f37d871c4c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:52.619637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4a820-ca6b-4d18-81bb-9f37d871c4c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:52.621023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4a820-ca6b-4d18-81bb-9f37d871c4c4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:52.630098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 387/758] 10.222.0.17 () {56 vars in 1149 bytes} [Tue Aug 2 08:40:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:52.631003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05289bc-0633-4c43-8e10-f9d264fa48df None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:52.637156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 372/759] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:52.638311 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4a820-ca6b-4d18-81bb-9f37d871c4c4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:52.741567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05289bc-0633-4c43-8e10-f9d264fa48df None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:52.748673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4a820-ca6b-4d18-81bb-9f37d871c4c4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:52.756597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:52.784961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca4dec-70ab-4df8-b07e-a0554fa743b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:52.785571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca4dec-70ab-4df8-b07e-a0554fa743b6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:52.785854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca4dec-70ab-4df8-b07e-a0554fa743b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:52.786141 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca4dec-70ab-4df8-b07e-a0554fa743b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:52.786872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca4dec-70ab-4df8-b07e-a0554fa743b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:52.787184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca4dec-70ab-4df8-b07e-a0554fa743b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:52.788601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb261a8-5532-48e8-8e61-c9147c138b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:52.788756 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca4dec-70ab-4df8-b07e-a0554fa743b6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:52.789591 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb261a8-5532-48e8-8e61-c9147c138b5a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:52.790246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb261a8-5532-48e8-8e61-c9147c138b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:52.790727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb261a8-5532-48e8-8e61-c9147c138b5a None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:52.791980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb261a8-5532-48e8-8e61-c9147c138b5a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:52.792526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb261a8-5532-48e8-8e61-c9147c138b5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:52.794089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb261a8-5532-48e8-8e61-c9147c138b5a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:52.801715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 388/760] 10.222.0.17 () {56 vars in 1124 bytes} [Tue Aug 2 08:40:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:52.801715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb261a8-5532-48e8-8e61-c9147c138b5a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:52.805797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 373/761] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:52.806888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca4dec-70ab-4df8-b07e-a0554fa743b6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:52.866155 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:52.919793 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb261a8-5532-48e8-8e61-c9147c138b5a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:52.921578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca4dec-70ab-4df8-b07e-a0554fa743b6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:52.957479 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877637c-4b09-44d9-bce9-b89387a14229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:52.958098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877637c-4b09-44d9-bce9-b89387a14229 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:52.958380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877637c-4b09-44d9-bce9-b89387a14229 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:52.958750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a9a6b-7fb5-475b-81c4-693f1b95f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:52.958929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877637c-4b09-44d9-bce9-b89387a14229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:52.959335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a9a6b-7fb5-475b-81c4-693f1b95f2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:52.959614 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a9a6b-7fb5-475b-81c4-693f1b95f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:52.959886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a9a6b-7fb5-475b-81c4-693f1b95f2e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:52.966508 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a9a6b-7fb5-475b-81c4-693f1b95f2e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:52.967936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a9a6b-7fb5-475b-81c4-693f1b95f2e0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-cf2a9a6b-7fb5-475b-81c4-693f1b95f2e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:52.978962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:52.979863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:52.980810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:52.980810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:52.980810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:52.980810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:52.980810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:52.980810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:52.980810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:52.980810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:52.980810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 374/762] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:52.981319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a9a6b-7fb5-475b-81c4-693f1b95f2e0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:53.010563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:53.029052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877637c-4b09-44d9-bce9-b89387a14229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:53.030498 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877637c-4b09-44d9-bce9-b89387a14229 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:53.084393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:53.086813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a9a6b-7fb5-475b-81c4-693f1b95f2e0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:53.122910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33211c-593e-4a8a-8aae-3cdd7361683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:53.123524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33211c-593e-4a8a-8aae-3cdd7361683f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:53.123806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33211c-593e-4a8a-8aae-3cdd7361683f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:53.124076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33211c-593e-4a8a-8aae-3cdd7361683f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:53.124856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33211c-593e-4a8a-8aae-3cdd7361683f None admin] RBAC: Adding query filter params (interface=public, service_id=72defcff4b944efb86f2f895c4ecbc7e, region_id=RegionOne) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:53.125168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33211c-593e-4a8a-8aae-3cdd7361683f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:53.126844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33211c-593e-4a8a-8aae-3cdd7361683f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:53.132956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 389/763] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:40:53.133782 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877637c-4b09-44d9-bce9-b89387a14229 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:53.134840 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 375/764] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Aug 2 08:40:52 2022] GET /identity/v3/endpoints?service_id=72defcff4b944efb86f2f895c4ecbc7e&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:53.137391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9baf3-fa6f-4422-8a36-cb0848a03703 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:53.137685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9baf3-fa6f-4422-8a36-cb0848a03703 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:53.137968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9baf3-fa6f-4422-8a36-cb0848a03703 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:53.139208 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 376/765] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:53.140706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9baf3-fa6f-4422-8a36-cb0848a03703 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:53.233305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:53.239631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877637c-4b09-44d9-bce9-b89387a14229 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:53.244765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9baf3-fa6f-4422-8a36-cb0848a03703 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:53.276407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9161f7f-70e8-476f-8cee-18479b407ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:53.277120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9161f7f-70e8-476f-8cee-18479b407ac2 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:53.277525 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9161f7f-70e8-476f-8cee-18479b407ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:53.278223 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9161f7f-70e8-476f-8cee-18479b407ac2 None admin] PATH_INFO: `/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/e1de289ba7ae4140a421127b8f18901f/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:53.279852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb020db-2b4e-4aaf-bcd6-1d4ea267bb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:53.280484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb020db-2b4e-4aaf-bcd6-1d4ea267bb6e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:53.280762 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb020db-2b4e-4aaf-bcd6-1d4ea267bb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:53.280950 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9161f7f-70e8-476f-8cee-18479b407ac2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e1649f32d3d494682dc06e05ae34f3d, user_id=e1de289ba7ae4140a421127b8f18901f, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:53.281058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb020db-2b4e-4aaf-bcd6-1d4ea267bb6e None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:53.281763 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb020db-2b4e-4aaf-bcd6-1d4ea267bb6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:53.282068 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb020db-2b4e-4aaf-bcd6-1d4ea267bb6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:53.282443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9161f7f-70e8-476f-8cee-18479b407ac2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:53.283465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb020db-2b4e-4aaf-bcd6-1d4ea267bb6e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:53.296479 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 390/766] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:40:53 2022] PUT /identity/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/e1de289ba7ae4140a421127b8f18901f/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:40:53.297405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9161f7f-70e8-476f-8cee-18479b407ac2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:53.300392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 377/767] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:53.302829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb020db-2b4e-4aaf-bcd6-1d4ea267bb6e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:53.316912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:53.421520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9161f7f-70e8-476f-8cee-18479b407ac2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:53.436214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb020db-2b4e-4aaf-bcd6-1d4ea267bb6e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:53.464642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cda9e-016c-4d13-8c83-4a78409e7eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:53.465298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cda9e-016c-4d13-8c83-4a78409e7eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:53.465734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cda9e-016c-4d13-8c83-4a78409e7eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:53.466274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cda9e-016c-4d13-8c83-4a78409e7eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:53.479284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cda9e-016c-4d13-8c83-4a78409e7eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:53.480601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e42c12-cd34-4925-bca7-a8eacfae27e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:53.480779 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cda9e-016c-4d13-8c83-4a78409e7eb2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:53.481240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e42c12-cd34-4925-bca7-a8eacfae27e2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:53.481523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e42c12-cd34-4925-bca7-a8eacfae27e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:53.481888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e42c12-cd34-4925-bca7-a8eacfae27e2 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:53.482550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e42c12-cd34-4925-bca7-a8eacfae27e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:53.483917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e42c12-cd34-4925-bca7-a8eacfae27e2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:53.489424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 378/768] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Aug 2 08:40:53 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:53.490629 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a291b1-af51-4404-8151-cfbb6e7dd4e1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:53.490917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a291b1-af51-4404-8151-cfbb6e7dd4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:53.491198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a291b1-af51-4404-8151-cfbb6e7dd4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-555cda9e-016c-4d13-8c83-4a78409e7eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:53.499961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:53.501133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:53.502238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:53.502238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:53.502238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:53.502238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:53.504238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 391/769] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:53.509656 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cda9e-016c-4d13-8c83-4a78409e7eb2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:53.511409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a8a291b1-af51-4404-8151-cfbb6e7dd4e1 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:53.512853 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a8a291b1-af51-4404-8151-cfbb6e7dd4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:53.527732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:53.592938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:53.620168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 379/770] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:40:53.620168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a291b1-af51-4404-8151-cfbb6e7dd4e1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:53.667643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cda9e-016c-4d13-8c83-4a78409e7eb2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:53.715028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee425a96-9ead-40de-9550-60048bcb20a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:53.716233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee425a96-9ead-40de-9550-60048bcb20a4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:53.716951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee425a96-9ead-40de-9550-60048bcb20a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:53.717476 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee425a96-9ead-40de-9550-60048bcb20a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:53.718679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee425a96-9ead-40de-9550-60048bcb20a4 None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=d182c7050f0040559f69a231bee6dccf) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:53.719204 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee425a96-9ead-40de-9550-60048bcb20a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:53.721020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee425a96-9ead-40de-9550-60048bcb20a4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:53.728963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 392/771] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:53 2022] GET /identity/v3/role_assignments?user.id=d182c7050f0040559f69a231bee6dccf&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:53.730144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee425a96-9ead-40de-9550-60048bcb20a4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:53.778725 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a291b1-af51-4404-8151-cfbb6e7dd4e1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:53.845612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb95698-5cfb-4d5d-8a31-cb66910208f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:53.846249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb95698-5cfb-4d5d-8a31-cb66910208f4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:53.846528 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb95698-5cfb-4d5d-8a31-cb66910208f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:53.846803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb95698-5cfb-4d5d-8a31-cb66910208f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:53.847517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb95698-5cfb-4d5d-8a31-cb66910208f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:53.847826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb95698-5cfb-4d5d-8a31-cb66910208f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:53.849271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb95698-5cfb-4d5d-8a31-cb66910208f4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:53.880354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 380/772] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:53.885133 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb95698-5cfb-4d5d-8a31-cb66910208f4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:53.892495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:53.920064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee425a96-9ead-40de-9550-60048bcb20a4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:53.966283 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:53.973945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fe5b0-f17e-4092-a9f2-afe6af49fa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:53.974596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fe5b0-f17e-4092-a9f2-afe6af49fa46 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:53.974879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fe5b0-f17e-4092-a9f2-afe6af49fa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:53.975156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fe5b0-f17e-4092-a9f2-afe6af49fa46 None admin] PATH_INFO: `/v3/services/network` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:53.975956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fe5b0-f17e-4092-a9f2-afe6af49fa46 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:53.978225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fe5b0-f17e-4092-a9f2-afe6af49fa46 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-135fe5b0-f17e-4092-a9f2-afe6af49fa46 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:53.988870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:53.989866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:40:53.990723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:53.994178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 393/773] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:53 2022] GET /identity/v3/services/network => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:54.000241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fe5b0-f17e-4092-a9f2-afe6af49fa46 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:54.037463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb95698-5cfb-4d5d-8a31-cb66910208f4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:54.080028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6f3a4-d151-40fe-a85a-7aebd4f3222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:54.080741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f3a4-d151-40fe-a85a-7aebd4f3222a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:54.081024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f3a4-d151-40fe-a85a-7aebd4f3222a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:54.081361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f3a4-d151-40fe-a85a-7aebd4f3222a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:54.090649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6f3a4-d151-40fe-a85a-7aebd4f3222a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:54.092159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6f3a4-d151-40fe-a85a-7aebd4f3222a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f4b6f3a4-d151-40fe-a85a-7aebd4f3222a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:54.105460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:54.106413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:54.107291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:54.107291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:54.107291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:54.107291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:54.107291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:54.107291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:54.107291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:54.107291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:54.107291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 381/774] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:40:54.112221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6f3a4-d151-40fe-a85a-7aebd4f3222a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:54.212510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:54.214146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fe5b0-f17e-4092-a9f2-afe6af49fa46 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:54.275996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6f3a4-d151-40fe-a85a-7aebd4f3222a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:54.279454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287805b8-7c0d-48f8-9475-dcd9c3c9e3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:54.280071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287805b8-7c0d-48f8-9475-dcd9c3c9e3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:54.280370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287805b8-7c0d-48f8-9475-dcd9c3c9e3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:54.280642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287805b8-7c0d-48f8-9475-dcd9c3c9e3d7 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:54.281328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287805b8-7c0d-48f8-9475-dcd9c3c9e3d7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:54.281631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287805b8-7c0d-48f8-9475-dcd9c3c9e3d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:54.283060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287805b8-7c0d-48f8-9475-dcd9c3c9e3d7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:54.295453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 394/775] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:40:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:54.303429 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287805b8-7c0d-48f8-9475-dcd9c3c9e3d7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:54.349719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52e193-b8ae-49d3-8994-58f9b9d44868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:54.350344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52e193-b8ae-49d3-8994-58f9b9d44868 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:54.350624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52e193-b8ae-49d3-8994-58f9b9d44868 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:54.350898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52e193-b8ae-49d3-8994-58f9b9d44868 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:54.351683 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52e193-b8ae-49d3-8994-58f9b9d44868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:54.351994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52e193-b8ae-49d3-8994-58f9b9d44868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:54.353467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52e193-b8ae-49d3-8994-58f9b9d44868 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:54.381881 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 382/776] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:54.389129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52e193-b8ae-49d3-8994-58f9b9d44868 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:54.416481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:54.488110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287805b8-7c0d-48f8-9475-dcd9c3c9e3d7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:54.557296 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef57b4-63e0-4aff-b014-47c561a0757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:54.557848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef57b4-63e0-4aff-b014-47c561a0757c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:54.558128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef57b4-63e0-4aff-b014-47c561a0757c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:54.558396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef57b4-63e0-4aff-b014-47c561a0757c None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:54.559074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef57b4-63e0-4aff-b014-47c561a0757c None admin] RBAC: Adding query filter params (type=network) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:54.559375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef57b4-63e0-4aff-b014-47c561a0757c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:54.562029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef57b4-63e0-4aff-b014-47c561a0757c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:54.568154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52e193-b8ae-49d3-8994-58f9b9d44868 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:54.577237 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 395/777] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:40:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:54.584211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef57b4-63e0-4aff-b014-47c561a0757c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:54.616539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:54.638036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab27fc-fd9a-4bae-abfd-867a1ca77e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:54.638674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab27fc-fd9a-4bae-abfd-867a1ca77e6f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:54.638954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab27fc-fd9a-4bae-abfd-867a1ca77e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:54.639328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab27fc-fd9a-4bae-abfd-867a1ca77e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:54.640255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab27fc-fd9a-4bae-abfd-867a1ca77e6f None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=ba31cc812281466f90d0c2bfce49d373) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:54.640628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab27fc-fd9a-4bae-abfd-867a1ca77e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:54.642067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab27fc-fd9a-4bae-abfd-867a1ca77e6f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:54.648346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 383/778] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:54 2022] GET /identity/v3/role_assignments?user.id=ba31cc812281466f90d0c2bfce49d373&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:54.755619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef57b4-63e0-4aff-b014-47c561a0757c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:54.797555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:54.839716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ca681-58ee-4f4f-aa57-89dd939510fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:54.840462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ca681-58ee-4f4f-aa57-89dd939510fc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:54.840771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ca681-58ee-4f4f-aa57-89dd939510fc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:54.841051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ca681-58ee-4f4f-aa57-89dd939510fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:54.841885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ca681-58ee-4f4f-aa57-89dd939510fc None admin] RBAC: Adding query filter params (interface=public, service_id=c9b162dc980c4a7e9d21e0f6201c7aa3, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:54.842224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ca681-58ee-4f4f-aa57-89dd939510fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:54.843632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ca681-58ee-4f4f-aa57-89dd939510fc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:54.856499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 396/779] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Aug 2 08:40:54 2022] GET /identity/v3/endpoints?service_id=c9b162dc980c4a7e9d21e0f6201c7aa3&interface=public®ion_id=RegionOne => generated 194 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:54.859570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab27fc-fd9a-4bae-abfd-867a1ca77e6f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:54.986076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab27fc-fd9a-4bae-abfd-867a1ca77e6f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:55.037832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac35486-901d-439e-a83f-110d3d90ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:55.038490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac35486-901d-439e-a83f-110d3d90ac21 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:55.039331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac35486-901d-439e-a83f-110d3d90ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:55.039645 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac35486-901d-439e-a83f-110d3d90ac21 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:55.040352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac35486-901d-439e-a83f-110d3d90ac21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:55.041795 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac35486-901d-439e-a83f-110d3d90ac21 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:55.049092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 384/780] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Aug 2 08:40:54 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:55.565315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1f90a-1fae-4b78-8b20-20379a1502b5 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:55.565693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1f90a-1fae-4b78-8b20-20379a1502b5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:55.565877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1f90a-1fae-4b78-8b20-20379a1502b5 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:55.567397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 397/781] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:55.572782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45fcc0-f183-44b6-9911-2307f1e5f890 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:55.573119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45fcc0-f183-44b6-9911-2307f1e5f890 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:55.573494 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45fcc0-f183-44b6-9911-2307f1e5f890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:55.598261 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1c45fcc0-f183-44b6-9911-2307f1e5f890 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:55.599491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1c45fcc0-f183-44b6-9911-2307f1e5f890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:55.671168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:55.702891 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 385/782] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:40:55.739609 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1f90a-1fae-4b78-8b20-20379a1502b5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:55.740921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90aea3-7b34-4641-85e2-342822535a42 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:55.741214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90aea3-7b34-4641-85e2-342822535a42 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:55.741491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90aea3-7b34-4641-85e2-342822535a42 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:55.743686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 386/783] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:40:55.748756 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a865-d31d-488b-bec7-e9d300d88aab None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:55.749157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a865-d31d-488b-bec7-e9d300d88aab None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:55.749550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a865-d31d-488b-bec7-e9d300d88aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:55.781127 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bd51a865-d31d-488b-bec7-e9d300d88aab None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:55.782338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bd51a865-d31d-488b-bec7-e9d300d88aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:55.915239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 387/784] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:40:55.923128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1f90a-1fae-4b78-8b20-20379a1502b5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:55.963300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51a865-d31d-488b-bec7-e9d300d88aab None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:55.990825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312605d2-156f-450e-9983-d5d8d352516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:55.991607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312605d2-156f-450e-9983-d5d8d352516c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:55.991932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312605d2-156f-450e-9983-d5d8d352516c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:55.992235 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312605d2-156f-450e-9983-d5d8d352516c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:56.017083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312605d2-156f-450e-9983-d5d8d352516c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-312605d2-156f-450e-9983-d5d8d352516c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:56.025824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:56.026992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:56.028011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 398/785] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:56.033037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312605d2-156f-450e-9983-d5d8d352516c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:56.086862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51a865-d31d-488b-bec7-e9d300d88aab None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:56.112664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:56.120793 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:56.129639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5bd11-f273-4915-92c5-9d47be7ecd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:56.130445 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5bd11-f273-4915-92c5-9d47be7ecd5c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:56.130833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5bd11-f273-4915-92c5-9d47be7ecd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:56.131120 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5bd11-f273-4915-92c5-9d47be7ecd5c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:56.131763 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5bd11-f273-4915-92c5-9d47be7ecd5c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:56.133856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5bd11-f273-4915-92c5-9d47be7ecd5c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-75e5bd11-f273-4915-92c5-9d47be7ecd5c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:56.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:56.156728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:40:56.158186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:56.164772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 388/786] 10.222.0.17 () {56 vars in 1129 bytes} [Tue Aug 2 08:40:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:40:56.172433 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5bd11-f273-4915-92c5-9d47be7ecd5c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:56.225403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312605d2-156f-450e-9983-d5d8d352516c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:56.265572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca8f28-26e6-4a97-a83b-a01163e3c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:56.266571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca8f28-26e6-4a97-a83b-a01163e3c07d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:56.267084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca8f28-26e6-4a97-a83b-a01163e3c07d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:56.268166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca8f28-26e6-4a97-a83b-a01163e3c07d None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:56.269102 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca8f28-26e6-4a97-a83b-a01163e3c07d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:56.269658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca8f28-26e6-4a97-a83b-a01163e3c07d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:56.272079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca8f28-26e6-4a97-a83b-a01163e3c07d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:56.284862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 399/787] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:56.287095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b683f3-e2c5-4bfe-a1d5-24610cd0eb35 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:56.287612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b683f3-e2c5-4bfe-a1d5-24610cd0eb35 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:56.288369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b683f3-e2c5-4bfe-a1d5-24610cd0eb35 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:56.291106 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 400/788] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:56.292854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b683f3-e2c5-4bfe-a1d5-24610cd0eb35 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:56.295903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5bd11-f273-4915-92c5-9d47be7ecd5c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:56.335179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c007f09-eb8c-4384-99ed-80ef3e9efd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:56.336526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c007f09-eb8c-4384-99ed-80ef3e9efd4c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:56.337405 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c007f09-eb8c-4384-99ed-80ef3e9efd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:56.337687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c007f09-eb8c-4384-99ed-80ef3e9efd4c None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:56.338736 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c007f09-eb8c-4384-99ed-80ef3e9efd4c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:56.339051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c007f09-eb8c-4384-99ed-80ef3e9efd4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:56.340586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c007f09-eb8c-4384-99ed-80ef3e9efd4c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:56.347260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 389/789] 10.222.0.17 () {56 vars in 1124 bytes} [Tue Aug 2 08:40:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:40:56.348602 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ea2cb-c60a-453b-b455-44f5b299b151 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:56.348894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ea2cb-c60a-453b-b455-44f5b299b151 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:56.349172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ea2cb-c60a-453b-b455-44f5b299b151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:56.373118 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fe8ea2cb-c60a-453b-b455-44f5b299b151 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:56.374674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fe8ea2cb-c60a-453b-b455-44f5b299b151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:56.420340 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:56.443249 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b683f3-e2c5-4bfe-a1d5-24610cd0eb35 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:56.457306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:56.459670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 390/790] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:40:56.461674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ea2cb-c60a-453b-b455-44f5b299b151 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:56.497351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06cb45-3312-45cb-88d1-6875071603e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:56.498090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06cb45-3312-45cb-88d1-6875071603e7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:56.498377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06cb45-3312-45cb-88d1-6875071603e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:56.498668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06cb45-3312-45cb-88d1-6875071603e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:56.511415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06cb45-3312-45cb-88d1-6875071603e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:56.513232 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06cb45-3312-45cb-88d1-6875071603e7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-dc06cb45-3312-45cb-88d1-6875071603e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:56.532293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:56.533199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:56.534176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:56.534176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:56.534176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:56.534176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:56.534176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 401/791] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:56.540142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06cb45-3312-45cb-88d1-6875071603e7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:56.572355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ea2cb-c60a-453b-b455-44f5b299b151 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:56.609075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c383c-8050-462c-b0f2-403802eea04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:56.609698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c383c-8050-462c-b0f2-403802eea04a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:56.609983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c383c-8050-462c-b0f2-403802eea04a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:56.610262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c383c-8050-462c-b0f2-403802eea04a None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:56.610946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c383c-8050-462c-b0f2-403802eea04a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:56.611254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c383c-8050-462c-b0f2-403802eea04a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:56.612735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c383c-8050-462c-b0f2-403802eea04a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:56.619923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 391/792] 10.222.0.17 () {56 vars in 1124 bytes} [Tue Aug 2 08:40:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:56.620838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c383c-8050-462c-b0f2-403802eea04a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:56.643632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06cb45-3312-45cb-88d1-6875071603e7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:56.658714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:56.682361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726d3bc-f914-4e32-879d-06aba5ae7957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:56.683050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726d3bc-f914-4e32-879d-06aba5ae7957 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:56.683333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726d3bc-f914-4e32-879d-06aba5ae7957 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:56.683607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726d3bc-f914-4e32-879d-06aba5ae7957 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:56.699226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726d3bc-f914-4e32-879d-06aba5ae7957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b726d3bc-f914-4e32-879d-06aba5ae7957 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:56.705111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:56.707441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 402/793] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:56.709756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726d3bc-f914-4e32-879d-06aba5ae7957 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:56.730895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:56.752799 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c383c-8050-462c-b0f2-403802eea04a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:56.790908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3572bf-9579-43fd-8034-096049a5c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:56.791543 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3572bf-9579-43fd-8034-096049a5c47b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:56.791826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3572bf-9579-43fd-8034-096049a5c47b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:56.792179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3572bf-9579-43fd-8034-096049a5c47b None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:56.793293 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3572bf-9579-43fd-8034-096049a5c47b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:56.793605 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3572bf-9579-43fd-8034-096049a5c47b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:56.795098 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3572bf-9579-43fd-8034-096049a5c47b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:56.818577 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726d3bc-f914-4e32-879d-06aba5ae7957 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:56.820636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 392/794] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:56.821654 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3572bf-9579-43fd-8034-096049a5c47b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:56.855708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74511f06-b5df-4351-a99c-d4ff9318e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:56.856602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74511f06-b5df-4351-a99c-d4ff9318e472 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:56.857056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74511f06-b5df-4351-a99c-d4ff9318e472 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:56.857471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74511f06-b5df-4351-a99c-d4ff9318e472 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:56.858391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74511f06-b5df-4351-a99c-d4ff9318e472 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:56.860003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74511f06-b5df-4351-a99c-d4ff9318e472 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:56.887245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 403/795] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:40:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:40:56.888734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74511f06-b5df-4351-a99c-d4ff9318e472 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:56.932021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:56.939795 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3572bf-9579-43fd-8034-096049a5c47b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:56.981528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:56.991088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b42ae-df4c-4f36-a41c-1d36ddded543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:56.992642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b42ae-df4c-4f36-a41c-1d36ddded543 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:56.993102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b42ae-df4c-4f36-a41c-1d36ddded543 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:56.993533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b42ae-df4c-4f36-a41c-1d36ddded543 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:56.995809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b42ae-df4c-4f36-a41c-1d36ddded543 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:56.996625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b42ae-df4c-4f36-a41c-1d36ddded543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:56.998469 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b42ae-df4c-4f36-a41c-1d36ddded543 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:57.009492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 393/796] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:57.014214 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74511f06-b5df-4351-a99c-d4ff9318e472 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:57.015776 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b42ae-df4c-4f36-a41c-1d36ddded543 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:57.060153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f892f-4817-42ba-9379-4196d632bbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:57.060153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f892f-4817-42ba-9379-4196d632bbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:57.060153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f892f-4817-42ba-9379-4196d632bbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:57.060153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f892f-4817-42ba-9379-4196d632bbf0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:57.081176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f892f-4817-42ba-9379-4196d632bbf0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:57.082770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f892f-4817-42ba-9379-4196d632bbf0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-258f892f-4817-42ba-9379-4196d632bbf0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:57.115740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:57.116860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:57.117802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:57.117802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:57.117802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:57.117802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:57.117802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:57.117802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:57.117802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:57.117802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:57.117802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:40:57.117802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:57.119411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 404/797] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Aug 2 08:40:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:57.122913 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f892f-4817-42ba-9379-4196d632bbf0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:57.189643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b42ae-df4c-4f36-a41c-1d36ddded543 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:57.235720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08e903-8bb3-4bc7-825d-b2451bb14f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:57.236622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08e903-8bb3-4bc7-825d-b2451bb14f25 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:57.236909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08e903-8bb3-4bc7-825d-b2451bb14f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:57.237353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08e903-8bb3-4bc7-825d-b2451bb14f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:57.242655 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f892f-4817-42ba-9379-4196d632bbf0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:57.250872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08e903-8bb3-4bc7-825d-b2451bb14f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:57.252467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08e903-8bb3-4bc7-825d-b2451bb14f25 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-ce08e903-8bb3-4bc7-825d-b2451bb14f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:57.270315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:57.272428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:57.274764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:57.274764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:57.274764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:57.274764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:57.274764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 394/798] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:57.280595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08e903-8bb3-4bc7-825d-b2451bb14f25 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:57.286176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:57.292865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfee013-bd26-49ac-9a65-9262f0d44905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:57.293940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfee013-bd26-49ac-9a65-9262f0d44905 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:57.294430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfee013-bd26-49ac-9a65-9262f0d44905 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:57.294944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfee013-bd26-49ac-9a65-9262f0d44905 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:57.296063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfee013-bd26-49ac-9a65-9262f0d44905 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:57.296595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfee013-bd26-49ac-9a65-9262f0d44905 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:57.298399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfee013-bd26-49ac-9a65-9262f0d44905 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:57.302597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:57.321715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 405/799] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Aug 2 08:40:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:57.329354 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfee013-bd26-49ac-9a65-9262f0d44905 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:57.402895 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08e903-8bb3-4bc7-825d-b2451bb14f25 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:57.439237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f397ce2-18bf-4875-a9af-1fa6aaf97e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:57.439859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f397ce2-18bf-4875-a9af-1fa6aaf97e53 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:57.440161 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f397ce2-18bf-4875-a9af-1fa6aaf97e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:57.440446 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f397ce2-18bf-4875-a9af-1fa6aaf97e53 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:57.441216 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f397ce2-18bf-4875-a9af-1fa6aaf97e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:57.441443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f397ce2-18bf-4875-a9af-1fa6aaf97e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:57.442820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f397ce2-18bf-4875-a9af-1fa6aaf97e53 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:57.444586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfee013-bd26-49ac-9a65-9262f0d44905 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:57.460344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 395/800] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:57.461615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff114a-bcc8-45a7-bbed-a2c740f0a455 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:57.461908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff114a-bcc8-45a7-bbed-a2c740f0a455 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:57.462189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff114a-bcc8-45a7-bbed-a2c740f0a455 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:57.463714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 396/801] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:57.465122 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff114a-bcc8-45a7-bbed-a2c740f0a455 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:57.483907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83cd6f-fe1b-4912-b21b-0de6b6ebaf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:57.484947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83cd6f-fe1b-4912-b21b-0de6b6ebaf6a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:57.485426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83cd6f-fe1b-4912-b21b-0de6b6ebaf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:57.485973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83cd6f-fe1b-4912-b21b-0de6b6ebaf6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:57.533128 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:57.552347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:57.562481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83cd6f-fe1b-4912-b21b-0de6b6ebaf6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:57.564386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83cd6f-fe1b-4912-b21b-0de6b6ebaf6a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:57.576694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff114a-bcc8-45a7-bbed-a2c740f0a455 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:57.613542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b4fe8-a329-42e2-9411-9acbac20f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:57.614193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b4fe8-a329-42e2-9411-9acbac20f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:57.614481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b4fe8-a329-42e2-9411-9acbac20f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:57.614759 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b4fe8-a329-42e2-9411-9acbac20f1e2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:57.623060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b4fe8-a329-42e2-9411-9acbac20f1e2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:57.624554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b4fe8-a329-42e2-9411-9acbac20f1e2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-002b4fe8-a329-42e2-9411-9acbac20f1e2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:57.636714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:57.637765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:57.638713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:57.638713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:57.638713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:57.638713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:57.638713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:57.638713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:57.638713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:57.638713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:57.638713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:40:57.638713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:57.642667 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 397/802] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:40:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:40:57.644468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7229c-163a-496e-b908-2820d96b800d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:57.644468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7229c-163a-496e-b908-2820d96b800d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:57.644667 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7229c-163a-496e-b908-2820d96b800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:57.662789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9df7229c-163a-496e-b908-2820d96b800d None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:57.664539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9df7229c-163a-496e-b908-2820d96b800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:57.686018 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 406/803] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:40:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:40:57.686018 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83cd6f-fe1b-4912-b21b-0de6b6ebaf6a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:57.741699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 398/804] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:40:57.743644 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09221b1b-e796-414b-8ca9-494d2111129b None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:57.743994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09221b1b-e796-414b-8ca9-494d2111129b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:57.744377 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09221b1b-e796-414b-8ca9-494d2111129b None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:57.745851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 399/805] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:57.746410 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09221b1b-e796-414b-8ca9-494d2111129b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:57.815640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:57.819871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:57.825027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83cd6f-fe1b-4912-b21b-0de6b6ebaf6a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:57.861683 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe78967-16d3-4c27-a12e-eeac27c608c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:57.862303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe78967-16d3-4c27-a12e-eeac27c608c3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:57.862603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe78967-16d3-4c27-a12e-eeac27c608c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:57.862876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe78967-16d3-4c27-a12e-eeac27c608c3 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:57.863667 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe78967-16d3-4c27-a12e-eeac27c608c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:57.863979 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe78967-16d3-4c27-a12e-eeac27c608c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:57.865513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe78967-16d3-4c27-a12e-eeac27c608c3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:57.872649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09221b1b-e796-414b-8ca9-494d2111129b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:57.884484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 407/806] 10.222.0.17 () {56 vars in 1135 bytes} [Tue Aug 2 08:40:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:57.885722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0957d-a303-4fbd-addd-5f44b263b4e7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:57.886010 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0957d-a303-4fbd-addd-5f44b263b4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:57.886284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0957d-a303-4fbd-addd-5f44b263b4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:57.904952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-80b0957d-a303-4fbd-addd-5f44b263b4e7 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:57.906237 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-80b0957d-a303-4fbd-addd-5f44b263b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:57.917304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6786c9-2302-4fa6-a29d-fe4deb437216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:57.917946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6786c9-2302-4fa6-a29d-fe4deb437216 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:57.918236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6786c9-2302-4fa6-a29d-fe4deb437216 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:57.918511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6786c9-2302-4fa6-a29d-fe4deb437216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:57.931082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6786c9-2302-4fa6-a29d-fe4deb437216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:57.932658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6786c9-2302-4fa6-a29d-fe4deb437216 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-da6786c9-2302-4fa6-a29d-fe4deb437216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:57.948515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:57.949443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:57.950331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:57.950331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:57.950331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:57.950331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:57.954941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 400/807] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:57.955847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6786c9-2302-4fa6-a29d-fe4deb437216 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:57.991506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 408/808] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:40:57.991506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0957d-a303-4fbd-addd-5f44b263b4e7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:58.078221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6786c9-2302-4fa6-a29d-fe4deb437216 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:58.086816 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:58.088729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:58.108896 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0957d-a303-4fbd-addd-5f44b263b4e7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:58.116358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecb5b2-183b-4723-bb84-5cac16d5213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:58.117101 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb5b2-183b-4723-bb84-5cac16d5213c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:58.117383 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb5b2-183b-4723-bb84-5cac16d5213c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:58.117660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb5b2-183b-4723-bb84-5cac16d5213c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:58.129124 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecb5b2-183b-4723-bb84-5cac16d5213c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-62ecb5b2-183b-4723-bb84-5cac16d5213c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:40:58.134834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:58.135999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:58.137084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:58.137084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:58.137084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:58.137084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:58.137084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:40:58.137084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:40:58.137084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:40:58.137084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:40:58.137084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:40:58.137084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:40:58.137084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:40:58.137084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:58.142798 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 401/809] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:40:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:58.142798 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecb5b2-183b-4723-bb84-5cac16d5213c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:58.151557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160132f3-469c-407e-a362-22bdc48f6c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:58.152396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160132f3-469c-407e-a362-22bdc48f6c9b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:58.152678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160132f3-469c-407e-a362-22bdc48f6c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:58.152949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160132f3-469c-407e-a362-22bdc48f6c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:58.166614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160132f3-469c-407e-a362-22bdc48f6c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:58.168643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160132f3-469c-407e-a362-22bdc48f6c9b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-160132f3-469c-407e-a362-22bdc48f6c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:58.185915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:58.186855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:58.187778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:58.187778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:58.187778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:58.187778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:58.187778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 409/810] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:58.188050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160132f3-469c-407e-a362-22bdc48f6c9b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:58.253203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecb5b2-183b-4723-bb84-5cac16d5213c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:58.292409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ef6d6-c8e0-49e9-89b1-77f3327fc951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:58.293031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ef6d6-c8e0-49e9-89b1-77f3327fc951 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:58.293322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ef6d6-c8e0-49e9-89b1-77f3327fc951 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:58.293599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ef6d6-c8e0-49e9-89b1-77f3327fc951 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:58.294296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ef6d6-c8e0-49e9-89b1-77f3327fc951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:58.294610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ef6d6-c8e0-49e9-89b1-77f3327fc951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:58.295973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ef6d6-c8e0-49e9-89b1-77f3327fc951 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:58.302294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160132f3-469c-407e-a362-22bdc48f6c9b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:58.310695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 402/811] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:58.312422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ef6d6-c8e0-49e9-89b1-77f3327fc951 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:58.340180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bf636-7391-4fb7-803a-d6dcf36c53a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:58.341308 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bf636-7391-4fb7-803a-d6dcf36c53a5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:58.341599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bf636-7391-4fb7-803a-d6dcf36c53a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:58.342197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bf636-7391-4fb7-803a-d6dcf36c53a5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:58.342891 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bf636-7391-4fb7-803a-d6dcf36c53a5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:58.345357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bf636-7391-4fb7-803a-d6dcf36c53a5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:58.346661 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:58.348459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c41bf636-7391-4fb7-803a-d6dcf36c53a5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:58.360846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:58.361860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:58.362707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 410/812] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:58 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:58.364024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bf636-7391-4fb7-803a-d6dcf36c53a5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:58.428743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ef6d6-c8e0-49e9-89b1-77f3327fc951 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:58.468913 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be751bd-458f-4093-bd96-de13c060c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:58.469580 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be751bd-458f-4093-bd96-de13c060c827 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:58.469685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bf636-7391-4fb7-803a-d6dcf36c53a5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:58.469864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be751bd-458f-4093-bd96-de13c060c827 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:58.470137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be751bd-458f-4093-bd96-de13c060c827 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:58.470847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be751bd-458f-4093-bd96-de13c060c827 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:58.471310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be751bd-458f-4093-bd96-de13c060c827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:58.473461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be751bd-458f-4093-bd96-de13c060c827 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:58.488027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 403/813] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:40:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:58.488027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be751bd-458f-4093-bd96-de13c060c827 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:58.504784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d348e87-56e7-4ab4-ad6e-048e6591a5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:58.505564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d348e87-56e7-4ab4-ad6e-048e6591a5fe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:58.506182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d348e87-56e7-4ab4-ad6e-048e6591a5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:58.506182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d348e87-56e7-4ab4-ad6e-048e6591a5fe None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:58.506930 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d348e87-56e7-4ab4-ad6e-048e6591a5fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:58.507213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d348e87-56e7-4ab4-ad6e-048e6591a5fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:58.509092 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d348e87-56e7-4ab4-ad6e-048e6591a5fe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:58.521433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 411/814] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:58.522236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d348e87-56e7-4ab4-ad6e-048e6591a5fe None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:58.585328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:58.588211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:58.601334 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be751bd-458f-4093-bd96-de13c060c827 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:58.634043 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d348e87-56e7-4ab4-ad6e-048e6591a5fe None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:58.644358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fc12b-d862-4438-a15f-2ba978080473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:58.645431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fc12b-d862-4438-a15f-2ba978080473 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:58.645723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fc12b-d862-4438-a15f-2ba978080473 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:58.646287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fc12b-d862-4438-a15f-2ba978080473 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:58.656182 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fc12b-d862-4438-a15f-2ba978080473 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:58.657660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fc12b-d862-4438-a15f-2ba978080473 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:58.669346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057100d6-7dc5-4e1a-a657-8f724e845d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:58.669965 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057100d6-7dc5-4e1a-a657-8f724e845d40 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:58.670249 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057100d6-7dc5-4e1a-a657-8f724e845d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:58.670526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057100d6-7dc5-4e1a-a657-8f724e845d40 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-bd1fc12b-d862-4438-a15f-2ba978080473 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:58.670996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:58.671821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:58.673404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:58.673404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:58.673404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:58.673404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:58.673404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:58.673404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:58.673404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:58.673404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:58.673851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057100d6-7dc5-4e1a-a657-8f724e845d40 None admin] RBAC: Adding query filter params (name=network) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:58.673851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057100d6-7dc5-4e1a-a657-8f724e845d40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:58.673974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 404/815] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:58.673974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fc12b-d862-4438-a15f-2ba978080473 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:58.677526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057100d6-7dc5-4e1a-a657-8f724e845d40 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:58.687809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 412/816] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:40:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:58.687809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057100d6-7dc5-4e1a-a657-8f724e845d40 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:58.792703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fc12b-d862-4438-a15f-2ba978080473 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:58.800963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057100d6-7dc5-4e1a-a657-8f724e845d40 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:58.827270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:58.836674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d141b-7d4a-47fc-8b26-f076a287f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:58.837323 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d141b-7d4a-47fc-8b26-f076a287f8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:58.837669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d141b-7d4a-47fc-8b26-f076a287f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:58.837939 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d141b-7d4a-47fc-8b26-f076a287f8b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:58.842078 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbb587-8f31-4530-9233-60e8f5da6828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:58.842931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbb587-8f31-4530-9233-60e8f5da6828 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:58.843388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbb587-8f31-4530-9233-60e8f5da6828 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:58.843870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbb587-8f31-4530-9233-60e8f5da6828 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:58.849457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d141b-7d4a-47fc-8b26-f076a287f8b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:58.850912 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d141b-7d4a-47fc-8b26-f076a287f8b8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:58.853849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbb587-8f31-4530-9233-60e8f5da6828 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:58.855734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbb587-8f31-4530-9233-60e8f5da6828 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:58.859780 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-953d141b-7d4a-47fc-8b26-f076a287f8b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:40:58.867425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:58.868357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:58.874212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:40:58.874212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:40:58.874212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:40:58.874212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:58.874212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 405/817] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:58.874212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d141b-7d4a-47fc-8b26-f076a287f8b8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-65cbb587-8f31-4530-9233-60e8f5da6828 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:40:58.874555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:58.875351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:58.877068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:40:58.877068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:40:58.877068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:40:58.877068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:40:58.877068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:40:58.877068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:40:58.877068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:40:58.877068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:40:58.877068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 413/818] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:58.877068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbb587-8f31-4530-9233-60e8f5da6828 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:58.984241 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d141b-7d4a-47fc-8b26-f076a287f8b8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:58.985918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbb587-8f31-4530-9233-60e8f5da6828 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:59.021212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0493-44f4-4264-994a-719e77104581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:59.021872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0493-44f4-4264-994a-719e77104581 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:59.022104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0493-44f4-4264-994a-719e77104581 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:59.022385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0493-44f4-4264-994a-719e77104581 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:59.023584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e0493-44f4-4264-994a-719e77104581 None admin] RBAC: Adding query filter params (type=network) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:59.023892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e0493-44f4-4264-994a-719e77104581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:59.024109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfda36-5d2c-4212-818b-17d5bf70e626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:59.024925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfda36-5d2c-4212-818b-17d5bf70e626 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:59.025373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e0493-44f4-4264-994a-719e77104581 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:59.025486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfda36-5d2c-4212-818b-17d5bf70e626 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:59.025888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfda36-5d2c-4212-818b-17d5bf70e626 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:59.026796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfda36-5d2c-4212-818b-17d5bf70e626 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:59.027255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfda36-5d2c-4212-818b-17d5bf70e626 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:59.028869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfda36-5d2c-4212-818b-17d5bf70e626 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:59.030398 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 414/819] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:40:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:59.031188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0493-44f4-4264-994a-719e77104581 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:59.047886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 406/820] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:59.048967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfda36-5d2c-4212-818b-17d5bf70e626 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:59.085097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:59.114025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:59.147132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0493-44f4-4264-994a-719e77104581 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:59.158216 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfda36-5d2c-4212-818b-17d5bf70e626 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:59.189157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665da40-a109-4709-afe6-63b86367195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:59.190096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665da40-a109-4709-afe6-63b86367195d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:59.190540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665da40-a109-4709-afe6-63b86367195d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:59.190971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665da40-a109-4709-afe6-63b86367195d None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:59.191693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665da40-a109-4709-afe6-63b86367195d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:59.192029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665da40-a109-4709-afe6-63b86367195d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:59.193423 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665da40-a109-4709-afe6-63b86367195d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:59.199571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02606ac0-cb83-4763-bbf2-9396a83fdedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:59.200664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02606ac0-cb83-4763-bbf2-9396a83fdedb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:59.200664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02606ac0-cb83-4763-bbf2-9396a83fdedb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:59.200885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02606ac0-cb83-4763-bbf2-9396a83fdedb None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:59.201520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02606ac0-cb83-4763-bbf2-9396a83fdedb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:59.201836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02606ac0-cb83-4763-bbf2-9396a83fdedb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:59.203265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02606ac0-cb83-4763-bbf2-9396a83fdedb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:59.210824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 415/821] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:59.210824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665da40-a109-4709-afe6-63b86367195d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:59.216895 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 407/822] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:59.221861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02606ac0-cb83-4763-bbf2-9396a83fdedb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:59.310451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665da40-a109-4709-afe6-63b86367195d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:59.317435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:59.317602 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02606ac0-cb83-4763-bbf2-9396a83fdedb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:59.339014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:59.344780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6812dd6-a390-4a8a-b6c4-09baf9cf831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:59.345405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6812dd6-a390-4a8a-b6c4-09baf9cf831c None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:59.345694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6812dd6-a390-4a8a-b6c4-09baf9cf831c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:59.346111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6812dd6-a390-4a8a-b6c4-09baf9cf831c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:59.346670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6812dd6-a390-4a8a-b6c4-09baf9cf831c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:59.348040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6812dd6-a390-4a8a-b6c4-09baf9cf831c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:59.353702 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f4f17-5102-48a7-92a2-627214da83ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:59.354321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4f17-5102-48a7-92a2-627214da83ef None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:59.354603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4f17-5102-48a7-92a2-627214da83ef None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:59.354878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4f17-5102-48a7-92a2-627214da83ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:59.355710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4f17-5102-48a7-92a2-627214da83ef None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=e1de289ba7ae4140a421127b8f18901f) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:59.355975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4f17-5102-48a7-92a2-627214da83ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:59.357426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4f17-5102-48a7-92a2-627214da83ef None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:59.363343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 408/823] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:40:59 2022] GET /identity/v3/role_assignments?user.id=e1de289ba7ae4140a421127b8f18901f&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:59.364194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f4f17-5102-48a7-92a2-627214da83ef None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:59.376529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 416/824] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:40:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:40:59.378014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b97af-1d31-44b7-8836-62412c8bc411 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:59.378358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b97af-1d31-44b7-8836-62412c8bc411 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:59.378718 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b97af-1d31-44b7-8836-62412c8bc411 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:59.380464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 417/825] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:40:59.385777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b97af-1d31-44b7-8836-62412c8bc411 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:59.528176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f4f17-5102-48a7-92a2-627214da83ef None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:59.554595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b97af-1d31-44b7-8836-62412c8bc411 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:59.570282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5c51a-da66-457f-a724-0d443feaf4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:59.570944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5c51a-da66-457f-a724-0d443feaf4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:59.572003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5c51a-da66-457f-a724-0d443feaf4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:59.572003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5c51a-da66-457f-a724-0d443feaf4a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:59.583156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5c51a-da66-457f-a724-0d443feaf4a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:59.585156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5c51a-da66-457f-a724-0d443feaf4a0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d5d5c51a-da66-457f-a724-0d443feaf4a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:40:59.606022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:59.607023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:59.607982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:59.607982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:59.607982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:40:59.607982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:40:59.607982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:40:59.607982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:40:59.607982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:40:59.607982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:40:59.607982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:40:59.607982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:59.608582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 409/826] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Aug 2 08:40:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:59.609106 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bac0c-fb5b-4f91-b0a4-b57b890ac2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:59.609994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bac0c-fb5b-4f91-b0a4-b57b890ac2fa None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:59.610098 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2836b02-a3a9-48b0-8ce9-3051b310b3d7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:59.610172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bac0c-fb5b-4f91-b0a4-b57b890ac2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:59.610240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2836b02-a3a9-48b0-8ce9-3051b310b3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:59.610309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bac0c-fb5b-4f91-b0a4-b57b890ac2fa None admin] PATH_INFO: `/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/d182c7050f0040559f69a231bee6dccf/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:59.610844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2836b02-a3a9-48b0-8ce9-3051b310b3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:59.612078 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bac0c-fb5b-4f91-b0a4-b57b890ac2fa None admin] RBAC: Authorizing `identity:create_grant(project_id=7e1649f32d3d494682dc06e05ae34f3d, user_id=d182c7050f0040559f69a231bee6dccf, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:59.613550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bac0c-fb5b-4f91-b0a4-b57b890ac2fa None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:59.630280 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 418/827] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:40:59 2022] PUT /identity/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/d182c7050f0040559f69a231bee6dccf/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:40:59.631244 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bac0c-fb5b-4f91-b0a4-b57b890ac2fa None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:59.638141 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b2836b02-a3a9-48b0-8ce9-3051b310b3d7 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:40:59.639732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b2836b02-a3a9-48b0-8ce9-3051b310b3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:40:59.656068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:59.694664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:59.730423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 410/828] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:40:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:40:59.756593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2836b02-a3a9-48b0-8ce9-3051b310b3d7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:59.776555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bac0c-fb5b-4f91-b0a4-b57b890ac2fa None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:59.820274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e06f1e-da41-42e5-858c-68df8a911c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:59.821284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e06f1e-da41-42e5-858c-68df8a911c2e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:59.821771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e06f1e-da41-42e5-858c-68df8a911c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:59.822306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e06f1e-da41-42e5-858c-68df8a911c2e None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:59.823298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e06f1e-da41-42e5-858c-68df8a911c2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:40:59.823798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e06f1e-da41-42e5-858c-68df8a911c2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:59.825465 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e06f1e-da41-42e5-858c-68df8a911c2e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:59.852214 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 419/829] 10.222.0.17 () {56 vars in 1149 bytes} [Tue Aug 2 08:40:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:40:59.859011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e06f1e-da41-42e5-858c-68df8a911c2e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:59.892008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2836b02-a3a9-48b0-8ce9-3051b310b3d7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:40:59.939518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7c2cf-da73-4c2e-b715-0a52a2fcb8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:40:59.940217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7c2cf-da73-4c2e-b715-0a52a2fcb8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:40:59.940509 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7c2cf-da73-4c2e-b715-0a52a2fcb8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:40:59.941087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7c2cf-da73-4c2e-b715-0a52a2fcb8c8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:40:59.941735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7c2cf-da73-4c2e-b715-0a52a2fcb8c8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:40:59.944403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7c2cf-da73-4c2e-b715-0a52a2fcb8c8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:40:59.952236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-7ce7c2cf-da73-4c2e-b715-0a52a2fcb8c8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:40:59.956478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:40:59.957815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:40:59.958942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 411/830] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:40:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:40:59.964292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7c2cf-da73-4c2e-b715-0a52a2fcb8c8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:40:59.993077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e06f1e-da41-42e5-858c-68df8a911c2e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:00.008158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:00.039748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255fd2f-872a-47cf-9ef5-0f68334a33fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:00.040526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255fd2f-872a-47cf-9ef5-0f68334a33fe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:00.040878 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255fd2f-872a-47cf-9ef5-0f68334a33fe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:00.041219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255fd2f-872a-47cf-9ef5-0f68334a33fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:00.052007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255fd2f-872a-47cf-9ef5-0f68334a33fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:00.053567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255fd2f-872a-47cf-9ef5-0f68334a33fe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9255fd2f-872a-47cf-9ef5-0f68334a33fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:00.071845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:00.072830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:00.073722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:00.073722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:00.073722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:00.073722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:00.077938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 420/831] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:00.078887 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255fd2f-872a-47cf-9ef5-0f68334a33fe None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:00.098008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7c2cf-da73-4c2e-b715-0a52a2fcb8c8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:00.139233 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8edf-100d-4392-a123-3f578dd2cef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:00.140001 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8edf-100d-4392-a123-3f578dd2cef1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:00.140402 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8edf-100d-4392-a123-3f578dd2cef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:00.140850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8edf-100d-4392-a123-3f578dd2cef1 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:00.141542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8edf-100d-4392-a123-3f578dd2cef1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:00.141943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8edf-100d-4392-a123-3f578dd2cef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:00.143466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8edf-100d-4392-a123-3f578dd2cef1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:00.149271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 412/832] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:40:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:00.158439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8edf-100d-4392-a123-3f578dd2cef1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:00.203843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255fd2f-872a-47cf-9ef5-0f68334a33fe None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:00.232700 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:00.241520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec54eab-d9ed-4fb7-9831-05f7fc94388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:00.242930 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec54eab-d9ed-4fb7-9831-05f7fc94388a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:00.243410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec54eab-d9ed-4fb7-9831-05f7fc94388a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:00.243831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec54eab-d9ed-4fb7-9831-05f7fc94388a None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:00.244724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec54eab-d9ed-4fb7-9831-05f7fc94388a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:00.245178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec54eab-d9ed-4fb7-9831-05f7fc94388a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:00.246723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec54eab-d9ed-4fb7-9831-05f7fc94388a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:00.260212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 421/833] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:00.266587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec54eab-d9ed-4fb7-9831-05f7fc94388a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:00.275968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8edf-100d-4392-a123-3f578dd2cef1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:00.278088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:00.340290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a6d9f-37f3-4517-af05-9f90ba30941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:00.341379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6d9f-37f3-4517-af05-9f90ba30941d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:00.341863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6d9f-37f3-4517-af05-9f90ba30941d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:00.342512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6d9f-37f3-4517-af05-9f90ba30941d None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:00.343406 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a6d9f-37f3-4517-af05-9f90ba30941d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:00.343929 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a6d9f-37f3-4517-af05-9f90ba30941d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:00.345519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a6d9f-37f3-4517-af05-9f90ba30941d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:00.351878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 413/834] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:41:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:00.405682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec54eab-d9ed-4fb7-9831-05f7fc94388a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:00.446016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e981d-c5fc-4124-9f59-9a341150da8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:00.446691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e981d-c5fc-4124-9f59-9a341150da8e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:00.446979 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e981d-c5fc-4124-9f59-9a341150da8e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:00.447262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e981d-c5fc-4124-9f59-9a341150da8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:00.455338 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e981d-c5fc-4124-9f59-9a341150da8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:00.456860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e981d-c5fc-4124-9f59-9a341150da8e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-146e981d-c5fc-4124-9f59-9a341150da8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:41:00.470552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:00.471493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:00.472410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:41:00.472410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:41:00.472410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:41:00.472410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:41:00.472410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:41:00.472410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:41:00.472410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:00.472410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:00.472410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 422/835] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:00.480105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a6d9f-37f3-4517-af05-9f90ba30941d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:00.591311 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a6d9f-37f3-4517-af05-9f90ba30941d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:00.627964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3ca29-79f7-4944-88ce-4d3b2b37af04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:00.628629 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3ca29-79f7-4944-88ce-4d3b2b37af04 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:00.628915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3ca29-79f7-4944-88ce-4d3b2b37af04 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:00.629192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3ca29-79f7-4944-88ce-4d3b2b37af04 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:00.629947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3ca29-79f7-4944-88ce-4d3b2b37af04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:00.630259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3ca29-79f7-4944-88ce-4d3b2b37af04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:00.631696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3ca29-79f7-4944-88ce-4d3b2b37af04 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:00.645510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 414/836] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:00.653393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e981d-c5fc-4124-9f59-9a341150da8e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:00.727888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:00.783309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e981d-c5fc-4124-9f59-9a341150da8e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:00.821874 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd323d7-260f-49f5-a471-109c5cefbfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:00.822569 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd323d7-260f-49f5-a471-109c5cefbfe5 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:00.822856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd323d7-260f-49f5-a471-109c5cefbfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:00.823141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd323d7-260f-49f5-a471-109c5cefbfe5 None admin] PATH_INFO: `/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/ba31cc812281466f90d0c2bfce49d373/roles/508a2d8d86e0445e83f4adfdbe4c1b43` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:00.840594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd323d7-260f-49f5-a471-109c5cefbfe5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e1649f32d3d494682dc06e05ae34f3d, user_id=ba31cc812281466f90d0c2bfce49d373, role_id=508a2d8d86e0445e83f4adfdbe4c1b43)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:00.842114 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd323d7-260f-49f5-a471-109c5cefbfe5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:00.860532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 423/837] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:41:00 2022] PUT /identity/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/ba31cc812281466f90d0c2bfce49d373/roles/508a2d8d86e0445e83f4adfdbe4c1b43 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:41:01.552329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fa286-93ff-458f-98ba-410b4df0c14f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:01.552871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fa286-93ff-458f-98ba-410b4df0c14f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:01.553186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fa286-93ff-458f-98ba-410b4df0c14f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:01.555170 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 415/838] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:01.560973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed8fae-04ac-4298-b380-9781645da84c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:01.561433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed8fae-04ac-4298-b380-9781645da84c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:01.561735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed8fae-04ac-4298-b380-9781645da84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:01.581793 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a8ed8fae-04ac-4298-b380-9781645da84c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:01.583004 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a8ed8fae-04ac-4298-b380-9781645da84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:01.660234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 424/839] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:01.677676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fa286-93ff-458f-98ba-410b4df0c14f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:01.706511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:01.760086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4457fa-55d0-414b-b8f3-3dd19f7d6fc5 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:01.760762 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4457fa-55d0-414b-b8f3-3dd19f7d6fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:01.761110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4457fa-55d0-414b-b8f3-3dd19f7d6fc5 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:01.762695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 425/840] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:41:01.767663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453774d-ef6a-4a99-a0a0-a18239f591bf None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:01.768188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453774d-ef6a-4a99-a0a0-a18239f591bf None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:01.768675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453774d-ef6a-4a99-a0a0-a18239f591bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:01.787774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fa286-93ff-458f-98ba-410b4df0c14f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:01.788211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8453774d-ef6a-4a99-a0a0-a18239f591bf None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:01.789648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8453774d-ef6a-4a99-a0a0-a18239f591bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:01.815956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:01.827144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61270cc1-9ed0-4bcd-8650-537b2bcb6087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:01.827809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270cc1-9ed0-4bcd-8650-537b2bcb6087 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:01.828060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270cc1-9ed0-4bcd-8650-537b2bcb6087 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:01.828366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270cc1-9ed0-4bcd-8650-537b2bcb6087 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:01.828990 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61270cc1-9ed0-4bcd-8650-537b2bcb6087 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:01.830417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61270cc1-9ed0-4bcd-8650-537b2bcb6087 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-61270cc1-9ed0-4bcd-8650-537b2bcb6087 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:01.840111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:01.841090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:01.847588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 416/841] 10.222.0.17 () {56 vars in 1132 bytes} [Tue Aug 2 08:41:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:01.850445 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61270cc1-9ed0-4bcd-8650-537b2bcb6087 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:01.884236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 426/842] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:01.906479 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453774d-ef6a-4a99-a0a0-a18239f591bf None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:01.976101 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61270cc1-9ed0-4bcd-8650-537b2bcb6087 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:01.984518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:02.014167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc17520-544e-43f6-b083-7f600803c50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:02.014790 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc17520-544e-43f6-b083-7f600803c50b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:02.015073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc17520-544e-43f6-b083-7f600803c50b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:02.015348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc17520-544e-43f6-b083-7f600803c50b None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:02.016027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc17520-544e-43f6-b083-7f600803c50b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:02.016382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc17520-544e-43f6-b083-7f600803c50b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:02.017976 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc17520-544e-43f6-b083-7f600803c50b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:02.023201 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 417/843] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Aug 2 08:41:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:02.029534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc17520-544e-43f6-b083-7f600803c50b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:02.032286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453774d-ef6a-4a99-a0a0-a18239f591bf None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:02.077995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e696d4e-c0c8-4ee0-ab18-25c303c0bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:02.078580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e696d4e-c0c8-4ee0-ab18-25c303c0bc35 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:02.078869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e696d4e-c0c8-4ee0-ab18-25c303c0bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:02.079154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e696d4e-c0c8-4ee0-ab18-25c303c0bc35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:02.090819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e696d4e-c0c8-4ee0-ab18-25c303c0bc35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9e696d4e-c0c8-4ee0-ab18-25c303c0bc35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:02.096202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:02.097126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:02.098407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 427/844] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:41:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:02.106912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e696d4e-c0c8-4ee0-ab18-25c303c0bc35 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:02.131977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:02.147274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc17520-544e-43f6-b083-7f600803c50b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:02.185105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a740ad1-3418-45bb-8cf1-4c0fb8043671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:02.185830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740ad1-3418-45bb-8cf1-4c0fb8043671 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:02.186117 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740ad1-3418-45bb-8cf1-4c0fb8043671 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:02.186389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740ad1-3418-45bb-8cf1-4c0fb8043671 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:02.187065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a740ad1-3418-45bb-8cf1-4c0fb8043671 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:02.187390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a740ad1-3418-45bb-8cf1-4c0fb8043671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:02.188876 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a740ad1-3418-45bb-8cf1-4c0fb8043671 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:02.200560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 418/845] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Aug 2 08:41:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:02.234361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e696d4e-c0c8-4ee0-ab18-25c303c0bc35 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:02.275396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629ae7-3598-42fd-8c94-42d06dccbbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:02.276475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629ae7-3598-42fd-8c94-42d06dccbbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:02.276968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629ae7-3598-42fd-8c94-42d06dccbbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:02.277463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629ae7-3598-42fd-8c94-42d06dccbbd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:02.278403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48629ae7-3598-42fd-8c94-42d06dccbbd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:02.278919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48629ae7-3598-42fd-8c94-42d06dccbbd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:02.280700 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48629ae7-3598-42fd-8c94-42d06dccbbd8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:02.292400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 428/846] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:41:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:02.298469 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a740ad1-3418-45bb-8cf1-4c0fb8043671 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:02.325480 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:02.422194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a740ad1-3418-45bb-8cf1-4c0fb8043671 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:02.457379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd677208-7c4e-4a6c-a3bb-4e6121deb837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:02.458797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd677208-7c4e-4a6c-a3bb-4e6121deb837 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:02.459283 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd677208-7c4e-4a6c-a3bb-4e6121deb837 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:02.459772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd677208-7c4e-4a6c-a3bb-4e6121deb837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:02.471154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd677208-7c4e-4a6c-a3bb-4e6121deb837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:02.473015 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd677208-7c4e-4a6c-a3bb-4e6121deb837 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-bd677208-7c4e-4a6c-a3bb-4e6121deb837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:02.493215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:02.494168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:02.495056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:02.495056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:02.495056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:02.495056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:02.495056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 419/847] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:02.501560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629ae7-3598-42fd-8c94-42d06dccbbd8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:02.505448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979997c-f11c-4d78-857a-481fafb3d9a4 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:02.505742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979997c-f11c-4d78-857a-481fafb3d9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:02.506024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979997c-f11c-4d78-857a-481fafb3d9a4 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:02.509240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 420/848] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:02.514030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063baba8-8c85-4db3-b174-bebbc1c86d76 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:02.514435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063baba8-8c85-4db3-b174-bebbc1c86d76 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:02.514873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063baba8-8c85-4db3-b174-bebbc1c86d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:02.535699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-063baba8-8c85-4db3-b174-bebbc1c86d76 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:02.537203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-063baba8-8c85-4db3-b174-bebbc1c86d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:02.597866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:02.610680 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:02.618210 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 421/849] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:02.628095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629ae7-3598-42fd-8c94-42d06dccbbd8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:02.641063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063baba8-8c85-4db3-b174-bebbc1c86d76 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:02.669826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bda616-14b1-4b07-b91f-97eca9fecfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:02.670810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bda616-14b1-4b07-b91f-97eca9fecfd5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:02.671349 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bda616-14b1-4b07-b91f-97eca9fecfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:02.671863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bda616-14b1-4b07-b91f-97eca9fecfd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:02.672895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bda616-14b1-4b07-b91f-97eca9fecfd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:02.673412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bda616-14b1-4b07-b91f-97eca9fecfd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:02.674990 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bda616-14b1-4b07-b91f-97eca9fecfd5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:02.696155 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 429/850] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:02.697542 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bda616-14b1-4b07-b91f-97eca9fecfd5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:02.761403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063baba8-8c85-4db3-b174-bebbc1c86d76 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:02.807762 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32b0ce-1e53-439d-81fb-6e2311a08088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:02.808435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32b0ce-1e53-439d-81fb-6e2311a08088 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:02.808783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32b0ce-1e53-439d-81fb-6e2311a08088 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:02.813131 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32b0ce-1e53-439d-81fb-6e2311a08088 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:02.813131 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32b0ce-1e53-439d-81fb-6e2311a08088 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:02.813131 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32b0ce-1e53-439d-81fb-6e2311a08088 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:02.827055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bda616-14b1-4b07-b91f-97eca9fecfd5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:02.840648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 422/851] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:41:02 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:41:02.877398 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d927b-5f89-4d63-b027-987d7a28254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:02.878672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d927b-5f89-4d63-b027-987d7a28254d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:02.879353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d927b-5f89-4d63-b027-987d7a28254d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:02.879866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d927b-5f89-4d63-b027-987d7a28254d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:02.885869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:02.891692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d927b-5f89-4d63-b027-987d7a28254d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:02.894012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d927b-5f89-4d63-b027-987d7a28254d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a32d927b-5f89-4d63-b027-987d7a28254d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:41:02.908638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:02.909672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:02.910630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:02.910630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:02.910630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:41:02.910630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:41:02.910630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:41:02.910630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:41:02.910630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:41:02.910630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:41:02.910630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:41:02.910630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:02.913441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 430/852] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:41:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:02.919266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32b0ce-1e53-439d-81fb-6e2311a08088 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:02.967873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67897b-4ff6-4af7-ba16-39a624bdc541 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:02.968529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67897b-4ff6-4af7-ba16-39a624bdc541 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:02.969017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67897b-4ff6-4af7-ba16-39a624bdc541 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:02.971033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 431/853] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:02.977962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c60394-0a43-4793-8e16-6816e5a5d177 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:02.979225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c60394-0a43-4793-8e16-6816e5a5d177 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:02.979731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c60394-0a43-4793-8e16-6816e5a5d177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:03.000300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:03.007694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-06c60394-0a43-4793-8e16-6816e5a5d177 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:03.009026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-06c60394-0a43-4793-8e16-6816e5a5d177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:03.052999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32b0ce-1e53-439d-81fb-6e2311a08088 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:03.095856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 432/854] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:03.097456 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee26bc-eb2b-44bb-a549-9dfc311f7dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:03.098087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee26bc-eb2b-44bb-a549-9dfc311f7dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:03.098372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee26bc-eb2b-44bb-a549-9dfc311f7dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:03.098649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee26bc-eb2b-44bb-a549-9dfc311f7dc6 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:03.099442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee26bc-eb2b-44bb-a549-9dfc311f7dc6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:03.099753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee26bc-eb2b-44bb-a549-9dfc311f7dc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:03.101287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee26bc-eb2b-44bb-a549-9dfc311f7dc6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:03.125026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c60394-0a43-4793-8e16-6816e5a5d177 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:03.125329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 423/855] 10.222.0.17 () {56 vars in 1135 bytes} [Tue Aug 2 08:41:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:03.133074 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee26bc-eb2b-44bb-a549-9dfc311f7dc6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:03.259075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c60394-0a43-4793-8e16-6816e5a5d177 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:03.266629 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee26bc-eb2b-44bb-a549-9dfc311f7dc6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:03.293102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:03.294849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:03.310072 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea414844-85dc-4bdf-a0da-6826861e90b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:03.310720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea414844-85dc-4bdf-a0da-6826861e90b4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:03.311004 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea414844-85dc-4bdf-a0da-6826861e90b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:03.311281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea414844-85dc-4bdf-a0da-6826861e90b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:03.324425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080bf96-9ace-4825-9a79-fe64745fce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:03.325052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080bf96-9ace-4825-9a79-fe64745fce4b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:03.325341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080bf96-9ace-4825-9a79-fe64745fce4b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:03.325611 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080bf96-9ace-4825-9a79-fe64745fce4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:03.327039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea414844-85dc-4bdf-a0da-6826861e90b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ea414844-85dc-4bdf-a0da-6826861e90b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:03.333958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:03.334898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:03.335832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:03.335832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:03.335832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:03.335832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:03.335832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:03.335832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:03.335832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:03.335832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:03.335832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:03.335832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:03.335832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:41:03.335832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:03.343861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 433/856] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:41:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:03.345048 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea414844-85dc-4bdf-a0da-6826861e90b4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:03.438477 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080bf96-9ace-4825-9a79-fe64745fce4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:03.440317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080bf96-9ace-4825-9a79-fe64745fce4b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:03.487390 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea414844-85dc-4bdf-a0da-6826861e90b4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:03.532431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80183fa-2312-43c6-9033-b5160dc518d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:03.532978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80183fa-2312-43c6-9033-b5160dc518d0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:03.533273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80183fa-2312-43c6-9033-b5160dc518d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:03.533556 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80183fa-2312-43c6-9033-b5160dc518d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:03.534283 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80183fa-2312-43c6-9033-b5160dc518d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:03.534599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80183fa-2312-43c6-9033-b5160dc518d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:03.535982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80183fa-2312-43c6-9033-b5160dc518d0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:03.551383 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 434/857] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:41:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:03.552463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80183fa-2312-43c6-9033-b5160dc518d0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:03.573784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 424/858] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:41:03 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:41:03.579042 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080bf96-9ace-4825-9a79-fe64745fce4b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:03.600505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:03.622045 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:03.697064 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080bf96-9ace-4825-9a79-fe64745fce4b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:03.698968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80183fa-2312-43c6-9033-b5160dc518d0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:03.737434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d4a19-3d01-4081-9aa4-dca2f23584ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:03.738237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d4a19-3d01-4081-9aa4-dca2f23584ec None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:03.738638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d4a19-3d01-4081-9aa4-dca2f23584ec None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:03.739013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d4a19-3d01-4081-9aa4-dca2f23584ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:03.746821 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f02ded-9786-425e-9947-66f3f2dd6ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:03.748205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f02ded-9786-425e-9947-66f3f2dd6ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:03.748649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f02ded-9786-425e-9947-66f3f2dd6ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:03.749098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f02ded-9786-425e-9947-66f3f2dd6ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:03.753795 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d4a19-3d01-4081-9aa4-dca2f23584ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:03.755666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d4a19-3d01-4081-9aa4-dca2f23584ec None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:03.766188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f02ded-9786-425e-9947-66f3f2dd6ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:03.767954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f02ded-9786-425e-9947-66f3f2dd6ef8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-ed7d4a19-3d01-4081-9aa4-dca2f23584ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:03.773541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:03.774449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:03.775324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:03.775324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:03.775324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:03.775324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:03.780036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 425/859] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:03.781084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d4a19-3d01-4081-9aa4-dca2f23584ec None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-84f02ded-9786-425e-9947-66f3f2dd6ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:03.788435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:03.789827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:03.790709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:03.790709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:03.790709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:03.790709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:03.792956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 435/860] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:03.798324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f02ded-9786-425e-9947-66f3f2dd6ef8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:03.872376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:03.912400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d4a19-3d01-4081-9aa4-dca2f23584ec None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:03.933379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:03.938324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f02ded-9786-425e-9947-66f3f2dd6ef8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:03.956422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32576353-1c1e-4d5a-bdb4-788833e91a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:03.957412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32576353-1c1e-4d5a-bdb4-788833e91a04 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:03.957707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32576353-1c1e-4d5a-bdb4-788833e91a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:03.958296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32576353-1c1e-4d5a-bdb4-788833e91a04 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:03.960049 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32576353-1c1e-4d5a-bdb4-788833e91a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:03.960537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32576353-1c1e-4d5a-bdb4-788833e91a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:03.962376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32576353-1c1e-4d5a-bdb4-788833e91a04 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:03.980282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 426/861] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:03.983976 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32576353-1c1e-4d5a-bdb4-788833e91a04 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:03.989680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993e933-b0d3-42c0-aa1d-706d79d23600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:03.990319 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993e933-b0d3-42c0-aa1d-706d79d23600 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:03.990605 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993e933-b0d3-42c0-aa1d-706d79d23600 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:03.990881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993e933-b0d3-42c0-aa1d-706d79d23600 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:03.991608 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993e933-b0d3-42c0-aa1d-706d79d23600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:03.992485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993e933-b0d3-42c0-aa1d-706d79d23600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:03.994229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993e933-b0d3-42c0-aa1d-706d79d23600 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:04.010803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 436/862] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:04.016417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993e933-b0d3-42c0-aa1d-706d79d23600 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:04.130357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32576353-1c1e-4d5a-bdb4-788833e91a04 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:04.134266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993e933-b0d3-42c0-aa1d-706d79d23600 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:04.162831 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:04.170502 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2683c2-278a-4901-8878-255b7a8a39de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:04.171146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2683c2-278a-4901-8878-255b7a8a39de None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:04.171426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2683c2-278a-4901-8878-255b7a8a39de None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:04.171698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2683c2-278a-4901-8878-255b7a8a39de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:04.177826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1098f81-f144-4f21-ab7e-4a3d9d9662ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:04.178717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1098f81-f144-4f21-ab7e-4a3d9d9662ea None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:04.178844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2683c2-278a-4901-8878-255b7a8a39de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:04.179346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1098f81-f144-4f21-ab7e-4a3d9d9662ea None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:04.179817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1098f81-f144-4f21-ab7e-4a3d9d9662ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:04.180748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2683c2-278a-4901-8878-255b7a8a39de None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:04.188240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1098f81-f144-4f21-ab7e-4a3d9d9662ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:04.190218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1098f81-f144-4f21-ab7e-4a3d9d9662ea None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-2d2683c2-278a-4901-8878-255b7a8a39de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:41:04.192845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:04.193789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:04.194676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:41:04.194676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:41:04.194676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:41:04.194676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:41:04.194676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:41:04.194676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:41:04.194676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:04.194676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:04.198808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 427/863] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:04.199674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2683c2-278a-4901-8878-255b7a8a39de None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c1098f81-f144-4f21-ab7e-4a3d9d9662ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:41:04.206670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:04.207615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:04.208910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:04.208910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:04.208910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:41:04.208910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:41:04.208910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:41:04.208910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:41:04.208910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:41:04.208910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:41:04.208910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:41:04.208910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:04.211935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 437/864] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Aug 2 08:41:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:04.221692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1098f81-f144-4f21-ab7e-4a3d9d9662ea None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:04.245713 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:04.332077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2683c2-278a-4901-8878-255b7a8a39de None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:04.346914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1098f81-f144-4f21-ab7e-4a3d9d9662ea None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:04.372080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe1390-ec38-4de3-b40e-6fc576db4434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:04.373084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe1390-ec38-4de3-b40e-6fc576db4434 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:04.373509 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe1390-ec38-4de3-b40e-6fc576db4434 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:04.373922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe1390-ec38-4de3-b40e-6fc576db4434 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:04.374915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe1390-ec38-4de3-b40e-6fc576db4434 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:04.375465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe1390-ec38-4de3-b40e-6fc576db4434 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:04.377069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe1390-ec38-4de3-b40e-6fc576db4434 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:04.384020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666dada-83d5-4119-a3db-38ef6c8a4d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:04.384718 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666dada-83d5-4119-a3db-38ef6c8a4d5b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:04.385095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666dada-83d5-4119-a3db-38ef6c8a4d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:04.385469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666dada-83d5-4119-a3db-38ef6c8a4d5b None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:04.386552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666dada-83d5-4119-a3db-38ef6c8a4d5b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:04.386783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666dada-83d5-4119-a3db-38ef6c8a4d5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:04.388494 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666dada-83d5-4119-a3db-38ef6c8a4d5b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:04.397488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 428/865] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:41:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:04.398933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe1390-ec38-4de3-b40e-6fc576db4434 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:04.409182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 438/866] 10.222.0.17 () {56 vars in 1149 bytes} [Tue Aug 2 08:41:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:04.415563 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666dada-83d5-4119-a3db-38ef6c8a4d5b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:04.464447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:04.503073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:04.524606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe1390-ec38-4de3-b40e-6fc576db4434 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:04.527469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666dada-83d5-4119-a3db-38ef6c8a4d5b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:04.563767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24729393-a737-45ae-a1b5-6239b5d52d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:04.563976 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c31304-2bc5-4285-a201-ed204a12a9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:04.564590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24729393-a737-45ae-a1b5-6239b5d52d7c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:04.564772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c31304-2bc5-4285-a201-ed204a12a9ba None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:04.565014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24729393-a737-45ae-a1b5-6239b5d52d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:04.565171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c31304-2bc5-4285-a201-ed204a12a9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:04.565429 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24729393-a737-45ae-a1b5-6239b5d52d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:04.565521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c31304-2bc5-4285-a201-ed204a12a9ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:04.566465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c31304-2bc5-4285-a201-ed204a12a9ba None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=d182c7050f0040559f69a231bee6dccf) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:04.566787 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c31304-2bc5-4285-a201-ed204a12a9ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:04.568412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c31304-2bc5-4285-a201-ed204a12a9ba None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:04.580221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 429/867] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:41:04 2022] GET /identity/v3/role_assignments?user.id=d182c7050f0040559f69a231bee6dccf&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:04.580221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd687f-f28b-41c7-bf1b-d99d30e7ccf3 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:04.580221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd687f-f28b-41c7-bf1b-d99d30e7ccf3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:04.580221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd687f-f28b-41c7-bf1b-d99d30e7ccf3 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:04.580221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 430/868] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:04.590135 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008140-0917-4e37-9b2d-8f316b2fb2a2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:04.590515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008140-0917-4e37-9b2d-8f316b2fb2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:04.590864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008140-0917-4e37-9b2d-8f316b2fb2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:04.611236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a6008140-0917-4e37-9b2d-8f316b2fb2a2 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:04.612622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a6008140-0917-4e37-9b2d-8f316b2fb2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:04.669292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24729393-a737-45ae-a1b5-6239b5d52d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:04.671403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24729393-a737-45ae-a1b5-6239b5d52d7c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:04.712301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 431/869] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:04.737352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6008140-0917-4e37-9b2d-8f316b2fb2a2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:04.784188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:04.798383 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:04.819100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 439/870] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:41:04 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:41:04.824728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24729393-a737-45ae-a1b5-6239b5d52d7c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:04.871290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6008140-0917-4e37-9b2d-8f316b2fb2a2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:04.916710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c2c85-4d4a-4ad8-9977-ca9a06f67f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:04.917429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c2c85-4d4a-4ad8-9977-ca9a06f67f51 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:04.917782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c2c85-4d4a-4ad8-9977-ca9a06f67f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:04.918127 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c2c85-4d4a-4ad8-9977-ca9a06f67f51 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:04.919150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c2c85-4d4a-4ad8-9977-ca9a06f67f51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:04.921423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c2c85-4d4a-4ad8-9977-ca9a06f67f51 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:04.940535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24729393-a737-45ae-a1b5-6239b5d52d7c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:04.940727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 432/871] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:41:04 2022] POST /identity/v3/services => generated 269 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:41:04.988424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c11ae-4477-449e-b9d2-3cb2b0848c2f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:04.988754 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c11ae-4477-449e-b9d2-3cb2b0848c2f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:04.989005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c11ae-4477-449e-b9d2-3cb2b0848c2f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:04.992392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df400147-c1f6-48b5-a84e-e3290cd643b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:04.993369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400147-c1f6-48b5-a84e-e3290cd643b4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:04.993864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400147-c1f6-48b5-a84e-e3290cd643b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:04.994364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400147-c1f6-48b5-a84e-e3290cd643b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:04.994898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 433/872] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:41:04.997045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cfb0-6f39-48dd-b0b9-e7a7e15408d4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:04.997350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cfb0-6f39-48dd-b0b9-e7a7e15408d4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:04.997610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cfb0-6f39-48dd-b0b9-e7a7e15408d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:05.008989 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df400147-c1f6-48b5-a84e-e3290cd643b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:05.010847 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df400147-c1f6-48b5-a84e-e3290cd643b4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:05.017897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7c69cfb0-6f39-48dd-b0b9-e7a7e15408d4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:05.019136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7c69cfb0-6f39-48dd-b0b9-e7a7e15408d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-df400147-c1f6-48b5-a84e-e3290cd643b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:05.029415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:05.030665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:05.031710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:05.031710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:05.031710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:05.031710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:05.032916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 440/873] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:05.045204 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df400147-c1f6-48b5-a84e-e3290cd643b4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:05.079604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:05.113357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 434/874] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:05.136251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cfb0-6f39-48dd-b0b9-e7a7e15408d4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:05.159699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df400147-c1f6-48b5-a84e-e3290cd643b4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:05.182150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:05.212855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb082a1f-52e1-4911-b527-6dd9a098849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:05.213754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb082a1f-52e1-4911-b527-6dd9a098849f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:05.214044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb082a1f-52e1-4911-b527-6dd9a098849f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:05.214327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb082a1f-52e1-4911-b527-6dd9a098849f None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:05.215026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb082a1f-52e1-4911-b527-6dd9a098849f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:05.215337 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb082a1f-52e1-4911-b527-6dd9a098849f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:05.217397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb082a1f-52e1-4911-b527-6dd9a098849f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:05.233785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 441/875] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:05.244173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb082a1f-52e1-4911-b527-6dd9a098849f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:05.274992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cfb0-6f39-48dd-b0b9-e7a7e15408d4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:05.324215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980386a8-d5e1-4c58-aee2-fc73021fb903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:05.325759 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980386a8-d5e1-4c58-aee2-fc73021fb903 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:05.326249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980386a8-d5e1-4c58-aee2-fc73021fb903 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:05.326754 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980386a8-d5e1-4c58-aee2-fc73021fb903 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:05.327981 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980386a8-d5e1-4c58-aee2-fc73021fb903 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:05.330341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980386a8-d5e1-4c58-aee2-fc73021fb903 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:05.336437 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-980386a8-d5e1-4c58-aee2-fc73021fb903 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:05.347197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:05.348331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:41:05.349163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:05.353057 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 435/876] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:41:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:05.356459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980386a8-d5e1-4c58-aee2-fc73021fb903 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:05.367698 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb082a1f-52e1-4911-b527-6dd9a098849f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:05.416372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c270647-64e4-49c2-969c-61ab4bf9c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:05.417120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c270647-64e4-49c2-969c-61ab4bf9c97d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:05.417479 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c270647-64e4-49c2-969c-61ab4bf9c97d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:05.417873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c270647-64e4-49c2-969c-61ab4bf9c97d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:05.428328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c270647-64e4-49c2-969c-61ab4bf9c97d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:05.430192 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c270647-64e4-49c2-969c-61ab4bf9c97d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9c270647-64e4-49c2-969c-61ab4bf9c97d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:41:05.446394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:05.447302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:05.448676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:41:05.448676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:41:05.448676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:41:05.448676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:41:05.448676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:41:05.448676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:41:05.448676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:05.448676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:05.448676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 442/877] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:05.456080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c270647-64e4-49c2-969c-61ab4bf9c97d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:05.474025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:05.478090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980386a8-d5e1-4c58-aee2-fc73021fb903 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:05.523706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d21be6-5771-4b24-a9f5-f65a0af28bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:05.524795 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d21be6-5771-4b24-a9f5-f65a0af28bea None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:05.525283 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d21be6-5771-4b24-a9f5-f65a0af28bea None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:05.525805 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d21be6-5771-4b24-a9f5-f65a0af28bea None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:05.526698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d21be6-5771-4b24-a9f5-f65a0af28bea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:05.527254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d21be6-5771-4b24-a9f5-f65a0af28bea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:05.528852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d21be6-5771-4b24-a9f5-f65a0af28bea None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:05.534256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 436/878] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:41:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:05.540266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d21be6-5771-4b24-a9f5-f65a0af28bea None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:05.596306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c270647-64e4-49c2-969c-61ab4bf9c97d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:05.633926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3531365-6840-4e6c-841f-7648b182ecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:05.634992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3531365-6840-4e6c-841f-7648b182ecd6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:05.635643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3531365-6840-4e6c-841f-7648b182ecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:05.636378 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3531365-6840-4e6c-841f-7648b182ecd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:05.637517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3531365-6840-4e6c-841f-7648b182ecd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:05.638057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3531365-6840-4e6c-841f-7648b182ecd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:05.639914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3531365-6840-4e6c-841f-7648b182ecd6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:05.661773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 443/879] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:41:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:05.663132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3531365-6840-4e6c-841f-7648b182ecd6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:05.672170 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d21be6-5771-4b24-a9f5-f65a0af28bea None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:05.674707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:05.718369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79535d-a122-4740-92eb-a5165735c3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:05.718903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79535d-a122-4740-92eb-a5165735c3db None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:05.719190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79535d-a122-4740-92eb-a5165735c3db None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:05.719471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79535d-a122-4740-92eb-a5165735c3db None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:05.720472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79535d-a122-4740-92eb-a5165735c3db None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:05.720781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79535d-a122-4740-92eb-a5165735c3db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:05.722166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79535d-a122-4740-92eb-a5165735c3db None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:05.732207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 437/880] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:41:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:05.736508 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79535d-a122-4740-92eb-a5165735c3db None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:05.774541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:05.808263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3531365-6840-4e6c-841f-7648b182ecd6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:05.858545 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a565704-a855-4967-a432-5948bb75d762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:05.860244 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a565704-a855-4967-a432-5948bb75d762 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:05.860776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a565704-a855-4967-a432-5948bb75d762 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:05.861278 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a565704-a855-4967-a432-5948bb75d762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:05.862363 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a565704-a855-4967-a432-5948bb75d762 None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=ba31cc812281466f90d0c2bfce49d373) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:05.862921 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a565704-a855-4967-a432-5948bb75d762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:05.864980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a565704-a855-4967-a432-5948bb75d762 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:05.865530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79535d-a122-4740-92eb-a5165735c3db None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:05.873067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 444/881] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:41:05 2022] GET /identity/v3/role_assignments?user.id=ba31cc812281466f90d0c2bfce49d373&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:05.903898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f5f07-3927-431b-b7fc-d6f06968d2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:05.904618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f5f07-3927-431b-b7fc-d6f06968d2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:05.904928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f5f07-3927-431b-b7fc-d6f06968d2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:05.905223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f5f07-3927-431b-b7fc-d6f06968d2f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:05.906055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f5f07-3927-431b-b7fc-d6f06968d2f0 None admin] RBAC: Adding query filter params (interface=public, service_id=f0f3654055794d21be10f4837494c51c, region_id=RegionOne) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:05.906370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f5f07-3927-431b-b7fc-d6f06968d2f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:05.907840 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f5f07-3927-431b-b7fc-d6f06968d2f0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:05.918901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 438/882] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Aug 2 08:41:05 2022] GET /identity/v3/endpoints?service_id=f0f3654055794d21be10f4837494c51c&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:05.920399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a565704-a855-4967-a432-5948bb75d762 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:06.003075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:06.045588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a565704-a855-4967-a432-5948bb75d762 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:06.082006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f3f87-0300-4fca-9383-a64210a5555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:06.082626 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f3f87-0300-4fca-9383-a64210a5555d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:06.082907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f3f87-0300-4fca-9383-a64210a5555d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:06.083239 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f3f87-0300-4fca-9383-a64210a5555d None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:06.084172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f3f87-0300-4fca-9383-a64210a5555d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:06.086169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f3f87-0300-4fca-9383-a64210a5555d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:06.092396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 445/883] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Aug 2 08:41:05 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:41:06.811344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237d693-ba49-4aab-a0f3-1193246b9aaa None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:06.811344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237d693-ba49-4aab-a0f3-1193246b9aaa None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:06.811344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237d693-ba49-4aab-a0f3-1193246b9aaa None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:06.811968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 439/884] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:06.817489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703c257-09fc-4450-92d3-40ec2e48ca2d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:06.817909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703c257-09fc-4450-92d3-40ec2e48ca2d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:06.818195 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703c257-09fc-4450-92d3-40ec2e48ca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:06.837458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b703c257-09fc-4450-92d3-40ec2e48ca2d None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:06.838800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b703c257-09fc-4450-92d3-40ec2e48ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:06.916238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 446/885] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:06.933674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237d693-ba49-4aab-a0f3-1193246b9aaa None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:07.030656 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:07.042791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237d693-ba49-4aab-a0f3-1193246b9aaa None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:07.077333 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979b690-2e0b-4859-9508-4f8a853070e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:07.077904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979b690-2e0b-4859-9508-4f8a853070e7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:07.078188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979b690-2e0b-4859-9508-4f8a853070e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:07.078465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979b690-2e0b-4859-9508-4f8a853070e7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:07.079090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979b690-2e0b-4859-9508-4f8a853070e7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:07.080558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979b690-2e0b-4859-9508-4f8a853070e7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-4979b690-2e0b-4859-9508-4f8a853070e7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:07.090631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:07.091719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:07.092665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:07.096203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 440/886] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Aug 2 08:41:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:07.097731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839508e-6f98-453b-94d0-2b007d818a8d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:07.098027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839508e-6f98-453b-94d0-2b007d818a8d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:07.098310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839508e-6f98-453b-94d0-2b007d818a8d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:07.099732 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 447/887] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:07.102997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979b690-2e0b-4859-9508-4f8a853070e7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:07.106356 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd5dd3-bb8f-4444-b8b3-cbf7a18af467 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:07.106682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd5dd3-bb8f-4444-b8b3-cbf7a18af467 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:07.106962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd5dd3-bb8f-4444-b8b3-cbf7a18af467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:07.125449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-14fd5dd3-bb8f-4444-b8b3-cbf7a18af467 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:07.126651 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-14fd5dd3-bb8f-4444-b8b3-cbf7a18af467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:07.191938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:07.204460 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 448/888] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:07.213118 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979b690-2e0b-4859-9508-4f8a853070e7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:07.225962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd5dd3-bb8f-4444-b8b3-cbf7a18af467 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:07.262280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c17e2-8ad8-42a4-844a-5d35129e2e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:07.263368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c17e2-8ad8-42a4-844a-5d35129e2e29 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:07.263847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c17e2-8ad8-42a4-844a-5d35129e2e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:07.264331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c17e2-8ad8-42a4-844a-5d35129e2e29 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:07.265236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c17e2-8ad8-42a4-844a-5d35129e2e29 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:07.265734 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c17e2-8ad8-42a4-844a-5d35129e2e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:07.267305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c17e2-8ad8-42a4-844a-5d35129e2e29 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:07.280159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 441/889] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Aug 2 08:41:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:07.284240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c17e2-8ad8-42a4-844a-5d35129e2e29 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:07.310861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:07.363010 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd5dd3-bb8f-4444-b8b3-cbf7a18af467 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:07.404050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d61d5-1afc-4457-bf15-9d7c6773a100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:07.405042 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d61d5-1afc-4457-bf15-9d7c6773a100 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:07.405441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d61d5-1afc-4457-bf15-9d7c6773a100 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:07.405899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d61d5-1afc-4457-bf15-9d7c6773a100 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:07.406570 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d61d5-1afc-4457-bf15-9d7c6773a100 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:07.408767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d61d5-1afc-4457-bf15-9d7c6773a100 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-535d61d5-1afc-4457-bf15-9d7c6773a100 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:07.420646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:07.421839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:41:07.422815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:07.423894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 449/890] 10.222.0.17 () {56 vars in 1132 bytes} [Tue Aug 2 08:41:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:07.428137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c17e2-8ad8-42a4-844a-5d35129e2e29 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:07.429843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d61d5-1afc-4457-bf15-9d7c6773a100 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:07.466213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94961-6203-4b7c-acde-18b8325cda6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:07.466979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94961-6203-4b7c-acde-18b8325cda6f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:07.467360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94961-6203-4b7c-acde-18b8325cda6f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:07.467732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94961-6203-4b7c-acde-18b8325cda6f None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:07.468545 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c94961-6203-4b7c-acde-18b8325cda6f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:07.468970 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c94961-6203-4b7c-acde-18b8325cda6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:07.470554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c94961-6203-4b7c-acde-18b8325cda6f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:07.484224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 442/891] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Aug 2 08:41:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:07.500569 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:07.550094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d61d5-1afc-4457-bf15-9d7c6773a100 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:07.594949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55f3dc-bf36-4b20-b862-e3f399981c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:07.595613 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55f3dc-bf36-4b20-b862-e3f399981c4d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:07.595905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55f3dc-bf36-4b20-b862-e3f399981c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:07.596274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55f3dc-bf36-4b20-b862-e3f399981c4d None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:07.597394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55f3dc-bf36-4b20-b862-e3f399981c4d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:07.597719 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55f3dc-bf36-4b20-b862-e3f399981c4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:07.599124 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55f3dc-bf36-4b20-b862-e3f399981c4d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:07.606245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 450/892] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Aug 2 08:41:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:07.612289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94961-6203-4b7c-acde-18b8325cda6f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:07.707301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:07.728954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94961-6203-4b7c-acde-18b8325cda6f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:07.767496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105016c-a0b1-4085-9f95-d5708427d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:07.768130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105016c-a0b1-4085-9f95-d5708427d79c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:07.768419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105016c-a0b1-4085-9f95-d5708427d79c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:07.768689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105016c-a0b1-4085-9f95-d5708427d79c None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:07.769370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105016c-a0b1-4085-9f95-d5708427d79c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:07.769704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105016c-a0b1-4085-9f95-d5708427d79c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:07.771460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105016c-a0b1-4085-9f95-d5708427d79c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:07.778124 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 443/893] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Aug 2 08:41:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:07.784208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55f3dc-bf36-4b20-b862-e3f399981c4d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:07.890457 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55f3dc-bf36-4b20-b862-e3f399981c4d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:07.914670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:07.926828 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d03fa2-646e-4556-9b30-028f1179ca83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:07.927641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d03fa2-646e-4556-9b30-028f1179ca83 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:07.927991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d03fa2-646e-4556-9b30-028f1179ca83 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:07.928507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d03fa2-646e-4556-9b30-028f1179ca83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:07.929309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d03fa2-646e-4556-9b30-028f1179ca83 None admin] RBAC: Adding query filter params (interface=public, service_id=4e73fe00f53f446682576604345eace8, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:07.929628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d03fa2-646e-4556-9b30-028f1179ca83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:07.931009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d03fa2-646e-4556-9b30-028f1179ca83 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:07.936942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 451/894] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Aug 2 08:41:07 2022] GET /identity/v3/endpoints?service_id=4e73fe00f53f446682576604345eace8&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:07.942490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105016c-a0b1-4085-9f95-d5708427d79c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:08.055732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105016c-a0b1-4085-9f95-d5708427d79c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:08.067045 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c634933-8e58-40a0-aed9-1a341ee7e538 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:08.067354 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c634933-8e58-40a0-aed9-1a341ee7e538 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:08.067615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c634933-8e58-40a0-aed9-1a341ee7e538 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:08.069305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 452/895] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:08.074684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e69ff8-30a3-49b7-8807-0522a7af4038 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:08.075259 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e69ff8-30a3-49b7-8807-0522a7af4038 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:08.075763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e69ff8-30a3-49b7-8807-0522a7af4038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:08.097572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d5e69ff8-30a3-49b7-8807-0522a7af4038 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:08.098593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d6a6f-fb8c-4f9f-80d0-30aea6c3022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:08.099230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d6a6f-fb8c-4f9f-80d0-30aea6c3022f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:08.099514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d6a6f-fb8c-4f9f-80d0-30aea6c3022f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:08.099788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d6a6f-fb8c-4f9f-80d0-30aea6c3022f None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:08.100081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d5e69ff8-30a3-49b7-8807-0522a7af4038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:08.100473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d6a6f-fb8c-4f9f-80d0-30aea6c3022f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:08.102400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d6a6f-fb8c-4f9f-80d0-30aea6c3022f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:08.109224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 444/896] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Aug 2 08:41:07 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:41:08.181956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 453/897] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:08.206604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d6a6f-fb8c-4f9f-80d0-30aea6c3022f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:08.221808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:08.275273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed246e-cb6f-4359-8158-9927dc711e71 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:08.275565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed246e-cb6f-4359-8158-9927dc711e71 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:08.275869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed246e-cb6f-4359-8158-9927dc711e71 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:08.277341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 454/898] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:41:08.283250 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb268743-ee1c-46a1-bf2e-e2740b1dbf31 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:08.283250 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb268743-ee1c-46a1-bf2e-e2740b1dbf31 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:08.283465 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb268743-ee1c-46a1-bf2e-e2740b1dbf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:08.303549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fb268743-ee1c-46a1-bf2e-e2740b1dbf31 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:08.305358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fb268743-ee1c-46a1-bf2e-e2740b1dbf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:08.326713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d6a6f-fb8c-4f9f-80d0-30aea6c3022f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:08.374397 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759592f7-6001-4772-b8d8-959d9ef835ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:08.375316 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759592f7-6001-4772-b8d8-959d9ef835ff None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:08.375604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759592f7-6001-4772-b8d8-959d9ef835ff None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:08.375907 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759592f7-6001-4772-b8d8-959d9ef835ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:08.379598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 455/899] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:08.387080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759592f7-6001-4772-b8d8-959d9ef835ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-759592f7-6001-4772-b8d8-959d9ef835ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:08.392389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:08.393369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:08.394247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 445/900] 10.222.0.17 () {56 vars in 1120 bytes} [Tue Aug 2 08:41:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:08.401776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb268743-ee1c-46a1-bf2e-e2740b1dbf31 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:08.402960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759592f7-6001-4772-b8d8-959d9ef835ff None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:08.454664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:08.497850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:08.528446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb268743-ee1c-46a1-bf2e-e2740b1dbf31 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:08.532668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759592f7-6001-4772-b8d8-959d9ef835ff None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:08.570077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fef60-0ec5-429e-83e4-ec14052b0736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:08.570726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fef60-0ec5-429e-83e4-ec14052b0736 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:08.571011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fef60-0ec5-429e-83e4-ec14052b0736 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:08.571293 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fef60-0ec5-429e-83e4-ec14052b0736 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:08.571937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fef60-0ec5-429e-83e4-ec14052b0736 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:08.573558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fef60-0ec5-429e-83e4-ec14052b0736 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:08.575109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402485b-0a17-4245-ae49-24377e4906a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:08.576267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402485b-0a17-4245-ae49-24377e4906a1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:08.577218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402485b-0a17-4245-ae49-24377e4906a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:08.577811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402485b-0a17-4245-ae49-24377e4906a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:08.578808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402485b-0a17-4245-ae49-24377e4906a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:08.579291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402485b-0a17-4245-ae49-24377e4906a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:08.580861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402485b-0a17-4245-ae49-24377e4906a1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-060fef60-0ec5-429e-83e4-ec14052b0736 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:08.583965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:08.584987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:08.586328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 446/901] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:41:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:08.593562 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fef60-0ec5-429e-83e4-ec14052b0736 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:08.595011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 456/902] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Aug 2 08:41:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:08.603451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402485b-0a17-4245-ae49-24377e4906a1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:08.715659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fef60-0ec5-429e-83e4-ec14052b0736 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:08.718081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402485b-0a17-4245-ae49-24377e4906a1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:08.732568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:08.761151 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d4f4d-bc91-4dbd-a9e4-d5c79d751780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:08.761920 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d4f4d-bc91-4dbd-a9e4-d5c79d751780 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:08.762207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d4f4d-bc91-4dbd-a9e4-d5c79d751780 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:08.762486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d4f4d-bc91-4dbd-a9e4-d5c79d751780 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:08.763212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d4f4d-bc91-4dbd-a9e4-d5c79d751780 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:08.763484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d4f4d-bc91-4dbd-a9e4-d5c79d751780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:08.764903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d4f4d-bc91-4dbd-a9e4-d5c79d751780 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:08.766263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:08.768550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af457c-df45-4dc0-9366-87eb9f899ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:08.769753 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af457c-df45-4dc0-9366-87eb9f899ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:08.770233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af457c-df45-4dc0-9366-87eb9f899ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:08.770740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af457c-df45-4dc0-9366-87eb9f899ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:08.771404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 447/903] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:41:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:08.776686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d4f4d-bc91-4dbd-a9e4-d5c79d751780 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:08.784176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af457c-df45-4dc0-9366-87eb9f899ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:08.785996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af457c-df45-4dc0-9366-87eb9f899ee1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a5af457c-df45-4dc0-9366-87eb9f899ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:08.808020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:08.808946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:08.809819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:08.809819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:08.809819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:08.809819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:08.809819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 457/904] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:08.815385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af457c-df45-4dc0-9366-87eb9f899ee1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:08.905693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d4f4d-bc91-4dbd-a9e4-d5c79d751780 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:08.948910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af457c-df45-4dc0-9366-87eb9f899ee1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:08.953214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b040d-b104-44d8-b971-a6d5fed9d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:08.953943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b040d-b104-44d8-b971-a6d5fed9d31a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:08.954301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b040d-b104-44d8-b971-a6d5fed9d31a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:08.954647 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b040d-b104-44d8-b971-a6d5fed9d31a None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:08.955403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b040d-b104-44d8-b971-a6d5fed9d31a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:08.955784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b040d-b104-44d8-b971-a6d5fed9d31a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:08.957307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b040d-b104-44d8-b971-a6d5fed9d31a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:08.964532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 448/905] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Aug 2 08:41:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:08.969932 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b040d-b104-44d8-b971-a6d5fed9d31a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:08.991320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa29c2-2ec6-40f3-b26a-2c5dc453fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:08.993134 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa29c2-2ec6-40f3-b26a-2c5dc453fcff None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:08.993626 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa29c2-2ec6-40f3-b26a-2c5dc453fcff None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:08.994101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa29c2-2ec6-40f3-b26a-2c5dc453fcff None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:08.995006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa29c2-2ec6-40f3-b26a-2c5dc453fcff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:08.995514 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa29c2-2ec6-40f3-b26a-2c5dc453fcff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:08.997282 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa29c2-2ec6-40f3-b26a-2c5dc453fcff None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:09.010483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 458/906] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:09.015580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa29c2-2ec6-40f3-b26a-2c5dc453fcff None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:09.036910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:09.040284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:09.079837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b040d-b104-44d8-b971-a6d5fed9d31a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:09.115810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bec3cb-8842-4353-b374-c96bafc134ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:09.116460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bec3cb-8842-4353-b374-c96bafc134ab None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:09.116914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bec3cb-8842-4353-b374-c96bafc134ab None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:09.117193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bec3cb-8842-4353-b374-c96bafc134ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:09.117907 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bec3cb-8842-4353-b374-c96bafc134ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:09.119254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bec3cb-8842-4353-b374-c96bafc134ab None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:09.128520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa29c2-2ec6-40f3-b26a-2c5dc453fcff None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:09.148883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 449/907] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:41:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:41:09.175579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d8130-1e2d-4e92-9406-c8ebea463f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:09.176617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d8130-1e2d-4e92-9406-c8ebea463f4a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:09.177131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d8130-1e2d-4e92-9406-c8ebea463f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:09.177610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d8130-1e2d-4e92-9406-c8ebea463f4a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:09.187450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d8130-1e2d-4e92-9406-c8ebea463f4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:09.189326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d8130-1e2d-4e92-9406-c8ebea463f4a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-997d8130-1e2d-4e92-9406-c8ebea463f4a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:41:09.206567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:09.207638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:09.208901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:09.208901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:09.208901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:41:09.208901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:41:09.208901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:41:09.208901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:41:09.208901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:41:09.208901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:41:09.208901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:41:09.208901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:09.212346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 459/908] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Aug 2 08:41:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:09.221341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bec3cb-8842-4353-b374-c96bafc134ab None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:09.349934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bec3cb-8842-4353-b374-c96bafc134ab None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:09.369359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:09.390219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42570bab-ffcc-46af-8ac2-1e6603510043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:09.390841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42570bab-ffcc-46af-8ac2-1e6603510043 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:09.391130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42570bab-ffcc-46af-8ac2-1e6603510043 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:09.391406 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42570bab-ffcc-46af-8ac2-1e6603510043 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:09.392228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42570bab-ffcc-46af-8ac2-1e6603510043 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:09.392542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42570bab-ffcc-46af-8ac2-1e6603510043 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:09.394026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42570bab-ffcc-46af-8ac2-1e6603510043 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:09.413507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 450/909] 10.222.0.17 () {56 vars in 1149 bytes} [Tue Aug 2 08:41:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:09.419278 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d8130-1e2d-4e92-9406-c8ebea463f4a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:09.509854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:09.525492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d8130-1e2d-4e92-9406-c8ebea463f4a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:09.562301 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07f13b-12bc-4751-b0bf-22720d3fc7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:09.562931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07f13b-12bc-4751-b0bf-22720d3fc7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:09.563218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07f13b-12bc-4751-b0bf-22720d3fc7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:09.563499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07f13b-12bc-4751-b0bf-22720d3fc7c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:09.643579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07f13b-12bc-4751-b0bf-22720d3fc7c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:09.645137 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07f13b-12bc-4751-b0bf-22720d3fc7c1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:09.667375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cf49a-b6fd-4122-baf9-b5db7490eaa9 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:09.667655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cf49a-b6fd-4122-baf9-b5db7490eaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:09.667936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cf49a-b6fd-4122-baf9-b5db7490eaa9 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:09.673251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 451/910] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:09.674677 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88572358-779d-4d74-a95c-ca05f217d7a8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:09.674960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88572358-779d-4d74-a95c-ca05f217d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:09.675234 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88572358-779d-4d74-a95c-ca05f217d7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:09.695966 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-88572358-779d-4d74-a95c-ca05f217d7a8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:09.697568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-88572358-779d-4d74-a95c-ca05f217d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:09.727879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:09.755761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 460/911] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:41:09 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:41:09.762727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07f13b-12bc-4751-b0bf-22720d3fc7c1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:09.792219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 452/912] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:09.816566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88572358-779d-4d74-a95c-ca05f217d7a8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:09.887697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07f13b-12bc-4751-b0bf-22720d3fc7c1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:09.933125 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb871b0-ca3c-4704-9236-cc2cf05ec14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:09.933808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb871b0-ca3c-4704-9236-cc2cf05ec14e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:09.934095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb871b0-ca3c-4704-9236-cc2cf05ec14e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:09.934606 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb871b0-ca3c-4704-9236-cc2cf05ec14e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:09.944984 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88572358-779d-4d74-a95c-ca05f217d7a8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:09.948855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb871b0-ca3c-4704-9236-cc2cf05ec14e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:09.950526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb871b0-ca3c-4704-9236-cc2cf05ec14e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:09.954089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-beb871b0-ca3c-4704-9236-cc2cf05ec14e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:09.971271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:09.972456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:09.973557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:09.973557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:09.973557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:09.973557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:09.978610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 461/913] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:09.981246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb871b0-ca3c-4704-9236-cc2cf05ec14e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:09.996996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd6bbc-09fc-4b91-acd7-73ab69788913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:09.997633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd6bbc-09fc-4b91-acd7-73ab69788913 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:09.997935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd6bbc-09fc-4b91-acd7-73ab69788913 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:09.998282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd6bbc-09fc-4b91-acd7-73ab69788913 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:09.999341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd6bbc-09fc-4b91-acd7-73ab69788913 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:10.000757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd6bbc-09fc-4b91-acd7-73ab69788913 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:10.017244 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:10.028214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 453/914] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:41:09 2022] POST /identity/v3/services => generated 241 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:41:10.116729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb871b0-ca3c-4704-9236-cc2cf05ec14e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:10.166676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e8786-c19e-45c5-aace-ce7f064b40d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:10.167339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e8786-c19e-45c5-aace-ce7f064b40d3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:10.167624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e8786-c19e-45c5-aace-ce7f064b40d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:10.167920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e8786-c19e-45c5-aace-ce7f064b40d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:10.168676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e8786-c19e-45c5-aace-ce7f064b40d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:10.168988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e8786-c19e-45c5-aace-ce7f064b40d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:10.170451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e8786-c19e-45c5-aace-ce7f064b40d3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:10.184285 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 462/915] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:10.189825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd6bbc-09fc-4b91-acd7-73ab69788913 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:10.248454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202205ea-903d-4f72-8104-aa954765ff3e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:10.248454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202205ea-903d-4f72-8104-aa954765ff3e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:10.248735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202205ea-903d-4f72-8104-aa954765ff3e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:10.250065 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 463/916] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:41:10.254997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a5d4-4d7c-432a-98f9-4a9579a12687 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:10.255284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a5d4-4d7c-432a-98f9-4a9579a12687 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:10.255560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a5d4-4d7c-432a-98f9-4a9579a12687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:10.276776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6207a5d4-4d7c-432a-98f9-4a9579a12687 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:10.278338 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6207a5d4-4d7c-432a-98f9-4a9579a12687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:10.312662 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd6bbc-09fc-4b91-acd7-73ab69788913 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:10.351686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd328d85-4c66-4dd5-abb3-35c5c0192e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:10.352090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 464/917] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:10.352305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd328d85-4c66-4dd5-abb3-35c5c0192e3e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:10.352578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd328d85-4c66-4dd5-abb3-35c5c0192e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:10.352851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd328d85-4c66-4dd5-abb3-35c5c0192e3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:10.361863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd328d85-4c66-4dd5-abb3-35c5c0192e3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:10.361863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd328d85-4c66-4dd5-abb3-35c5c0192e3e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-fd328d85-4c66-4dd5-abb3-35c5c0192e3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:41:10.373435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:10.374537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:10.375587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:41:10.375587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:41:10.375587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:41:10.375587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:41:10.375587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:41:10.375587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:41:10.375587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:10.375587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:10.375587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 454/918] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:10.377453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207a5d4-4d7c-432a-98f9-4a9579a12687 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:10.381537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd328d85-4c66-4dd5-abb3-35c5c0192e3e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:10.394553 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:10.415863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:10.493892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207a5d4-4d7c-432a-98f9-4a9579a12687 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:10.510534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd328d85-4c66-4dd5-abb3-35c5c0192e3e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:10.536490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba64f1f-15d9-4a6a-a17d-7ca48d87d1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:10.538154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba64f1f-15d9-4a6a-a17d-7ca48d87d1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:10.538648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba64f1f-15d9-4a6a-a17d-7ca48d87d1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:10.539340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba64f1f-15d9-4a6a-a17d-7ca48d87d1f5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:10.540435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba64f1f-15d9-4a6a-a17d-7ca48d87d1f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:10.542715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba64f1f-15d9-4a6a-a17d-7ca48d87d1f5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:10.550192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ae70c-3831-4837-9308-602feb081867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:10.550812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae70c-3831-4837-9308-602feb081867 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:10.551094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae70c-3831-4837-9308-602feb081867 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:10.551369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae70c-3831-4837-9308-602feb081867 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:10.552144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ae70c-3831-4837-9308-602feb081867 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:10.552464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ae70c-3831-4837-9308-602feb081867 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:10.553877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ae70c-3831-4837-9308-602feb081867 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-fba64f1f-15d9-4a6a-a17d-7ca48d87d1f5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:10.556974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:10.558252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:41:10.559327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:10.562943 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 465/919] 10.222.0.17 () {56 vars in 1132 bytes} [Tue Aug 2 08:41:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:10.570125 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba64f1f-15d9-4a6a-a17d-7ca48d87d1f5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:10.572945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 455/920] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:41:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:10.581314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ae70c-3831-4837-9308-602feb081867 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:10.661490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:10.684670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba64f1f-15d9-4a6a-a17d-7ca48d87d1f5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:10.702054 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:10.723620 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01e65a-74ed-4583-a746-8690a0a796f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:10.724275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01e65a-74ed-4583-a746-8690a0a796f5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:10.724554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01e65a-74ed-4583-a746-8690a0a796f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:10.724825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01e65a-74ed-4583-a746-8690a0a796f5 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:10.725275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ae70c-3831-4837-9308-602feb081867 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:10.725499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01e65a-74ed-4583-a746-8690a0a796f5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:10.725888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01e65a-74ed-4583-a746-8690a0a796f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:10.727805 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01e65a-74ed-4583-a746-8690a0a796f5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:10.736190 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 466/921] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Aug 2 08:41:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:10.742466 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01e65a-74ed-4583-a746-8690a0a796f5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:10.772338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a3a23-f9fb-4c45-922e-c0e1223f0007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:10.773814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a3a23-f9fb-4c45-922e-c0e1223f0007 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:10.774293 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a3a23-f9fb-4c45-922e-c0e1223f0007 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:10.774776 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a3a23-f9fb-4c45-922e-c0e1223f0007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:10.775750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a3a23-f9fb-4c45-922e-c0e1223f0007 None admin] RBAC: Adding query filter params (role.id=3812c2fc466047f29e976571d85ca6d8, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=ba31cc812281466f90d0c2bfce49d373) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:10.776279 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a3a23-f9fb-4c45-922e-c0e1223f0007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:10.777927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a3a23-f9fb-4c45-922e-c0e1223f0007 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:10.784030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 456/922] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:41:10 2022] GET /identity/v3/role_assignments?user.id=ba31cc812281466f90d0c2bfce49d373&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=3812c2fc466047f29e976571d85ca6d8 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:10.872469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01e65a-74ed-4583-a746-8690a0a796f5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:10.916852 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984455a8-743f-412d-a8dc-789594ead55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:10.917853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984455a8-743f-412d-a8dc-789594ead55c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:10.918309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984455a8-743f-412d-a8dc-789594ead55c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:10.918786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984455a8-743f-412d-a8dc-789594ead55c None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:10.919933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984455a8-743f-412d-a8dc-789594ead55c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:10.920459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984455a8-743f-412d-a8dc-789594ead55c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:10.922807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984455a8-743f-412d-a8dc-789594ead55c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:10.932151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 467/923] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Aug 2 08:41:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:10.941007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a3a23-f9fb-4c45-922e-c0e1223f0007 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:11.056026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a3a23-f9fb-4c45-922e-c0e1223f0007 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:11.092561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181149f-49a6-4a2f-95b3-9d035ac79c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:11.093540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181149f-49a6-4a2f-95b3-9d035ac79c21 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:11.094035 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181149f-49a6-4a2f-95b3-9d035ac79c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:11.094525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181149f-49a6-4a2f-95b3-9d035ac79c21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:11.095456 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181149f-49a6-4a2f-95b3-9d035ac79c21 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:11.097053 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181149f-49a6-4a2f-95b3-9d035ac79c21 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:11.122222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 457/924] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:41:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:41:11.370635 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fb9f9-ae19-4798-8cf1-cfd841828742 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:11.371143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fb9f9-ae19-4798-8cf1-cfd841828742 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:11.371143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fb9f9-ae19-4798-8cf1-cfd841828742 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:11.372775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 468/925] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:11.378056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76fd3b-a7bb-4100-95cb-ecd1667ad7d3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:11.378353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76fd3b-a7bb-4100-95cb-ecd1667ad7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:11.378633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76fd3b-a7bb-4100-95cb-ecd1667ad7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:11.391856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:11.398012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fb76fd3b-a7bb-4100-95cb-ecd1667ad7d3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:11.400171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fb76fd3b-a7bb-4100-95cb-ecd1667ad7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:11.481977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 458/926] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:11.505043 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fb9f9-ae19-4798-8cf1-cfd841828742 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:11.515001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:11.624267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fb9f9-ae19-4798-8cf1-cfd841828742 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:11.673756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79532d4-36ad-403d-ba4c-1548784f1e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:11.675155 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79532d4-36ad-403d-ba4c-1548784f1e0e None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:11.675916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79532d4-36ad-403d-ba4c-1548784f1e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:11.676447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79532d4-36ad-403d-ba4c-1548784f1e0e None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:11.677409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79532d4-36ad-403d-ba4c-1548784f1e0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:11.679198 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79532d4-36ad-403d-ba4c-1548784f1e0e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:11.683200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: WARNING keystone.server.flask.common [None req-d79532d4-36ad-403d-ba4c-1548784f1e0e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 02 08:41:11.703914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.sql.core [None req-d79532d4-36ad-403d-ba4c-1548784f1e0e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 08:41:11.703914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 08:41:11.703914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [parameters: {'id': 'ff01ebfd0bf74c94a02e39b59b5abdc2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 08:41:11.703914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80209) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-d79532d4-36ad-403d-ba4c-1548784f1e0e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff01ebfd0bf74c94a02e39b59b5abdc2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff01ebfd0bf74c94a02e39b59b5abdc2. Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:41:11.712893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result.read() Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 02 08:41:11.713704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application yield resource Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise self.value Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application session.commit() Aug 02 08:41:11.714707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.session.flush() Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application compat.raise_( Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 08:41:11.715612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 08:41:11.716547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application result.read() Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:41:11.718391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [parameters: {'id': 'ff01ebfd0bf74c94a02e39b59b5abdc2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:11.720513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:11.722443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:11.724971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:11.724971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 02 08:41:11.724971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 02 08:41:11.724971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:11.724971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:11.724971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 02 08:41:11.724971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 02 08:41:11.724971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff01ebfd0bf74c94a02e39b59b5abdc2. Aug 02 08:41:11.724971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:11.728632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 469/927] 10.222.0.17 () {60 vars in 1140 bytes} [Tue Aug 2 08:41:11 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:11.736007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76fd3b-a7bb-4100-95cb-ecd1667ad7d3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:11.844431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76fd3b-a7bb-4100-95cb-ecd1667ad7d3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:11.876623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:11.881230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea88c87-5b46-492c-92d9-4443c87cdfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:11.881880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea88c87-5b46-492c-92d9-4443c87cdfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:11.882748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea88c87-5b46-492c-92d9-4443c87cdfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:11.883116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea88c87-5b46-492c-92d9-4443c87cdfe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:11.890783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea88c87-5b46-492c-92d9-4443c87cdfe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:11.892255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea88c87-5b46-492c-92d9-4443c87cdfe2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9ea88c87-5b46-492c-92d9-4443c87cdfe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:41:11.904804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:11.906193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:11.907076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:41:11.907076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:41:11.907076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:41:11.907076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:41:11.907076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:41:11.907076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:41:11.907076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:11.907076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:11.907076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 459/928] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:11.914157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79532d4-36ad-403d-ba4c-1548784f1e0e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:11.994097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:12.048338 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79532d4-36ad-403d-ba4c-1548784f1e0e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:12.085146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01111f-e948-4865-9acf-4ecab0314a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:12.086705 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01111f-e948-4865-9acf-4ecab0314a15 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:12.087215 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01111f-e948-4865-9acf-4ecab0314a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:12.087710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01111f-e948-4865-9acf-4ecab0314a15 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:12.088677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01111f-e948-4865-9acf-4ecab0314a15 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:12.089203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01111f-e948-4865-9acf-4ecab0314a15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:12.091096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01111f-e948-4865-9acf-4ecab0314a15 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:12.112444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 470/929] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:41:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:12.286460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd9a35-89db-431d-bac3-e90f8f3b8720 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:12.287286 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd9a35-89db-431d-bac3-e90f8f3b8720 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:12.287286 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd9a35-89db-431d-bac3-e90f8f3b8720 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:12.288717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 460/930] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:12.299662 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7bba2-38fe-4bb5-923c-43777049a0a5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:12.300321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7bba2-38fe-4bb5-923c-43777049a0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:12.300845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7bba2-38fe-4bb5-923c-43777049a0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:12.323040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-80a7bba2-38fe-4bb5-923c-43777049a0a5 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:12.325042 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-80a7bba2-38fe-4bb5-923c-43777049a0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:12.400106 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 471/931] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:12.422366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd9a35-89db-431d-bac3-e90f8f3b8720 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:12.535665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd9a35-89db-431d-bac3-e90f8f3b8720 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:12.572223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668a49d-d92f-4ecd-8087-a1f3c0aeb4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:12.572879 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668a49d-d92f-4ecd-8087-a1f3c0aeb4df None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:12.573163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668a49d-d92f-4ecd-8087-a1f3c0aeb4df None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:12.573439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668a49d-d92f-4ecd-8087-a1f3c0aeb4df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:12.574071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668a49d-d92f-4ecd-8087-a1f3c0aeb4df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:12.575524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668a49d-d92f-4ecd-8087-a1f3c0aeb4df None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a668a49d-d92f-4ecd-8087-a1f3c0aeb4df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:12.586419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:12.587447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:12.588343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 461/932] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Aug 2 08:41:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:12.595925 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7bba2-38fe-4bb5-923c-43777049a0a5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:12.652233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:12.706148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7bba2-38fe-4bb5-923c-43777049a0a5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:12.743745 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27929c-0f77-4166-86ff-bba43dc7b041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:12.744400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27929c-0f77-4166-86ff-bba43dc7b041 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:12.744685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27929c-0f77-4166-86ff-bba43dc7b041 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:12.744963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27929c-0f77-4166-86ff-bba43dc7b041 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:12.745647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27929c-0f77-4166-86ff-bba43dc7b041 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:12.745955 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27929c-0f77-4166-86ff-bba43dc7b041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:12.747389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27929c-0f77-4166-86ff-bba43dc7b041 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:12.752864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 472/933] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Aug 2 08:41:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:12.759369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668a49d-d92f-4ecd-8087-a1f3c0aeb4df None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:12.830532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:12.880758 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668a49d-d92f-4ecd-8087-a1f3c0aeb4df None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:12.918500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e7b18-bfca-4bc8-9582-c528b86ba5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:12.919128 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e7b18-bfca-4bc8-9582-c528b86ba5af None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:12.919412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e7b18-bfca-4bc8-9582-c528b86ba5af None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:12.919693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e7b18-bfca-4bc8-9582-c528b86ba5af None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:12.920414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e7b18-bfca-4bc8-9582-c528b86ba5af None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:12.920726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e7b18-bfca-4bc8-9582-c528b86ba5af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:12.922110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e7b18-bfca-4bc8-9582-c528b86ba5af None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:12.927786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 462/934] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Aug 2 08:41:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:12.933674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27929c-0f77-4166-86ff-bba43dc7b041 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:12.968251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16c6d-f0b1-4432-a904-5ca04110d413 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:12.968575 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16c6d-f0b1-4432-a904-5ca04110d413 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:12.968821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16c6d-f0b1-4432-a904-5ca04110d413 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:12.971189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 463/935] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:41:12.977305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151420f-3520-4800-976b-d3ded9eada9d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:12.977601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151420f-3520-4800-976b-d3ded9eada9d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:12.977884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151420f-3520-4800-976b-d3ded9eada9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:12.996730 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4151420f-3520-4800-976b-d3ded9eada9d None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:12.997935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4151420f-3520-4800-976b-d3ded9eada9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:13.067187 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27929c-0f77-4166-86ff-bba43dc7b041 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:13.076392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 464/936] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:13.084948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:13.093087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151420f-3520-4800-976b-d3ded9eada9d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:13.108916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082fdff-107c-461d-bd45-e7dc77b0ed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:13.110138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082fdff-107c-461d-bd45-e7dc77b0ed24 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:13.110855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082fdff-107c-461d-bd45-e7dc77b0ed24 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:13.111323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082fdff-107c-461d-bd45-e7dc77b0ed24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:13.112439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082fdff-107c-461d-bd45-e7dc77b0ed24 None admin] RBAC: Adding query filter params (interface=public, service_id=3b1414fbe63a42f788d4057213b4d5cc, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:13.113188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082fdff-107c-461d-bd45-e7dc77b0ed24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:13.114795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082fdff-107c-461d-bd45-e7dc77b0ed24 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:13.122830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 473/937] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Aug 2 08:41:12 2022] GET /identity/v3/endpoints?service_id=3b1414fbe63a42f788d4057213b4d5cc&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:13.128009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082fdff-107c-461d-bd45-e7dc77b0ed24 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:13.162728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:13.227175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151420f-3520-4800-976b-d3ded9eada9d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:13.259032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082fdff-107c-461d-bd45-e7dc77b0ed24 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:13.276836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6375946-fe00-4dfe-b1d0-6a63d97db35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:13.277740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375946-fe00-4dfe-b1d0-6a63d97db35d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:13.278165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375946-fe00-4dfe-b1d0-6a63d97db35d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:13.278597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375946-fe00-4dfe-b1d0-6a63d97db35d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:13.290425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6375946-fe00-4dfe-b1d0-6a63d97db35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f6375946-fe00-4dfe-b1d0-6a63d97db35d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:13.296752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:13.297884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:13.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:13.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:13.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:13.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:13.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:13.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:13.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:13.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:13.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:13.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:13.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:41:13.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:13.301461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 465/938] 10.222.0.17 () {56 vars in 1120 bytes} [Tue Aug 2 08:41:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:13.308258 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6375946-fe00-4dfe-b1d0-6a63d97db35d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:13.310094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435184f-67e6-4a13-be1f-0af8c8e524ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:13.310974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435184f-67e6-4a13-be1f-0af8c8e524ef None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:13.311446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435184f-67e6-4a13-be1f-0af8c8e524ef None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:13.311893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435184f-67e6-4a13-be1f-0af8c8e524ef None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:13.312774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435184f-67e6-4a13-be1f-0af8c8e524ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:13.315650 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435184f-67e6-4a13-be1f-0af8c8e524ef None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:13.332157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 474/939] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Aug 2 08:41:13 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:41:13.332157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ca7ed-5499-4614-8a88-4bf138424f2d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:13.332157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ca7ed-5499-4614-8a88-4bf138424f2d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:13.332157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ca7ed-5499-4614-8a88-4bf138424f2d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:13.332157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 475/940] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:13.335130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eea7e-125a-4302-a8b6-65d2b7125399 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:13.335428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eea7e-125a-4302-a8b6-65d2b7125399 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:13.335804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eea7e-125a-4302-a8b6-65d2b7125399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:13.357474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b46eea7e-125a-4302-a8b6-65d2b7125399 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:13.358934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b46eea7e-125a-4302-a8b6-65d2b7125399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:13.416936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:13.444041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6375946-fe00-4dfe-b1d0-6a63d97db35d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:13.457086 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:13.461233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 476/941] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:13.483633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eea7e-125a-4302-a8b6-65d2b7125399 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:13.497220 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec56ab-c908-4369-9613-5da5bf888f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:13.498229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec56ab-c908-4369-9613-5da5bf888f24 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:13.498518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec56ab-c908-4369-9613-5da5bf888f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:13.498795 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec56ab-c908-4369-9613-5da5bf888f24 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:13.499527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec56ab-c908-4369-9613-5da5bf888f24 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:13.499856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec56ab-c908-4369-9613-5da5bf888f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:13.501256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec56ab-c908-4369-9613-5da5bf888f24 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:13.510403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 466/942] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Aug 2 08:41:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:13.516037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec56ab-c908-4369-9613-5da5bf888f24 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:13.617830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eea7e-125a-4302-a8b6-65d2b7125399 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:13.632563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec56ab-c908-4369-9613-5da5bf888f24 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:13.655034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea5e6-b5fd-417f-8239-9c3c05189f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:13.655795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea5e6-b5fd-417f-8239-9c3c05189f60 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:13.656086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea5e6-b5fd-417f-8239-9c3c05189f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:13.656395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea5e6-b5fd-417f-8239-9c3c05189f60 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:13.657030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cea5e6-b5fd-417f-8239-9c3c05189f60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:13.658483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cea5e6-b5fd-417f-8239-9c3c05189f60 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-55cea5e6-b5fd-417f-8239-9c3c05189f60 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:13.669365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:13.670404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:13.671257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 477/943] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:13.676473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea5e6-b5fd-417f-8239-9c3c05189f60 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:13.679040 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a4b0b-c556-48ee-82ea-34a0e56bd606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:13.680740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4b0b-c556-48ee-82ea-34a0e56bd606 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:13.681203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4b0b-c556-48ee-82ea-34a0e56bd606 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:13.682589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4b0b-c556-48ee-82ea-34a0e56bd606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:13.696441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a4b0b-c556-48ee-82ea-34a0e56bd606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:13.698919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a4b0b-c556-48ee-82ea-34a0e56bd606 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-7f1a4b0b-c556-48ee-82ea-34a0e56bd606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:13.719371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:13.720327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:13.721228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:13.721228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:13.721228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:13.721228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:13.724275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 467/944] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:13.730719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a4b0b-c556-48ee-82ea-34a0e56bd606 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:13.732529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:13.762045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:13.814983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea5e6-b5fd-417f-8239-9c3c05189f60 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:13.855842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a4b0b-c556-48ee-82ea-34a0e56bd606 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:13.861994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce5596-8024-48e7-9b07-98d0fd29923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:13.862863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce5596-8024-48e7-9b07-98d0fd29923a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:13.863255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce5596-8024-48e7-9b07-98d0fd29923a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:13.863634 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce5596-8024-48e7-9b07-98d0fd29923a None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:13.864963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce5596-8024-48e7-9b07-98d0fd29923a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:13.865383 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce5596-8024-48e7-9b07-98d0fd29923a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:13.867280 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce5596-8024-48e7-9b07-98d0fd29923a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:13.874701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 478/945] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:41:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:13.880400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce5596-8024-48e7-9b07-98d0fd29923a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:13.896719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bad00-7e66-459b-a02d-ace7cdb825a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:13.897342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bad00-7e66-459b-a02d-ace7cdb825a1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:13.897623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bad00-7e66-459b-a02d-ace7cdb825a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:13.898422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bad00-7e66-459b-a02d-ace7cdb825a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:13.899128 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bad00-7e66-459b-a02d-ace7cdb825a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:13.899437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bad00-7e66-459b-a02d-ace7cdb825a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:13.900853 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bad00-7e66-459b-a02d-ace7cdb825a1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:13.914543 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 468/946] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:13.925878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bad00-7e66-459b-a02d-ace7cdb825a1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:14.011220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce5596-8024-48e7-9b07-98d0fd29923a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:14.013375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:14.021317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:14.044313 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bad00-7e66-459b-a02d-ace7cdb825a1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:14.059169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d6e7c-f7ec-41ed-a838-b5cd1752c360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:14.060398 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d6e7c-f7ec-41ed-a838-b5cd1752c360 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:14.060879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d6e7c-f7ec-41ed-a838-b5cd1752c360 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:14.061521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d6e7c-f7ec-41ed-a838-b5cd1752c360 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:14.062953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d6e7c-f7ec-41ed-a838-b5cd1752c360 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:14.063773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d6e7c-f7ec-41ed-a838-b5cd1752c360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:14.065888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d6e7c-f7ec-41ed-a838-b5cd1752c360 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:14.072219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 479/947] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:41:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:14.090580 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f052c19-0f64-466d-be13-203b9657ead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:14.091361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052c19-0f64-466d-be13-203b9657ead6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:14.091718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052c19-0f64-466d-be13-203b9657ead6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:14.092139 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052c19-0f64-466d-be13-203b9657ead6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:14.101610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f052c19-0f64-466d-be13-203b9657ead6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:14.103374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f052c19-0f64-466d-be13-203b9657ead6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-1f052c19-0f64-466d-be13-203b9657ead6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:41:14.117217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:14.118254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:14.119192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:14.119192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:14.119192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:41:14.119192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:41:14.119192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:41:14.119192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:41:14.119192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:41:14.119192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:41:14.119192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:41:14.119192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:14.119192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 469/948] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Aug 2 08:41:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:14.124695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d6e7c-f7ec-41ed-a838-b5cd1752c360 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:14.224012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf95999-6038-420f-81dc-26f4a286dd94 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:14.224338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf95999-6038-420f-81dc-26f4a286dd94 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:14.224591 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf95999-6038-420f-81dc-26f4a286dd94 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:14.226780 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 470/949] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:41:14.237535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e742a-eb3d-4332-8a50-30b98835b828 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:14.238112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e742a-eb3d-4332-8a50-30b98835b828 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:14.238562 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e742a-eb3d-4332-8a50-30b98835b828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:14.250590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d6e7c-f7ec-41ed-a838-b5cd1752c360 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:14.266374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c33e742a-eb3d-4332-8a50-30b98835b828 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:14.267895 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c33e742a-eb3d-4332-8a50-30b98835b828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:14.307403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165e39d-5d4e-4b6a-9e7b-4b2a9fe63191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:14.308843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165e39d-5d4e-4b6a-9e7b-4b2a9fe63191 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:14.309130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165e39d-5d4e-4b6a-9e7b-4b2a9fe63191 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:14.309442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165e39d-5d4e-4b6a-9e7b-4b2a9fe63191 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:14.310214 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165e39d-5d4e-4b6a-9e7b-4b2a9fe63191 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:14.310532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165e39d-5d4e-4b6a-9e7b-4b2a9fe63191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:14.311981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165e39d-5d4e-4b6a-9e7b-4b2a9fe63191 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:14.341702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 480/950] 10.222.0.17 () {56 vars in 1149 bytes} [Tue Aug 2 08:41:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:14.347724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165e39d-5d4e-4b6a-9e7b-4b2a9fe63191 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:14.356188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 471/951] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:14.379699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:14.381345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e742a-eb3d-4332-8a50-30b98835b828 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:14.461960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:14.488219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165e39d-5d4e-4b6a-9e7b-4b2a9fe63191 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:14.502014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e742a-eb3d-4332-8a50-30b98835b828 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:14.529631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d15a81-dc0c-4404-91d4-ecb07e77cc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:14.530636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15a81-dc0c-4404-91d4-ecb07e77cc10 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:14.531120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15a81-dc0c-4404-91d4-ecb07e77cc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:14.531627 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15a81-dc0c-4404-91d4-ecb07e77cc10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:14.542802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d15a81-dc0c-4404-91d4-ecb07e77cc10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:14.544585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d15a81-dc0c-4404-91d4-ecb07e77cc10 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:14.549024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225603f2-58cd-4d03-9749-2226fdc983b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:14.549639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225603f2-58cd-4d03-9749-2226fdc983b2 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:14.549919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225603f2-58cd-4d03-9749-2226fdc983b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:14.550189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225603f2-58cd-4d03-9749-2226fdc983b2 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:14.550977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225603f2-58cd-4d03-9749-2226fdc983b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:14.552616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225603f2-58cd-4d03-9749-2226fdc983b2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:14.556938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: WARNING keystone.server.flask.common [None req-225603f2-58cd-4d03-9749-2226fdc983b2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-65d15a81-dc0c-4404-91d4-ecb07e77cc10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:14.563575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:14.564736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:14.565625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:14.565625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:14.565625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:14.565625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:14.567659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 481/952] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:14.578192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.sql.core [None req-225603f2-58cd-4d03-9749-2226fdc983b2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 08:41:14.578192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 08:41:14.578192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [parameters: {'user_id': 'bf8aaa3de04d4148a7ef32a7cf6e132b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 08:41:14.578192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80210) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 08:41:14.578532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d15a81-dc0c-4404-91d4-ecb07e77cc10 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-225603f2-58cd-4d03-9749-2226fdc983b2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application result.read() Aug 02 08:41:14.592818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:41:14.593745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application yield resource Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise self.value Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application session.commit() Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 08:41:14.594858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.session.flush() Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application compat.raise_( Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 08:41:14.596011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:41:14.597202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application result.read() Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:41:14.598121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bf8aaa3de04d4148a7ef32a7cf6e132b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:14.599256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 02 08:41:14.600314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 02 08:41:14.601639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 02 08:41:14.601639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 02 08:41:14.601639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 08:41:14.601639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 08:41:14.601639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 08:41:14.601639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:14.601639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 472/953] 10.222.0.17 () {60 vars in 1131 bytes} [Tue Aug 2 08:41:14 2022] POST /identity/v3/users => generated 160 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:14.608850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225603f2-58cd-4d03-9749-2226fdc983b2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:14.665164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:14.692912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d15a81-dc0c-4404-91d4-ecb07e77cc10 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:14.737830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225603f2-58cd-4d03-9749-2226fdc983b2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:14.739559 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095431b-db05-466d-a95d-57c23b52ed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:14.740129 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095431b-db05-466d-a95d-57c23b52ed9e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:14.740438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095431b-db05-466d-a95d-57c23b52ed9e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:14.740959 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095431b-db05-466d-a95d-57c23b52ed9e None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:14.742186 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095431b-db05-466d-a95d-57c23b52ed9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:14.742497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095431b-db05-466d-a95d-57c23b52ed9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:14.744840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095431b-db05-466d-a95d-57c23b52ed9e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:14.764155 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 482/954] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:14.768617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095431b-db05-466d-a95d-57c23b52ed9e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:14.782948 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ec4e9-4e10-4b3d-8557-aef2236df28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:14.783836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ec4e9-4e10-4b3d-8557-aef2236df28d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:14.784144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ec4e9-4e10-4b3d-8557-aef2236df28d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:14.784526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ec4e9-4e10-4b3d-8557-aef2236df28d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:14.787729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:14.793553 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ec4e9-4e10-4b3d-8557-aef2236df28d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:14.796830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ec4e9-4e10-4b3d-8557-aef2236df28d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-601ec4e9-4e10-4b3d-8557-aef2236df28d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:41:14.815436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:14.816627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:14.817829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:14.817829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:14.817829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:41:14.817829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:41:14.817829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:41:14.817829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:41:14.817829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:41:14.817829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:41:14.817829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:41:14.817829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:14.820282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 473/955] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:41:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:14.826149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ec4e9-4e10-4b3d-8557-aef2236df28d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:14.899709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095431b-db05-466d-a95d-57c23b52ed9e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:14.938055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4791ed-2569-470c-b746-66086ea6d9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:14.938957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4791ed-2569-470c-b746-66086ea6d9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:14.939416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4791ed-2569-470c-b746-66086ea6d9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:14.939838 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4791ed-2569-470c-b746-66086ea6d9c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:14.943347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:14.948563 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4791ed-2569-470c-b746-66086ea6d9c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:14.950405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4791ed-2569-470c-b746-66086ea6d9c9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-2e4791ed-2569-470c-b746-66086ea6d9c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:41:14.966267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:14.967228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:14.968150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:41:14.968150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:41:14.968150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:41:14.968150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:41:14.968150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:41:14.968150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:41:14.968150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:14.968150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:14.968587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ec4e9-4e10-4b3d-8557-aef2236df28d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:14.970711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 483/956] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:14.976675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4791ed-2569-470c-b746-66086ea6d9c9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:15.017935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeda07-2e7a-4e1f-b2d8-d63aee77ea98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:15.018472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeda07-2e7a-4e1f-b2d8-d63aee77ea98 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:15.018758 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeda07-2e7a-4e1f-b2d8-d63aee77ea98 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:15.019043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeda07-2e7a-4e1f-b2d8-d63aee77ea98 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:15.019814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeda07-2e7a-4e1f-b2d8-d63aee77ea98 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:15.020153 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeda07-2e7a-4e1f-b2d8-d63aee77ea98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:15.021598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeda07-2e7a-4e1f-b2d8-d63aee77ea98 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:15.076113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 474/957] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Aug 2 08:41:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:15.097671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4791ed-2569-470c-b746-66086ea6d9c9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:15.139405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f476ef1-af10-4325-ab14-89568095f17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:15.140331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f476ef1-af10-4325-ab14-89568095f17c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:15.140766 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f476ef1-af10-4325-ab14-89568095f17c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:15.141222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f476ef1-af10-4325-ab14-89568095f17c None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:15.142523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f476ef1-af10-4325-ab14-89568095f17c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:15.143007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f476ef1-af10-4325-ab14-89568095f17c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:15.144717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f476ef1-af10-4325-ab14-89568095f17c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:15.159543 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 484/958] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:15.167557 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeda07-2e7a-4e1f-b2d8-d63aee77ea98 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:15.234301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:15.286716 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeda07-2e7a-4e1f-b2d8-d63aee77ea98 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:15.322771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08934da-c4a1-4c19-9354-512df8ee2b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:15.323448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08934da-c4a1-4c19-9354-512df8ee2b68 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:15.323731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08934da-c4a1-4c19-9354-512df8ee2b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:15.324006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08934da-c4a1-4c19-9354-512df8ee2b68 None admin] PATH_INFO: `/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/ba31cc812281466f90d0c2bfce49d373/roles/3812c2fc466047f29e976571d85ca6d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:15.326334 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08934da-c4a1-4c19-9354-512df8ee2b68 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e1649f32d3d494682dc06e05ae34f3d, user_id=ba31cc812281466f90d0c2bfce49d373, role_id=3812c2fc466047f29e976571d85ca6d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:15.327830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08934da-c4a1-4c19-9354-512df8ee2b68 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:15.352288 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 475/959] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:41:15 2022] PUT /identity/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/ba31cc812281466f90d0c2bfce49d373/roles/3812c2fc466047f29e976571d85ca6d8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:41:15.449556 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e255b-cc11-4aed-9692-58ebb1e99644 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:15.449912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e255b-cc11-4aed-9692-58ebb1e99644 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:15.450106 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e255b-cc11-4aed-9692-58ebb1e99644 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:15.451640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 485/960] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:15.457103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ecd12-bf56-48e0-9bc0-4ef7f058bd90 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:15.457977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ecd12-bf56-48e0-9bc0-4ef7f058bd90 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:15.457977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ecd12-bf56-48e0-9bc0-4ef7f058bd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:15.477025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-089ecd12-bf56-48e0-9bc0-4ef7f058bd90 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:15.478568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-089ecd12-bf56-48e0-9bc0-4ef7f058bd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:15.551704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 476/961] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:15.575524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e255b-cc11-4aed-9692-58ebb1e99644 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:15.635089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:15.684391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e255b-cc11-4aed-9692-58ebb1e99644 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:15.719057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ed929-ceb8-432c-86a3-c84ea4c7e7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:15.719881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ed929-ceb8-432c-86a3-c84ea4c7e7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:15.720305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ed929-ceb8-432c-86a3-c84ea4c7e7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:15.720683 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ed929-ceb8-432c-86a3-c84ea4c7e7f0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:15.721408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ed929-ceb8-432c-86a3-c84ea4c7e7f0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:15.722873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ed929-ceb8-432c-86a3-c84ea4c7e7f0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ee6ed929-ceb8-432c-86a3-c84ea4c7e7f0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:15.732786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:15.734111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:15.735149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:15.737087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 486/962] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Aug 2 08:41:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:15.743596 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ecd12-bf56-48e0-9bc0-4ef7f058bd90 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:15.790072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:15.855020 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ecd12-bf56-48e0-9bc0-4ef7f058bd90 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:15.891018 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d790-ca0f-40fe-a1cd-589237551582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:15.891637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d790-ca0f-40fe-a1cd-589237551582 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:15.891916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d790-ca0f-40fe-a1cd-589237551582 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:15.892215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d790-ca0f-40fe-a1cd-589237551582 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:15.892889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814d790-ca0f-40fe-a1cd-589237551582 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:15.893192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814d790-ca0f-40fe-a1cd-589237551582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:15.894609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814d790-ca0f-40fe-a1cd-589237551582 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:15.900355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 477/963] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Aug 2 08:41:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:15.906743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ed929-ceb8-432c-86a3-c84ea4c7e7f0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:16.009367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ed929-ceb8-432c-86a3-c84ea4c7e7f0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:16.029971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:16.045599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c4426-48b0-456e-8e42-fd17e0d8f688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:16.046221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4426-48b0-456e-8e42-fd17e0d8f688 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:16.046593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4426-48b0-456e-8e42-fd17e0d8f688 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:16.046806 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4426-48b0-456e-8e42-fd17e0d8f688 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:16.047461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4426-48b0-456e-8e42-fd17e0d8f688 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:16.047765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4426-48b0-456e-8e42-fd17e0d8f688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:16.049159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4426-48b0-456e-8e42-fd17e0d8f688 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:16.054891 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 487/964] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Aug 2 08:41:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:16.060524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d790-ca0f-40fe-a1cd-589237551582 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:16.141834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f23a90-f3e5-4269-91d4-bcbec2da1281 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:16.142126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f23a90-f3e5-4269-91d4-bcbec2da1281 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:16.142407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f23a90-f3e5-4269-91d4-bcbec2da1281 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:16.143901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 488/965] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:16.149347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b917b4-22a4-4906-9d64-fe13f13abcd0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:16.149899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b917b4-22a4-4906-9d64-fe13f13abcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:16.150403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b917b4-22a4-4906-9d64-fe13f13abcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:16.164325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d790-ca0f-40fe-a1cd-589237551582 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:16.168727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-56b917b4-22a4-4906-9d64-fe13f13abcd0 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:16.170144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-56b917b4-22a4-4906-9d64-fe13f13abcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:16.173933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:16.209865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844465c-cb18-4ff9-bc58-65d4eed49830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:16.210618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844465c-cb18-4ff9-bc58-65d4eed49830 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:16.210901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844465c-cb18-4ff9-bc58-65d4eed49830 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:16.211175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844465c-cb18-4ff9-bc58-65d4eed49830 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:16.211889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844465c-cb18-4ff9-bc58-65d4eed49830 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:16.213287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844465c-cb18-4ff9-bc58-65d4eed49830 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:16.234412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 478/966] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:41:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:41:16.252732 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 489/967] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:16.276835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844465c-cb18-4ff9-bc58-65d4eed49830 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:16.389863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844465c-cb18-4ff9-bc58-65d4eed49830 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:16.426590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c7a34-d327-491a-ac73-44d2375abf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:16.427226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c7a34-d327-491a-ac73-44d2375abf82 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:16.427514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c7a34-d327-491a-ac73-44d2375abf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:16.427787 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c7a34-d327-491a-ac73-44d2375abf82 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:16.428894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c7a34-d327-491a-ac73-44d2375abf82 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:16.430442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c7a34-d327-491a-ac73-44d2375abf82 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:16.447074 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 479/968] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:41:16 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:41:17.361732 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c2067-4b87-47d2-9c48-32a50006392a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:17.362283 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c2067-4b87-47d2-9c48-32a50006392a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:17.362283 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c2067-4b87-47d2-9c48-32a50006392a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:17.363822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 490/969] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:17.368877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb7b6b-bc72-4fd4-897e-632889e7f66f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:17.369269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb7b6b-bc72-4fd4-897e-632889e7f66f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:17.369484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb7b6b-bc72-4fd4-897e-632889e7f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:17.388305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-00cb7b6b-bc72-4fd4-897e-632889e7f66f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:17.389541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-00cb7b6b-bc72-4fd4-897e-632889e7f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:17.409807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:17.470434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 480/970] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:17.492699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c2067-4b87-47d2-9c48-32a50006392a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:17.598232 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c2067-4b87-47d2-9c48-32a50006392a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:17.609420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:17.636196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd0d4b-63da-4122-9497-0c52d82c5b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:17.636777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd0d4b-63da-4122-9497-0c52d82c5b04 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:17.637064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd0d4b-63da-4122-9497-0c52d82c5b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:17.637344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd0d4b-63da-4122-9497-0c52d82c5b04 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:17.647952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd0d4b-63da-4122-9497-0c52d82c5b04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-92fd0d4b-63da-4122-9497-0c52d82c5b04 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:17.652975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:17.653879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:17.660564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 491/971] 10.222.0.17 () {56 vars in 1120 bytes} [Tue Aug 2 08:41:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:17.661304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb7b6b-bc72-4fd4-897e-632889e7f66f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:17.768348 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb7b6b-bc72-4fd4-897e-632889e7f66f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:17.805434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63579c70-9708-4aa5-b98d-201864a91cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:17.805562 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63579c70-9708-4aa5-b98d-201864a91cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:17.805870 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63579c70-9708-4aa5-b98d-201864a91cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:17.806052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63579c70-9708-4aa5-b98d-201864a91cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:17.806847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63579c70-9708-4aa5-b98d-201864a91cb8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:17.807159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63579c70-9708-4aa5-b98d-201864a91cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:17.811194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63579c70-9708-4aa5-b98d-201864a91cb8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:17.819265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 481/972] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Aug 2 08:41:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:17.825225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd0d4b-63da-4122-9497-0c52d82c5b04 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:17.930354 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd0d4b-63da-4122-9497-0c52d82c5b04 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:17.965417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d6fbb-0ced-406a-9ef8-2ef066a53e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:17.966084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d6fbb-0ced-406a-9ef8-2ef066a53e9d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:17.966373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d6fbb-0ced-406a-9ef8-2ef066a53e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:17.966648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d6fbb-0ced-406a-9ef8-2ef066a53e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:17.977600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d6fbb-0ced-406a-9ef8-2ef066a53e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:17.979070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d6fbb-0ced-406a-9ef8-2ef066a53e9d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b57d6fbb-0ced-406a-9ef8-2ef066a53e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:17.995993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:18.001978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:18.002899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:18.002899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:18.002899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:18.002899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:18.002899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 492/973] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:18.004411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63579c70-9708-4aa5-b98d-201864a91cb8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:18.020166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:18.110675 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63579c70-9708-4aa5-b98d-201864a91cb8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:18.144793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f1563-0ae6-4b7e-a541-d300134ca8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:18.145425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1563-0ae6-4b7e-a541-d300134ca8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:18.145707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1563-0ae6-4b7e-a541-d300134ca8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:18.146030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1563-0ae6-4b7e-a541-d300134ca8a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:18.146731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f1563-0ae6-4b7e-a541-d300134ca8a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:18.147040 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f1563-0ae6-4b7e-a541-d300134ca8a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:18.148517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f1563-0ae6-4b7e-a541-d300134ca8a6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:18.165882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 482/974] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:18.167105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d6fbb-0ced-406a-9ef8-2ef066a53e9d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:18.192946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:18.277241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d6fbb-0ced-406a-9ef8-2ef066a53e9d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:18.296413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2254928-49c0-423c-841c-6a3bb0dbbd96 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:18.296700 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2254928-49c0-423c-841c-6a3bb0dbbd96 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:18.296974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2254928-49c0-423c-841c-6a3bb0dbbd96 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:18.298319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 483/975] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:41:18.304330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc0b2f-8c92-49b3-9ddb-7c4fa71c9f38 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:18.304620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc0b2f-8c92-49b3-9ddb-7c4fa71c9f38 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:18.304893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc0b2f-8c92-49b3-9ddb-7c4fa71c9f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:18.312676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e462af-777f-40ff-a7b4-1eae4e8ee37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:18.313608 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e462af-777f-40ff-a7b4-1eae4e8ee37d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:18.314101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e462af-777f-40ff-a7b4-1eae4e8ee37d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:18.314611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e462af-777f-40ff-a7b4-1eae4e8ee37d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:18.323669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bfdc0b2f-8c92-49b3-9ddb-7c4fa71c9f38 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:18.324470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e462af-777f-40ff-a7b4-1eae4e8ee37d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:18.324962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bfdc0b2f-8c92-49b3-9ddb-7c4fa71c9f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:18.326395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e462af-777f-40ff-a7b4-1eae4e8ee37d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-96e462af-777f-40ff-a7b4-1eae4e8ee37d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:41:18.340080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:18.341147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:18.342362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:18.342362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:18.342362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:41:18.342362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:41:18.342362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:41:18.342362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:41:18.342362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:41:18.342362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:41:18.342362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:41:18.342362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:18.344560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 493/976] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Aug 2 08:41:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:18.350180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e462af-777f-40ff-a7b4-1eae4e8ee37d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:18.398996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 484/977] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:18.421786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc0b2f-8c92-49b3-9ddb-7c4fa71c9f38 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:18.423934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:18.442379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:18.464067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e462af-777f-40ff-a7b4-1eae4e8ee37d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:18.500323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfde5e0-dc5e-4c5d-a0bb-b740066c998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:18.500946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfde5e0-dc5e-4c5d-a0bb-b740066c998f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:18.501224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfde5e0-dc5e-4c5d-a0bb-b740066c998f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:18.501497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfde5e0-dc5e-4c5d-a0bb-b740066c998f None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:18.502277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfde5e0-dc5e-4c5d-a0bb-b740066c998f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:18.502584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfde5e0-dc5e-4c5d-a0bb-b740066c998f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:18.504015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfde5e0-dc5e-4c5d-a0bb-b740066c998f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:18.521828 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 494/978] 10.222.0.17 () {56 vars in 1149 bytes} [Tue Aug 2 08:41:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:18.521982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc0b2f-8c92-49b3-9ddb-7c4fa71c9f38 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:18.523533 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39581d0c-e960-403a-b48e-694249086308 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:18.523830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39581d0c-e960-403a-b48e-694249086308 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:18.524105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39581d0c-e960-403a-b48e-694249086308 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:18.525356 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 495/979] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:18.528286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39581d0c-e960-403a-b48e-694249086308 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:18.561246 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c3418-0409-4123-ba26-162ff025d833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:18.561900 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c3418-0409-4123-ba26-162ff025d833 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:18.562185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c3418-0409-4123-ba26-162ff025d833 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:18.562460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c3418-0409-4123-ba26-162ff025d833 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:18.563100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c3418-0409-4123-ba26-162ff025d833 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:18.564656 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c3418-0409-4123-ba26-162ff025d833 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-ff5c3418-0409-4123-ba26-162ff025d833 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:18.574832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:18.576011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:18.576898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 485/980] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Aug 2 08:41:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:18.577689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200ae05-5135-4173-85f9-b1b7c9b83dca None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:18.577757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200ae05-5135-4173-85f9-b1b7c9b83dca None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:18.578420 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200ae05-5135-4173-85f9-b1b7c9b83dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:18.601888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9200ae05-5135-4173-85f9-b1b7c9b83dca None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:18.603715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9200ae05-5135-4173-85f9-b1b7c9b83dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:18.641132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39581d0c-e960-403a-b48e-694249086308 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:18.668552 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:18.676537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 486/981] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:18.677633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407f8fd-8a3c-4635-a93c-13119e557bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:18.677834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200ae05-5135-4173-85f9-b1b7c9b83dca None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:18.678365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407f8fd-8a3c-4635-a93c-13119e557bea None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:18.678893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407f8fd-8a3c-4635-a93c-13119e557bea None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:18.679393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407f8fd-8a3c-4635-a93c-13119e557bea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:18.692408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:18.758091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407f8fd-8a3c-4635-a93c-13119e557bea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:18.759538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407f8fd-8a3c-4635-a93c-13119e557bea None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:18.782586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200ae05-5135-4173-85f9-b1b7c9b83dca None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:18.821741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c16e-fcc9-4c17-9707-aa299c95c22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:18.822358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c16e-fcc9-4c17-9707-aa299c95c22d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:18.822634 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c16e-fcc9-4c17-9707-aa299c95c22d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:18.822904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c16e-fcc9-4c17-9707-aa299c95c22d None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:18.823580 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c16e-fcc9-4c17-9707-aa299c95c22d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:18.823883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c16e-fcc9-4c17-9707-aa299c95c22d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:18.825273 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c16e-fcc9-4c17-9707-aa299c95c22d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:18.830078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 487/982] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Aug 2 08:41:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:18.830965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c16e-fcc9-4c17-9707-aa299c95c22d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:18.878335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 496/983] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:41:18 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:41:18.878335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407f8fd-8a3c-4635-a93c-13119e557bea None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:18.894830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:18.920234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:18.939082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c16e-fcc9-4c17-9707-aa299c95c22d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:18.982192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df590be4-2dc9-414d-8640-061ad13cb01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:18.982840 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df590be4-2dc9-414d-8640-061ad13cb01c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:18.983122 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df590be4-2dc9-414d-8640-061ad13cb01c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:18.983398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df590be4-2dc9-414d-8640-061ad13cb01c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:18.984023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df590be4-2dc9-414d-8640-061ad13cb01c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:18.985425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df590be4-2dc9-414d-8640-061ad13cb01c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:18.986612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407f8fd-8a3c-4635-a93c-13119e557bea None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-df590be4-2dc9-414d-8640-061ad13cb01c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:18.995773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:18.997066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:18.997995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 488/984] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:18.999205 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df590be4-2dc9-414d-8640-061ad13cb01c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:19.030581 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015689b2-373d-47c7-af71-b171111a1839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:19.031223 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015689b2-373d-47c7-af71-b171111a1839 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:19.031513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015689b2-373d-47c7-af71-b171111a1839 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:19.031792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015689b2-373d-47c7-af71-b171111a1839 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:19.032500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015689b2-373d-47c7-af71-b171111a1839 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:19.032812 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015689b2-373d-47c7-af71-b171111a1839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:19.034198 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015689b2-373d-47c7-af71-b171111a1839 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:19.039237 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 497/985] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Aug 2 08:41:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:19.040032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015689b2-373d-47c7-af71-b171111a1839 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:19.114354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df590be4-2dc9-414d-8640-061ad13cb01c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:19.138573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:19.141439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015689b2-373d-47c7-af71-b171111a1839 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:19.143804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:19.152624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32158214-57a7-42f3-a1fe-29a2ca906c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:19.153361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32158214-57a7-42f3-a1fe-29a2ca906c20 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:19.153650 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32158214-57a7-42f3-a1fe-29a2ca906c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:19.153930 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32158214-57a7-42f3-a1fe-29a2ca906c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:19.164880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32158214-57a7-42f3-a1fe-29a2ca906c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:19.166380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32158214-57a7-42f3-a1fe-29a2ca906c20 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:19.179964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b753a1-1c2d-4d62-bd4e-f0a74ac0efc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:19.180774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b753a1-1c2d-4d62-bd4e-f0a74ac0efc3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:19.181059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b753a1-1c2d-4d62-bd4e-f0a74ac0efc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:19.181334 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b753a1-1c2d-4d62-bd4e-f0a74ac0efc3 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-32158214-57a7-42f3-a1fe-29a2ca906c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:19.181550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:19.182574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:19.183691 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:19.183691 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:19.183691 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:19.183691 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:19.183974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b753a1-1c2d-4d62-bd4e-f0a74ac0efc3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:19.183974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b753a1-1c2d-4d62-bd4e-f0a74ac0efc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:19.184168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 489/986] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:19.184168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32158214-57a7-42f3-a1fe-29a2ca906c20 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:19.188503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b753a1-1c2d-4d62-bd4e-f0a74ac0efc3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:19.193931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 498/987] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:41:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:19.195355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b753a1-1c2d-4d62-bd4e-f0a74ac0efc3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:19.300635 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b753a1-1c2d-4d62-bd4e-f0a74ac0efc3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:19.303120 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32158214-57a7-42f3-a1fe-29a2ca906c20 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:19.340782 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fe45d-3fea-4e66-a0f3-03630d7b1ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:19.341726 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fe45d-3fea-4e66-a0f3-03630d7b1ffd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:19.342145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fe45d-3fea-4e66-a0f3-03630d7b1ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:19.342373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fe45d-3fea-4e66-a0f3-03630d7b1ffd None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:19.343070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fe45d-3fea-4e66-a0f3-03630d7b1ffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:19.343383 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fe45d-3fea-4e66-a0f3-03630d7b1ffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:19.344796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fe45d-3fea-4e66-a0f3-03630d7b1ffd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:19.356844 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 499/988] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:19.357585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fe45d-3fea-4e66-a0f3-03630d7b1ffd None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:19.362859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806e27f-d4c9-4835-a6f2-6944cb84be06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:19.363488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806e27f-d4c9-4835-a6f2-6944cb84be06 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:19.363769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806e27f-d4c9-4835-a6f2-6944cb84be06 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:19.364041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806e27f-d4c9-4835-a6f2-6944cb84be06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:19.364863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806e27f-d4c9-4835-a6f2-6944cb84be06 None admin] RBAC: Adding query filter params (interface=admin, service_id=3b1414fbe63a42f788d4057213b4d5cc, region_id=RegionOne) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:19.365178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806e27f-d4c9-4835-a6f2-6944cb84be06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:19.367150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806e27f-d4c9-4835-a6f2-6944cb84be06 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:19.373329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 490/989] 10.222.0.17 () {56 vars in 1249 bytes} [Tue Aug 2 08:41:19 2022] GET /identity/v3/endpoints?service_id=3b1414fbe63a42f788d4057213b4d5cc&interface=admin®ion_id=RegionOne => generated 193 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:19.374111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806e27f-d4c9-4835-a6f2-6944cb84be06 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:19.388063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:19.417197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:19.464624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fe45d-3fea-4e66-a0f3-03630d7b1ffd None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:19.475315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806e27f-d4c9-4835-a6f2-6944cb84be06 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:19.498402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82285cc-506d-48d5-9e69-4e606c06bdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:19.499021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82285cc-506d-48d5-9e69-4e606c06bdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:19.499301 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82285cc-506d-48d5-9e69-4e606c06bdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:19.499577 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82285cc-506d-48d5-9e69-4e606c06bdf2 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:19.500287 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82285cc-506d-48d5-9e69-4e606c06bdf2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:19.500596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82285cc-506d-48d5-9e69-4e606c06bdf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:19.501957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82285cc-506d-48d5-9e69-4e606c06bdf2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:19.506709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 500/990] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:41:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:19.507484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82285cc-506d-48d5-9e69-4e606c06bdf2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:19.510101 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdac9a-2fe4-4e0f-8d14-8c43091cd933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:19.511804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdac9a-2fe4-4e0f-8d14-8c43091cd933 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:19.512106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdac9a-2fe4-4e0f-8d14-8c43091cd933 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:19.512416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdac9a-2fe4-4e0f-8d14-8c43091cd933 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:19.519294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdac9a-2fe4-4e0f-8d14-8c43091cd933 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:19.520771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdac9a-2fe4-4e0f-8d14-8c43091cd933 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-03cdac9a-2fe4-4e0f-8d14-8c43091cd933 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:41:19.532166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:19.533028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:19.533918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:41:19.533918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:41:19.533918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:41:19.533918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:41:19.533918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:41:19.533918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:41:19.533918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:19.533918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:19.533918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 491/991] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:19.534398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdac9a-2fe4-4e0f-8d14-8c43091cd933 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:19.602899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:19.612180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82285cc-506d-48d5-9e69-4e606c06bdf2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:19.646153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83317b-b345-4ee0-a298-d7cf645795b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:19.646674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:19.646828 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83317b-b345-4ee0-a298-d7cf645795b9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:19.647046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83317b-b345-4ee0-a298-d7cf645795b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:19.647329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83317b-b345-4ee0-a298-d7cf645795b9 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:19.648229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83317b-b345-4ee0-a298-d7cf645795b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:19.649794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83317b-b345-4ee0-a298-d7cf645795b9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:19.649971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdac9a-2fe4-4e0f-8d14-8c43091cd933 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:19.658537 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 501/992] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Aug 2 08:41:19 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:41:19.659380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83317b-b345-4ee0-a298-d7cf645795b9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:19.702769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02928203-a1bd-4704-84a4-871cbe93f18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:19.703485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02928203-a1bd-4704-84a4-871cbe93f18a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:19.703773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02928203-a1bd-4704-84a4-871cbe93f18a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:19.704055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02928203-a1bd-4704-84a4-871cbe93f18a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:19.704859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02928203-a1bd-4704-84a4-871cbe93f18a None admin] RBAC: Adding query filter params (interface=public, service_id=0f1f8a679297442589939e32eecaa1b7, region_id=RegionOne) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:19.705172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02928203-a1bd-4704-84a4-871cbe93f18a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:19.706596 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02928203-a1bd-4704-84a4-871cbe93f18a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:19.713163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 492/993] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Aug 2 08:41:19 2022] GET /identity/v3/endpoints?service_id=0f1f8a679297442589939e32eecaa1b7&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:19.718996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02928203-a1bd-4704-84a4-871cbe93f18a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:19.805020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83317b-b345-4ee0-a298-d7cf645795b9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:19.838870 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02928203-a1bd-4704-84a4-871cbe93f18a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:19.848470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848c145-76d5-4463-be03-a86a59810d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:19.849093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848c145-76d5-4463-be03-a86a59810d4c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:19.849374 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848c145-76d5-4463-be03-a86a59810d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:19.849648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848c145-76d5-4463-be03-a86a59810d4c None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:19.850394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848c145-76d5-4463-be03-a86a59810d4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:19.850742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848c145-76d5-4463-be03-a86a59810d4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:19.852752 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848c145-76d5-4463-be03-a86a59810d4c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:19.865906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 502/994] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:41:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:19.871942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848c145-76d5-4463-be03-a86a59810d4c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:19.879244 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed35a6-679c-4ca9-bc7b-418570b8ea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:19.879870 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed35a6-679c-4ca9-bc7b-418570b8ea2e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:19.880172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed35a6-679c-4ca9-bc7b-418570b8ea2e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:19.880753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed35a6-679c-4ca9-bc7b-418570b8ea2e None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:19.881103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed35a6-679c-4ca9-bc7b-418570b8ea2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:19.882488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed35a6-679c-4ca9-bc7b-418570b8ea2e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:19.888995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 493/995] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Aug 2 08:41:19 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:41:19.891063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:19.987998 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848c145-76d5-4463-be03-a86a59810d4c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:20.032275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdadea5-6b47-4bf3-8b07-8879d34e37dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:20.032912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdadea5-6b47-4bf3-8b07-8879d34e37dd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:20.033192 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdadea5-6b47-4bf3-8b07-8879d34e37dd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:20.033464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdadea5-6b47-4bf3-8b07-8879d34e37dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:20.034335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdadea5-6b47-4bf3-8b07-8879d34e37dd None admin] RBAC: Adding query filter params (role.id=3812c2fc466047f29e976571d85ca6d8, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=ba31cc812281466f90d0c2bfce49d373) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:20.034650 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdadea5-6b47-4bf3-8b07-8879d34e37dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:20.036176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdadea5-6b47-4bf3-8b07-8879d34e37dd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:20.044032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 503/996] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:41:19 2022] GET /identity/v3/role_assignments?user.id=ba31cc812281466f90d0c2bfce49d373&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=3812c2fc466047f29e976571d85ca6d8 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:21.685280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e394ae2-b36d-4f33-b53e-a33da7882990 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:21.685841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e394ae2-b36d-4f33-b53e-a33da7882990 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:21.685841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e394ae2-b36d-4f33-b53e-a33da7882990 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:21.687508 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 494/997] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:21.693088 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731e86b-d55b-40e4-abcb-f5a65576e571 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:21.693557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731e86b-d55b-40e4-abcb-f5a65576e571 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:21.693764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731e86b-d55b-40e4-abcb-f5a65576e571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:21.712169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b731e86b-d55b-40e4-abcb-f5a65576e571 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:21.713367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b731e86b-d55b-40e4-abcb-f5a65576e571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:21.781632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 504/998] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:21.805330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e394ae2-b36d-4f33-b53e-a33da7882990 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:21.834877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:21.910696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e394ae2-b36d-4f33-b53e-a33da7882990 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:21.920569 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc2bc4-e989-4fcd-8d28-aaa0be078516 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:21.920881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc2bc4-e989-4fcd-8d28-aaa0be078516 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:21.921185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc2bc4-e989-4fcd-8d28-aaa0be078516 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:21.922802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 505/999] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:21.933850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76080ede-0ee3-4c76-ab5f-54478642958f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:21.934307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76080ede-0ee3-4c76-ab5f-54478642958f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:21.934590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76080ede-0ee3-4c76-ab5f-54478642958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:21.949230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641af31-3ba4-449e-9330-b86c5636c9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:21.950080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641af31-3ba4-449e-9330-b86c5636c9ba None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:21.950515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641af31-3ba4-449e-9330-b86c5636c9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:21.950955 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641af31-3ba4-449e-9330-b86c5636c9ba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:21.951727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641af31-3ba4-449e-9330-b86c5636c9ba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:21.953276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641af31-3ba4-449e-9330-b86c5636c9ba None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:21.953518 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-76080ede-0ee3-4c76-ab5f-54478642958f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:21.954723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-76080ede-0ee3-4c76-ab5f-54478642958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:21.957630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c641af31-3ba4-449e-9330-b86c5636c9ba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:21.963620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:21.964819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:41:21.965791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:21.971831 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 495/1000] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Aug 2 08:41:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:21.973322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641af31-3ba4-449e-9330-b86c5636c9ba None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:22.032379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 506/1001] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:22.054655 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76080ede-0ee3-4c76-ab5f-54478642958f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:22.073497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:22.083201 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641af31-3ba4-449e-9330-b86c5636c9ba None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:22.117601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f59fb-176b-4039-aa41-93ead06b029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:22.118256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f59fb-176b-4039-aa41-93ead06b029b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:22.118626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f59fb-176b-4039-aa41-93ead06b029b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:22.118899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f59fb-176b-4039-aa41-93ead06b029b None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:22.119578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f59fb-176b-4039-aa41-93ead06b029b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:22.119893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f59fb-176b-4039-aa41-93ead06b029b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:22.121290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f59fb-176b-4039-aa41-93ead06b029b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:22.126257 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 496/1002] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Aug 2 08:41:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:22.127423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd49dfb-1245-4ea8-ae94-ef12cfe60da0 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:22.127709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd49dfb-1245-4ea8-ae94-ef12cfe60da0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:22.127989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd49dfb-1245-4ea8-ae94-ef12cfe60da0 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:22.129231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 497/1003] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:22.132050 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd49dfb-1245-4ea8-ae94-ef12cfe60da0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:22.159346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76080ede-0ee3-4c76-ab5f-54478642958f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:22.192931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df430fc5-c624-4846-b464-047c10c9014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:22.193574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df430fc5-c624-4846-b464-047c10c9014d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:22.193858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df430fc5-c624-4846-b464-047c10c9014d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:22.194130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df430fc5-c624-4846-b464-047c10c9014d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:22.194774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df430fc5-c624-4846-b464-047c10c9014d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:22.196159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df430fc5-c624-4846-b464-047c10c9014d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-df430fc5-c624-4846-b464-047c10c9014d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:22.204984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:22.206033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:41:22.206974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:22.207722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 507/1004] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:22.208783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e977ff-bd03-421c-a13e-3f2251374f96 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:22.209073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e977ff-bd03-421c-a13e-3f2251374f96 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:22.209347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e977ff-bd03-421c-a13e-3f2251374f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:22.216944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:22.229345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-37e977ff-bd03-421c-a13e-3f2251374f96 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:22.230524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-37e977ff-bd03-421c-a13e-3f2251374f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:22.235355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd49dfb-1245-4ea8-ae94-ef12cfe60da0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:22.271827 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6116d-f0ed-4170-9b8e-4fa1c0c8aaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:22.272967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6116d-f0ed-4170-9b8e-4fa1c0c8aaad None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:22.273247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6116d-f0ed-4170-9b8e-4fa1c0c8aaad None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:22.273518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6116d-f0ed-4170-9b8e-4fa1c0c8aaad None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:22.274189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6116d-f0ed-4170-9b8e-4fa1c0c8aaad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:22.274499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6116d-f0ed-4170-9b8e-4fa1c0c8aaad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:22.275870 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6116d-f0ed-4170-9b8e-4fa1c0c8aaad None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:22.280823 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 498/1005] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Aug 2 08:41:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:22.281598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6116d-f0ed-4170-9b8e-4fa1c0c8aaad None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:22.301158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 508/1006] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:22.301990 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e977ff-bd03-421c-a13e-3f2251374f96 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:22.303296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:22.387126 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6116d-f0ed-4170-9b8e-4fa1c0c8aaad None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:22.409971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e977ff-bd03-421c-a13e-3f2251374f96 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:22.421075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7713b9-90fc-4367-910a-c6569a628142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:22.421688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7713b9-90fc-4367-910a-c6569a628142 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:22.421968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7713b9-90fc-4367-910a-c6569a628142 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:22.422240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7713b9-90fc-4367-910a-c6569a628142 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:22.422906 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7713b9-90fc-4367-910a-c6569a628142 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:22.423206 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7713b9-90fc-4367-910a-c6569a628142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:22.424597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7713b9-90fc-4367-910a-c6569a628142 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:22.429249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 499/1007] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:41:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:22.430011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7713b9-90fc-4367-910a-c6569a628142 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:22.442687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67518aa-802a-43dc-898b-85e115a5c710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:22.443306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67518aa-802a-43dc-898b-85e115a5c710 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:22.443590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67518aa-802a-43dc-898b-85e115a5c710 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:22.443862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67518aa-802a-43dc-898b-85e115a5c710 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:22.445094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67518aa-802a-43dc-898b-85e115a5c710 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:22.446445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67518aa-802a-43dc-898b-85e115a5c710 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:22.451343 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:22.464546 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 509/1008] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:41:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:41:22.465275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67518aa-802a-43dc-898b-85e115a5c710 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:22.542449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:22.563030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7713b9-90fc-4367-910a-c6569a628142 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:22.594892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67518aa-802a-43dc-898b-85e115a5c710 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:22.603292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a2062-1d03-4f28-91e1-1aad757e3339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:22.603974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a2062-1d03-4f28-91e1-1aad757e3339 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:22.604284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a2062-1d03-4f28-91e1-1aad757e3339 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:22.604556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a2062-1d03-4f28-91e1-1aad757e3339 None admin] PATH_INFO: `/v3/services/image` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:22.605311 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a2062-1d03-4f28-91e1-1aad757e3339 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:22.606692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a2062-1d03-4f28-91e1-1aad757e3339 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-6e4a2062-1d03-4f28-91e1-1aad757e3339 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:22.616202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:22.617280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:22.618111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 500/1009] 10.222.0.17 () {56 vars in 1105 bytes} [Tue Aug 2 08:41:22 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:22.623205 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a2062-1d03-4f28-91e1-1aad757e3339 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:22.640416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115291af-0d6b-449d-b41d-469e5c345e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:22.641027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115291af-0d6b-449d-b41d-469e5c345e7d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:22.641308 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115291af-0d6b-449d-b41d-469e5c345e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:22.641588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115291af-0d6b-449d-b41d-469e5c345e7d None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:22.643131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115291af-0d6b-449d-b41d-469e5c345e7d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:22.643131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115291af-0d6b-449d-b41d-469e5c345e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:22.643892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115291af-0d6b-449d-b41d-469e5c345e7d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:22.650711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 510/1010] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Aug 2 08:41:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:22.656722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115291af-0d6b-449d-b41d-469e5c345e7d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:22.715916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:22.737154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a2062-1d03-4f28-91e1-1aad757e3339 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:22.767309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115291af-0d6b-449d-b41d-469e5c345e7d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:22.773943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ef97-d364-48b7-b563-1e16336e6d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:22.774560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ef97-d364-48b7-b563-1e16336e6d4d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:22.774837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ef97-d364-48b7-b563-1e16336e6d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:22.775112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ef97-d364-48b7-b563-1e16336e6d4d None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:22.775786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74ef97-d364-48b7-b563-1e16336e6d4d None admin] RBAC: Adding query filter params (name=image) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:22.776090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74ef97-d364-48b7-b563-1e16336e6d4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:22.777482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74ef97-d364-48b7-b563-1e16336e6d4d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:22.783184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 501/1011] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:22.789030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ef97-d364-48b7-b563-1e16336e6d4d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:22.805287 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea128fc3-28e5-49e7-850c-2ba393925c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:22.805922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea128fc3-28e5-49e7-850c-2ba393925c99 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:22.806210 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea128fc3-28e5-49e7-850c-2ba393925c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:22.806495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea128fc3-28e5-49e7-850c-2ba393925c99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:22.807206 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea128fc3-28e5-49e7-850c-2ba393925c99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:22.808629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea128fc3-28e5-49e7-850c-2ba393925c99 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:22.814413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:22.829778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 511/1012] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:41:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:41:22.922271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ef97-d364-48b7-b563-1e16336e6d4d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:22.968015 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6e82-2629-43d6-bc12-98bf9f06c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:22.968596 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6e82-2629-43d6-bc12-98bf9f06c85f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:22.968882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6e82-2629-43d6-bc12-98bf9f06c85f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:22.969160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6e82-2629-43d6-bc12-98bf9f06c85f None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:22.969850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6e82-2629-43d6-bc12-98bf9f06c85f None admin] RBAC: Adding query filter params (type=image) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:22.970167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6e82-2629-43d6-bc12-98bf9f06c85f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:22.971560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6e82-2629-43d6-bc12-98bf9f06c85f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:22.978213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 502/1013] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:24.516959 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6c7e-6234-48b1-91d4-30763fc554fe None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:24.517510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6c7e-6234-48b1-91d4-30763fc554fe None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:24.517510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6c7e-6234-48b1-91d4-30763fc554fe None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:24.519087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 512/1014] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:24.524131 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12767b-80f5-4018-9993-5d9f82b990a4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:24.524546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12767b-80f5-4018-9993-5d9f82b990a4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:24.524716 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12767b-80f5-4018-9993-5d9f82b990a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:24.542897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-dd12767b-80f5-4018-9993-5d9f82b990a4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:24.544100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-dd12767b-80f5-4018-9993-5d9f82b990a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:24.614387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 503/1015] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:24 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:24.637499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6c7e-6234-48b1-91d4-30763fc554fe None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:24.744394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6c7e-6234-48b1-91d4-30763fc554fe None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:24.765568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:24.792441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e8b7-cc7d-4ded-b495-6271dfbb0f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:24.793090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e8b7-cc7d-4ded-b495-6271dfbb0f3e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:24.793374 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e8b7-cc7d-4ded-b495-6271dfbb0f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:24.793649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e8b7-cc7d-4ded-b495-6271dfbb0f3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:24.794798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e8b7-cc7d-4ded-b495-6271dfbb0f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:24.796312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e8b7-cc7d-4ded-b495-6271dfbb0f3e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:24.803007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 513/1016] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:24.804581 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12767b-80f5-4018-9993-5d9f82b990a4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:24.806785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:24.915985 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12767b-80f5-4018-9993-5d9f82b990a4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:24.950957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47d288-da41-422a-babe-2bb65ad7c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:24.951661 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47d288-da41-422a-babe-2bb65ad7c218 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:24.951945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47d288-da41-422a-babe-2bb65ad7c218 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:24.952252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47d288-da41-422a-babe-2bb65ad7c218 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:24.952963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47d288-da41-422a-babe-2bb65ad7c218 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:24.954475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47d288-da41-422a-babe-2bb65ad7c218 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:24.963917 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0010adc-54f4-4870-9fd9-082273416bb5 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:24.964522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0010adc-54f4-4870-9fd9-082273416bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:24.964885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0010adc-54f4-4870-9fd9-082273416bb5 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:24.967192 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 514/1017] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:24.971933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd4c1-1ed0-467b-8382-35e02b6a508f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:24.972239 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd4c1-1ed0-467b-8382-35e02b6a508f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:24.972607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd4c1-1ed0-467b-8382-35e02b6a508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:24.983894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 504/1018] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:41:24 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:41:24.985217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803c5c-426f-4fe1-93a7-1261e0887d17 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:24.985510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803c5c-426f-4fe1-93a7-1261e0887d17 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:24.985791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803c5c-426f-4fe1-93a7-1261e0887d17 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:24.987121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 505/1019] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:24.993092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696e07f-57cd-4560-9ca7-e54f196f0695 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:24.993404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696e07f-57cd-4560-9ca7-e54f196f0695 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:24.993681 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696e07f-57cd-4560-9ca7-e54f196f0695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:24.994874 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-21dbd4c1-1ed0-467b-8382-35e02b6a508f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:24.996160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-21dbd4c1-1ed0-467b-8382-35e02b6a508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:25.013567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5696e07f-57cd-4560-9ca7-e54f196f0695 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:25.014822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5696e07f-57cd-4560-9ca7-e54f196f0695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:25.073453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:25.081737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 515/1020] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:24 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:25.102449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 506/1021] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:24 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:25.112419 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbd4c1-1ed0-467b-8382-35e02b6a508f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:25.124873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696e07f-57cd-4560-9ca7-e54f196f0695 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:25.221546 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbd4c1-1ed0-467b-8382-35e02b6a508f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:25.232774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:25.244818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696e07f-57cd-4560-9ca7-e54f196f0695 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:25.262800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba327b-dda3-4c1f-9440-6e1e78dd4b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:25.263458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba327b-dda3-4c1f-9440-6e1e78dd4b47 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:25.263737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba327b-dda3-4c1f-9440-6e1e78dd4b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:25.264013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba327b-dda3-4c1f-9440-6e1e78dd4b47 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:25.275719 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba327b-dda3-4c1f-9440-6e1e78dd4b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9bba327b-dda3-4c1f-9440-6e1e78dd4b47 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:25.281550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:25.282489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:25.283330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:25.283330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:25.283330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:25.283330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:25.283330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:25.283330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:25.283330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:25.283330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:25.283330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:25.283330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:25.283330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:41:25.283330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:25.283952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac91e96-4d6c-4db7-9e5f-38a947ec3d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:25.283952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac91e96-4d6c-4db7-9e5f-38a947ec3d49 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:25.283952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac91e96-4d6c-4db7-9e5f-38a947ec3d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:25.283952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac91e96-4d6c-4db7-9e5f-38a947ec3d49 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:25.284256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac91e96-4d6c-4db7-9e5f-38a947ec3d49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:25.289783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 516/1022] 10.222.0.17 () {56 vars in 1120 bytes} [Tue Aug 2 08:41:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:25.289930 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac91e96-4d6c-4db7-9e5f-38a947ec3d49 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:25.292403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba327b-dda3-4c1f-9440-6e1e78dd4b47 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:25.302995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 507/1023] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:41:25 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:41:25.414902 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba327b-dda3-4c1f-9440-6e1e78dd4b47 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:25.461482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e162a96-3960-4b1d-9d29-2c6f9d11eed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:25.461917 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e162a96-3960-4b1d-9d29-2c6f9d11eed5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:25.462199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e162a96-3960-4b1d-9d29-2c6f9d11eed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:25.462471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e162a96-3960-4b1d-9d29-2c6f9d11eed5 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:25.463229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e162a96-3960-4b1d-9d29-2c6f9d11eed5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:25.463810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e162a96-3960-4b1d-9d29-2c6f9d11eed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:25.465370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e162a96-3960-4b1d-9d29-2c6f9d11eed5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:25.474313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 517/1024] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Aug 2 08:41:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:25.480355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac91e96-4d6c-4db7-9e5f-38a947ec3d49 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:25.530631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:25.589344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac91e96-4d6c-4db7-9e5f-38a947ec3d49 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:25.622982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3127-b185-4377-af13-ffbf5086b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:25.623622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3127-b185-4377-af13-ffbf5086b76c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:25.623904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3127-b185-4377-af13-ffbf5086b76c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:25.624215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3127-b185-4377-af13-ffbf5086b76c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:25.635469 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c3127-b185-4377-af13-ffbf5086b76c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:25.636941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c3127-b185-4377-af13-ffbf5086b76c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e35c3127-b185-4377-af13-ffbf5086b76c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:25.652556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:25.653809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:25.655309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:25.655309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:25.655309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:25.655309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:25.655309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 508/1025] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:25.661380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e162a96-3960-4b1d-9d29-2c6f9d11eed5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:25.691640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:25.768622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e162a96-3960-4b1d-9d29-2c6f9d11eed5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:25.811515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780943cd-4b70-4559-af06-73678d54b105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:25.811515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780943cd-4b70-4559-af06-73678d54b105 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:25.811515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780943cd-4b70-4559-af06-73678d54b105 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:25.811835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780943cd-4b70-4559-af06-73678d54b105 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:25.812542 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780943cd-4b70-4559-af06-73678d54b105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:25.812861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780943cd-4b70-4559-af06-73678d54b105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:25.814249 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780943cd-4b70-4559-af06-73678d54b105 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:25.831734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 518/1026] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:25.833703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3127-b185-4377-af13-ffbf5086b76c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:25.934709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:25.941876 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3127-b185-4377-af13-ffbf5086b76c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:25.975960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6223853-9a70-4620-8eb6-e0c33de08b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:25.976638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6223853-9a70-4620-8eb6-e0c33de08b4d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:25.976926 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6223853-9a70-4620-8eb6-e0c33de08b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:25.977198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6223853-9a70-4620-8eb6-e0c33de08b4d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:25.984721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6223853-9a70-4620-8eb6-e0c33de08b4d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:25.986156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6223853-9a70-4620-8eb6-e0c33de08b4d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e6223853-9a70-4620-8eb6-e0c33de08b4d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:41:25.997819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:25.998757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:25.999703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:25.999703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:25.999703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:41:25.999703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:41:25.999703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:41:25.999703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:41:25.999703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:41:25.999703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:41:25.999703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:41:25.999703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:25.999703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 509/1027] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Aug 2 08:41:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:26.006482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780943cd-4b70-4559-af06-73678d54b105 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:26.096439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:26.112882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780943cd-4b70-4559-af06-73678d54b105 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:26.147740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054bbd7-ad06-4b0f-a77e-dc4891a58dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:26.148412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054bbd7-ad06-4b0f-a77e-dc4891a58dda None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:26.148697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054bbd7-ad06-4b0f-a77e-dc4891a58dda None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:26.148973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054bbd7-ad06-4b0f-a77e-dc4891a58dda None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:26.149792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054bbd7-ad06-4b0f-a77e-dc4891a58dda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:26.150105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054bbd7-ad06-4b0f-a77e-dc4891a58dda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:26.151583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054bbd7-ad06-4b0f-a77e-dc4891a58dda None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:26.176516 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 519/1028] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Aug 2 08:41:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:26.177848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6223853-9a70-4620-8eb6-e0c33de08b4d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:26.281802 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6223853-9a70-4620-8eb6-e0c33de08b4d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:26.319899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43368c-390a-49a6-843e-6ab22dfc41e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:26.320563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43368c-390a-49a6-843e-6ab22dfc41e0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:26.320855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43368c-390a-49a6-843e-6ab22dfc41e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:26.321164 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43368c-390a-49a6-843e-6ab22dfc41e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:26.346768 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:26.393147 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43368c-390a-49a6-843e-6ab22dfc41e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:26.394602 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43368c-390a-49a6-843e-6ab22dfc41e0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:26.501393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 510/1029] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:41:26 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:41:26.506919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054bbd7-ad06-4b0f-a77e-dc4891a58dda None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:26.608470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054bbd7-ad06-4b0f-a77e-dc4891a58dda None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:26.644723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da42a1-e216-465e-bc86-80e2b21fc330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:26.645372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da42a1-e216-465e-bc86-80e2b21fc330 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:26.645654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da42a1-e216-465e-bc86-80e2b21fc330 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:26.645928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da42a1-e216-465e-bc86-80e2b21fc330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:26.657041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da42a1-e216-465e-bc86-80e2b21fc330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:26.658752 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da42a1-e216-465e-bc86-80e2b21fc330 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:26.661452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-40da42a1-e216-465e-bc86-80e2b21fc330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:26.676507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:26.677455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:26.678373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:26.678373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:26.678373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:26.678373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:26.680273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 520/1030] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:26.683394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43368c-390a-49a6-843e-6ab22dfc41e0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:26.745465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:26.791969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43368c-390a-49a6-843e-6ab22dfc41e0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:26.836492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf55db-b37c-4ecc-aaa1-1ffd9d8338a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:26.837119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf55db-b37c-4ecc-aaa1-1ffd9d8338a1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:26.837406 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf55db-b37c-4ecc-aaa1-1ffd9d8338a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:26.837686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf55db-b37c-4ecc-aaa1-1ffd9d8338a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:26.838384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf55db-b37c-4ecc-aaa1-1ffd9d8338a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:26.838692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf55db-b37c-4ecc-aaa1-1ffd9d8338a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:26.840075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf55db-b37c-4ecc-aaa1-1ffd9d8338a1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:26.857711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 511/1031] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:26.858862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da42a1-e216-465e-bc86-80e2b21fc330 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:26.961592 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da42a1-e216-465e-bc86-80e2b21fc330 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:26.996385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577225b-7dd0-40cf-8e66-fa23e2a6dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:26.997034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577225b-7dd0-40cf-8e66-fa23e2a6dd8f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:26.997320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577225b-7dd0-40cf-8e66-fa23e2a6dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:26.997598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577225b-7dd0-40cf-8e66-fa23e2a6dd8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:27.004450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577225b-7dd0-40cf-8e66-fa23e2a6dd8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:27.005902 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577225b-7dd0-40cf-8e66-fa23e2a6dd8f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4577225b-7dd0-40cf-8e66-fa23e2a6dd8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:41:27.018229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:27.019182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:27.020089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:41:27.020089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:41:27.020089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:41:27.020089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:41:27.020089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:41:27.020089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:41:27.020089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:27.020089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:27.020089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 521/1032] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:27.027585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf55db-b37c-4ecc-aaa1-1ffd9d8338a1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:27.051437 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3e01e-218c-45d8-9411-d11909b6d98b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:27.051726 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3e01e-218c-45d8-9411-d11909b6d98b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:27.052006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3e01e-218c-45d8-9411-d11909b6d98b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:27.053422 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 522/1033] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:27.058403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e5afe-0b0f-4567-9570-2c044849b7a6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:27.058647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e5afe-0b0f-4567-9570-2c044849b7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:27.058928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e5afe-0b0f-4567-9570-2c044849b7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:27.077440 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d01e5afe-0b0f-4567-9570-2c044849b7a6 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:27.078630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d01e5afe-0b0f-4567-9570-2c044849b7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:27.140260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf55db-b37c-4ecc-aaa1-1ffd9d8338a1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:27.140900 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:27.158340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 523/1034] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:27.160097 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:27.179097 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ac8cf-239c-4dbf-a12f-3555d70e52f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:27.179729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ac8cf-239c-4dbf-a12f-3555d70e52f3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:27.180023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ac8cf-239c-4dbf-a12f-3555d70e52f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:27.180322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ac8cf-239c-4dbf-a12f-3555d70e52f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:27.181069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ac8cf-239c-4dbf-a12f-3555d70e52f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:27.181380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ac8cf-239c-4dbf-a12f-3555d70e52f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:27.182896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ac8cf-239c-4dbf-a12f-3555d70e52f3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:27.183733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e5afe-0b0f-4567-9570-2c044849b7a6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:27.202085 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 512/1035] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:41:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:27.203414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ac8cf-239c-4dbf-a12f-3555d70e52f3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:27.314327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e5afe-0b0f-4567-9570-2c044849b7a6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:27.328953 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ac8cf-239c-4dbf-a12f-3555d70e52f3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:27.351251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8aa4e-eca0-4db1-9437-4f599c62db09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:27.351897 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8aa4e-eca0-4db1-9437-4f599c62db09 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:27.352207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8aa4e-eca0-4db1-9437-4f599c62db09 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:27.352481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8aa4e-eca0-4db1-9437-4f599c62db09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:27.353620 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8aa4e-eca0-4db1-9437-4f599c62db09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:27.355046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8aa4e-eca0-4db1-9437-4f599c62db09 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:27.361599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 524/1036] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:27.361599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fca29-0ca5-4cdc-bc8b-a774db091853 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:27.361599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fca29-0ca5-4cdc-bc8b-a774db091853 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:27.361599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fca29-0ca5-4cdc-bc8b-a774db091853 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:27.361599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 525/1037] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:27.362298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fca29-0ca5-4cdc-bc8b-a774db091853 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:27.365903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee1091-a099-4d92-b861-1b3bde86481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:27.367038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee1091-a099-4d92-b861-1b3bde86481c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:27.367313 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee1091-a099-4d92-b861-1b3bde86481c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:27.367584 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee1091-a099-4d92-b861-1b3bde86481c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:27.368390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee1091-a099-4d92-b861-1b3bde86481c None admin] RBAC: Adding query filter params (role.id=3812c2fc466047f29e976571d85ca6d8, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=e1de289ba7ae4140a421127b8f18901f) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:27.368700 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee1091-a099-4d92-b861-1b3bde86481c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:27.370109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee1091-a099-4d92-b861-1b3bde86481c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:27.375774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 513/1038] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:41:27 2022] GET /identity/v3/role_assignments?user.id=e1de289ba7ae4140a421127b8f18901f&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=3812c2fc466047f29e976571d85ca6d8 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:27.376965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12156f-7063-45c7-b8e8-6a4eb9759b51 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:27.377252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12156f-7063-45c7-b8e8-6a4eb9759b51 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:27.377524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12156f-7063-45c7-b8e8-6a4eb9759b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:27.400815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ee12156f-7063-45c7-b8e8-6a4eb9759b51 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:27.401977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ee12156f-7063-45c7-b8e8-6a4eb9759b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:27.431930 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:27.445093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:27.484914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 514/1039] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:27.492899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fca29-0ca5-4cdc-bc8b-a774db091853 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:27.508867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12156f-7063-45c7-b8e8-6a4eb9759b51 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:27.533687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ee0f5-d30e-4e61-8042-6efcfab4cffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:27.534312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ee0f5-d30e-4e61-8042-6efcfab4cffe None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:27.534601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ee0f5-d30e-4e61-8042-6efcfab4cffe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:27.534878 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ee0f5-d30e-4e61-8042-6efcfab4cffe None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:27.535566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ee0f5-d30e-4e61-8042-6efcfab4cffe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:27.537216 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ee0f5-d30e-4e61-8042-6efcfab4cffe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:27.563000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 526/1040] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:41:27 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:41:27.646080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12156f-7063-45c7-b8e8-6a4eb9759b51 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:27.686842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b187864-001c-4c73-940d-90ce6bbcefea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:27.688381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187864-001c-4c73-940d-90ce6bbcefea None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:27.688868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187864-001c-4c73-940d-90ce6bbcefea None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:27.689373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187864-001c-4c73-940d-90ce6bbcefea None admin] PATH_INFO: `/v3/services/image` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:27.690237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b187864-001c-4c73-940d-90ce6bbcefea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:27.691970 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b187864-001c-4c73-940d-90ce6bbcefea None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8b187864-001c-4c73-940d-90ce6bbcefea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:27.702371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:27.703472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:41:27.704337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:27.705092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 515/1041] 10.222.0.17 () {56 vars in 1105 bytes} [Tue Aug 2 08:41:27 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:27.711148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ee0f5-d30e-4e61-8042-6efcfab4cffe None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:27.826143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ee0f5-d30e-4e61-8042-6efcfab4cffe None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:27.839218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:27.866274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ad4ef-cc47-4e92-a8f9-0db6d5a1d587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:27.867392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ad4ef-cc47-4e92-a8f9-0db6d5a1d587 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:27.867675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ad4ef-cc47-4e92-a8f9-0db6d5a1d587 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:27.867947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ad4ef-cc47-4e92-a8f9-0db6d5a1d587 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:27.868664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ad4ef-cc47-4e92-a8f9-0db6d5a1d587 None admin] RBAC: Adding query filter params (name=image) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:27.869046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ad4ef-cc47-4e92-a8f9-0db6d5a1d587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:27.870483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ad4ef-cc47-4e92-a8f9-0db6d5a1d587 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:27.876365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 527/1042] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:27.882159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b187864-001c-4c73-940d-90ce6bbcefea None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:27.928392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:27.998858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b187864-001c-4c73-940d-90ce6bbcefea None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:28.035088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e021c-ebdc-4c9a-9238-b2cc7f9d1556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:28.035796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e021c-ebdc-4c9a-9238-b2cc7f9d1556 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:28.036082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e021c-ebdc-4c9a-9238-b2cc7f9d1556 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:28.036578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e021c-ebdc-4c9a-9238-b2cc7f9d1556 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:28.037568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e021c-ebdc-4c9a-9238-b2cc7f9d1556 None admin] RBAC: Adding query filter params (type=image) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:28.037971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e021c-ebdc-4c9a-9238-b2cc7f9d1556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:28.040608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e021c-ebdc-4c9a-9238-b2cc7f9d1556 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:28.050694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 516/1043] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:28.052241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ad4ef-cc47-4e92-a8f9-0db6d5a1d587 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:28.156076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ad4ef-cc47-4e92-a8f9-0db6d5a1d587 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:28.193587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec4035-7ddb-407b-827a-0eef68b83180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:28.194436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec4035-7ddb-407b-827a-0eef68b83180 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:28.194720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec4035-7ddb-407b-827a-0eef68b83180 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:28.195001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec4035-7ddb-407b-827a-0eef68b83180 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:28.195762 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec4035-7ddb-407b-827a-0eef68b83180 None admin] RBAC: Adding query filter params (interface=public, service_id=03ade67e054341bbb7da6dbb4870238c, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:28.196266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec4035-7ddb-407b-827a-0eef68b83180 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:28.198699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec4035-7ddb-407b-827a-0eef68b83180 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:28.205120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 528/1044] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Aug 2 08:41:28 2022] GET /identity/v3/endpoints?service_id=03ade67e054341bbb7da6dbb4870238c&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:28.212899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e021c-ebdc-4c9a-9238-b2cc7f9d1556 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:28.311414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:28.316005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e021c-ebdc-4c9a-9238-b2cc7f9d1556 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:28.353950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff14985-6909-4300-b553-6d4079d2c534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:28.354575 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff14985-6909-4300-b553-6d4079d2c534 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:28.354858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff14985-6909-4300-b553-6d4079d2c534 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:28.355131 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff14985-6909-4300-b553-6d4079d2c534 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:28.355793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff14985-6909-4300-b553-6d4079d2c534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:28.357186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff14985-6909-4300-b553-6d4079d2c534 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:28.372204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 517/1045] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Aug 2 08:41:28 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:41:29.397452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f7341-6c1a-45c8-9a4a-0962b62a9931 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:29.398640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f7341-6c1a-45c8-9a4a-0962b62a9931 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:29.398640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f7341-6c1a-45c8-9a4a-0962b62a9931 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:29.400048 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 529/1046] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:29.406266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9f726-da43-4858-a57b-ef67f6953335 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:29.406699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9f726-da43-4858-a57b-ef67f6953335 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:29.406909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9f726-da43-4858-a57b-ef67f6953335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:29.424947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-08a9f726-da43-4858-a57b-ef67f6953335 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:29.426136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-08a9f726-da43-4858-a57b-ef67f6953335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:29.495881 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 518/1047] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:29.523927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f7341-6c1a-45c8-9a4a-0962b62a9931 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:29.565918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:29.631259 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f7341-6c1a-45c8-9a4a-0962b62a9931 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:29.664916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b88e-d6dc-454e-b488-de7834d7378a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:29.665135 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b88e-d6dc-454e-b488-de7834d7378a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:29.665420 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b88e-d6dc-454e-b488-de7834d7378a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:29.666903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 519/1048] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:29.668714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888efea6-3a6e-49e3-b073-33d54480ff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:29.669415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888efea6-3a6e-49e3-b073-33d54480ff3f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:29.669700 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888efea6-3a6e-49e3-b073-33d54480ff3f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:29.669972 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888efea6-3a6e-49e3-b073-33d54480ff3f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:29.671512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc522e-29bc-41b3-9766-71068db8445f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:29.671926 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc522e-29bc-41b3-9766-71068db8445f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:29.672266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc522e-29bc-41b3-9766-71068db8445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:29.681309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888efea6-3a6e-49e3-b073-33d54480ff3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-888efea6-3a6e-49e3-b073-33d54480ff3f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:29.686307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:29.687261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:29.688135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 530/1049] 10.222.0.17 () {56 vars in 1120 bytes} [Tue Aug 2 08:41:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:29.693202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888efea6-3a6e-49e3-b073-33d54480ff3f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:29.693367 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-acfc522e-29bc-41b3-9766-71068db8445f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:29.695276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-acfc522e-29bc-41b3-9766-71068db8445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:29.765541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 520/1050] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:29.788810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc522e-29bc-41b3-9766-71068db8445f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:29.806167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:29.811097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888efea6-3a6e-49e3-b073-33d54480ff3f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:29.821112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:29.855789 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3bc97-93ec-4cbe-8277-57549ad2dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:29.856458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3bc97-93ec-4cbe-8277-57549ad2dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:29.856746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3bc97-93ec-4cbe-8277-57549ad2dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:29.857031 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3bc97-93ec-4cbe-8277-57549ad2dfb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:29.857755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3bc97-93ec-4cbe-8277-57549ad2dfb2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:29.858186 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3bc97-93ec-4cbe-8277-57549ad2dfb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:29.859622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3bc97-93ec-4cbe-8277-57549ad2dfb2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:29.868756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 531/1051] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Aug 2 08:41:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:29.874496 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3bc97-93ec-4cbe-8277-57549ad2dfb2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:29.907611 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc522e-29bc-41b3-9766-71068db8445f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:29.944384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae78e33-2343-459b-a9f5-a9f69bac5a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:29.945004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae78e33-2343-459b-a9f5-a9f69bac5a18 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:29.945288 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae78e33-2343-459b-a9f5-a9f69bac5a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:29.945561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae78e33-2343-459b-a9f5-a9f69bac5a18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:29.956248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae78e33-2343-459b-a9f5-a9f69bac5a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9ae78e33-2343-459b-a9f5-a9f69bac5a18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:29.961425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:29.962434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:29.963269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:29.963269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:29.963269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:29.963269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:29.963269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:29.963269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:29.963269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:29.963269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:29.963269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:29.963269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:29.963269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:41:29.963269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:29.967667 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 521/1052] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:41:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:29.968520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae78e33-2343-459b-a9f5-a9f69bac5a18 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:29.988516 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3bc97-93ec-4cbe-8277-57549ad2dfb2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:30.032024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8c0d8-0fc9-4810-bc0f-ef4f3d3cf453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:30.032664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8c0d8-0fc9-4810-bc0f-ef4f3d3cf453 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.032957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8c0d8-0fc9-4810-bc0f-ef4f3d3cf453 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.033238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8c0d8-0fc9-4810-bc0f-ef4f3d3cf453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.045652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8c0d8-0fc9-4810-bc0f-ef4f3d3cf453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:30.047935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8c0d8-0fc9-4810-bc0f-ef4f3d3cf453 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:30.059229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-13c8c0d8-0fc9-4810-bc0f-ef4f3d3cf453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:30.063622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:30.064757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:30.065684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:30.065684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:30.065684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:30.065684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:30.065684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 532/1053] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:30.070508 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8c0d8-0fc9-4810-bc0f-ef4f3d3cf453 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:30.082688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae78e33-2343-459b-a9f5-a9f69bac5a18 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:30.086450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:30.121807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0d1dc-1d9b-452a-9fbd-6711797b753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:30.122662 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0d1dc-1d9b-452a-9fbd-6711797b753a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.123090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0d1dc-1d9b-452a-9fbd-6711797b753a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.123548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0d1dc-1d9b-452a-9fbd-6711797b753a None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.124286 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0d1dc-1d9b-452a-9fbd-6711797b753a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:30.124595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0d1dc-1d9b-452a-9fbd-6711797b753a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:30.125950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0d1dc-1d9b-452a-9fbd-6711797b753a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:30.134940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 522/1054] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:41:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:30.140484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0d1dc-1d9b-452a-9fbd-6711797b753a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:30.186021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8c0d8-0fc9-4810-bc0f-ef4f3d3cf453 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:30.235170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c50ee2-371f-40c5-9499-605071ff7486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:30.235701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c50ee2-371f-40c5-9499-605071ff7486 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.235983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c50ee2-371f-40c5-9499-605071ff7486 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.236273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c50ee2-371f-40c5-9499-605071ff7486 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.236957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c50ee2-371f-40c5-9499-605071ff7486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:30.237260 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c50ee2-371f-40c5-9499-605071ff7486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:30.238619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c50ee2-371f-40c5-9499-605071ff7486 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:30.250663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0d1dc-1d9b-452a-9fbd-6711797b753a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:30.255552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 533/1055] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:30.256764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c50ee2-371f-40c5-9499-605071ff7486 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:30.289686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3a839-1cc3-440a-9b83-6feb2e162045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:30.290335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3a839-1cc3-440a-9b83-6feb2e162045 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.290615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3a839-1cc3-440a-9b83-6feb2e162045 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.290884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3a839-1cc3-440a-9b83-6feb2e162045 None admin] PATH_INFO: `/v3/users/b15c53ec1a46434284223dd5dce73199` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.305689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3a839-1cc3-440a-9b83-6feb2e162045 None admin] RBAC: Authorizing `identity:get_user(user_id=b15c53ec1a46434284223dd5dce73199)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:30.307111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3a839-1cc3-440a-9b83-6feb2e162045 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:30.308808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 523/1056] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:41:30 2022] GET /identity/v3/users/b15c53ec1a46434284223dd5dce73199 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:30.314792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3a839-1cc3-440a-9b83-6feb2e162045 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:30.317601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:30.335864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:30.373492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c50ee2-371f-40c5-9499-605071ff7486 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:30.410636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04db7a-9986-4912-938c-d81570de2d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:30.411300 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04db7a-9986-4912-938c-d81570de2d46 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.411543 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04db7a-9986-4912-938c-d81570de2d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.411815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04db7a-9986-4912-938c-d81570de2d46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.419527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04db7a-9986-4912-938c-d81570de2d46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:30.421273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04db7a-9986-4912-938c-d81570de2d46 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:30.427049 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3a839-1cc3-440a-9b83-6feb2e162045 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-dd04db7a-9986-4912-938c-d81570de2d46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:41:30.433256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:30.434217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:30.435173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:30.435173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:30.435173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:41:30.435173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:41:30.435173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:41:30.435173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:41:30.435173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:41:30.435173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:41:30.435173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:41:30.435173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:30.435173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 534/1057] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Aug 2 08:41:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:30.436139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730542ca-7bff-4981-9621-1f0925c4dd7d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.436386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730542ca-7bff-4981-9621-1f0925c4dd7d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.436627 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730542ca-7bff-4981-9621-1f0925c4dd7d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.437887 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 535/1058] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:30.440103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730542ca-7bff-4981-9621-1f0925c4dd7d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:30.465880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fb873-617a-4094-9adf-58aa78f18b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:30.466499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fb873-617a-4094-9adf-58aa78f18b67 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.466785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fb873-617a-4094-9adf-58aa78f18b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.467063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fb873-617a-4094-9adf-58aa78f18b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.533893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fb873-617a-4094-9adf-58aa78f18b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:30.535253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fb873-617a-4094-9adf-58aa78f18b67 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:30.537132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:30.540935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730542ca-7bff-4981-9621-1f0925c4dd7d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:30.573160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:30.578745 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e07c8-0444-4c20-b340-339368b53312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:30.579438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e07c8-0444-4c20-b340-339368b53312 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.579734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e07c8-0444-4c20-b340-339368b53312 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.580008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e07c8-0444-4c20-b340-339368b53312 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.580886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e07c8-0444-4c20-b340-339368b53312 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:30.581213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e07c8-0444-4c20-b340-339368b53312 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:30.582724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e07c8-0444-4c20-b340-339368b53312 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:30.600776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 536/1059] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Aug 2 08:41:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:30.601982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b81e49-5436-41bf-8d2f-4b3c2d523b3e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.602272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b81e49-5436-41bf-8d2f-4b3c2d523b3e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.602554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b81e49-5436-41bf-8d2f-4b3c2d523b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.620946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a3b81e49-5436-41bf-8d2f-4b3c2d523b3e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:30.622156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a3b81e49-5436-41bf-8d2f-4b3c2d523b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:30.638616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 524/1060] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:41:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:41:30.639455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fb873-617a-4094-9adf-58aa78f18b67 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:30.690741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 537/1061] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:30.691583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b81e49-5436-41bf-8d2f-4b3c2d523b3e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:30.739756 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fb873-617a-4094-9adf-58aa78f18b67 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:30.742097 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:30.775761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e90acb-e7b1-4793-a6ac-94e8069014ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:30.776437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e90acb-e7b1-4793-a6ac-94e8069014ef None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.776726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e90acb-e7b1-4793-a6ac-94e8069014ef None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.777004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e90acb-e7b1-4793-a6ac-94e8069014ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.787007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e90acb-e7b1-4793-a6ac-94e8069014ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:30.788973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e90acb-e7b1-4793-a6ac-94e8069014ef None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:30.796568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b81e49-5436-41bf-8d2f-4b3c2d523b3e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-46e90acb-e7b1-4793-a6ac-94e8069014ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:30.803437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:30.804957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:30.805868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:30.805868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:30.805868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:30.805868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:30.805868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 525/1062] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:30.805868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e90acb-e7b1-4793-a6ac-94e8069014ef None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:30.820286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:30.835142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d2187-f766-4a5b-9a89-45071c2668bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:30.835785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d2187-f766-4a5b-9a89-45071c2668bf None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.836064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d2187-f766-4a5b-9a89-45071c2668bf None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.836364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d2187-f766-4a5b-9a89-45071c2668bf None admin] PATH_INFO: `/v3/projects/583f5b2131f942779222b3d41255e104` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.837512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d2187-f766-4a5b-9a89-45071c2668bf None admin] RBAC: Authorizing `identity:get_project(project_id=583f5b2131f942779222b3d41255e104)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:30.838939 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d2187-f766-4a5b-9a89-45071c2668bf None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:30.840767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 538/1063] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:41:30 2022] GET /identity/v3/projects/583f5b2131f942779222b3d41255e104 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:30.841528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d2187-f766-4a5b-9a89-45071c2668bf None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:30.911241 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e90acb-e7b1-4793-a6ac-94e8069014ef None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:30.941577 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d2187-f766-4a5b-9a89-45071c2668bf None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:30.944856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a0114-d637-4a08-a04b-5d2bd39c26be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:30.945500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a0114-d637-4a08-a04b-5d2bd39c26be None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.945785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a0114-d637-4a08-a04b-5d2bd39c26be None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.946063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a0114-d637-4a08-a04b-5d2bd39c26be None admin] PATH_INFO: `/v3/services/image` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.946691 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a0114-d637-4a08-a04b-5d2bd39c26be None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:30.948064 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a0114-d637-4a08-a04b-5d2bd39c26be None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-cf4a0114-d637-4a08-a04b-5d2bd39c26be None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:30.956917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:30.958061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:30.959145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 526/1064] 10.222.0.17 () {56 vars in 1105 bytes} [Tue Aug 2 08:41:30 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:30.960047 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a0114-d637-4a08-a04b-5d2bd39c26be None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:30.979290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:30.982800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3014cca-56da-4fdb-9c61-1b36bce69672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:30.983422 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3014cca-56da-4fdb-9c61-1b36bce69672 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:30.983701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3014cca-56da-4fdb-9c61-1b36bce69672 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:30.983969 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3014cca-56da-4fdb-9c61-1b36bce69672 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:30.984684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3014cca-56da-4fdb-9c61-1b36bce69672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:30.985006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3014cca-56da-4fdb-9c61-1b36bce69672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:30.986400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3014cca-56da-4fdb-9c61-1b36bce69672 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:30.998633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 539/1065] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:30.999447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3014cca-56da-4fdb-9c61-1b36bce69672 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:31.049060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:31.062391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a0114-d637-4a08-a04b-5d2bd39c26be None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:31.095555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed2b46-0d60-4761-819f-95767a6637ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:31.096189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed2b46-0d60-4761-819f-95767a6637ec None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:31.096471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed2b46-0d60-4761-819f-95767a6637ec None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:31.096741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed2b46-0d60-4761-819f-95767a6637ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:31.097514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed2b46-0d60-4761-819f-95767a6637ec None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=583f5b2131f942779222b3d41255e104, user.id=b15c53ec1a46434284223dd5dce73199) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:31.097819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed2b46-0d60-4761-819f-95767a6637ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:31.099218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed2b46-0d60-4761-819f-95767a6637ec None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:31.099361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3014cca-56da-4fdb-9c61-1b36bce69672 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:31.105465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 527/1066] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:41:30 2022] GET /identity/v3/role_assignments?user.id=b15c53ec1a46434284223dd5dce73199&scope.project.id=583f5b2131f942779222b3d41255e104&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:31.106327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed2b46-0d60-4761-819f-95767a6637ec None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:31.138243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23322444-c888-4faf-b2aa-32590bdf206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:31.138882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23322444-c888-4faf-b2aa-32590bdf206c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:31.139179 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23322444-c888-4faf-b2aa-32590bdf206c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:31.139660 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23322444-c888-4faf-b2aa-32590bdf206c None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:31.140388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23322444-c888-4faf-b2aa-32590bdf206c None admin] RBAC: Adding query filter params (name=image) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:31.140698 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23322444-c888-4faf-b2aa-32590bdf206c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:31.142117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23322444-c888-4faf-b2aa-32590bdf206c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:31.148607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 540/1067] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:31.153941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23322444-c888-4faf-b2aa-32590bdf206c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:31.213075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:31.234803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed2b46-0d60-4761-819f-95767a6637ec None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:31.271971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23322444-c888-4faf-b2aa-32590bdf206c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:31.273494 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2838ae-39fe-4f06-9e9a-7468dc7482e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:31.274252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2838ae-39fe-4f06-9e9a-7468dc7482e7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:31.274533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2838ae-39fe-4f06-9e9a-7468dc7482e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:31.274803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2838ae-39fe-4f06-9e9a-7468dc7482e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:31.287260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2838ae-39fe-4f06-9e9a-7468dc7482e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:31.289579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:31.289814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2838ae-39fe-4f06-9e9a-7468dc7482e7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-0e2838ae-39fe-4f06-9e9a-7468dc7482e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:41:31.301735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:31.302836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:31.303988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:41:31.303988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:41:31.303988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:41:31.303988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:41:31.303988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:41:31.303988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:41:31.303988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:31.303988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:31.304925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 528/1068] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:31.310582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2838ae-39fe-4f06-9e9a-7468dc7482e7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:31.317267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053e9d7-a1cf-44cb-8171-7b3d4d8ba82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:31.318045 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053e9d7-a1cf-44cb-8171-7b3d4d8ba82d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:31.318330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053e9d7-a1cf-44cb-8171-7b3d4d8ba82d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:31.318614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053e9d7-a1cf-44cb-8171-7b3d4d8ba82d None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:31.319303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053e9d7-a1cf-44cb-8171-7b3d4d8ba82d None admin] RBAC: Adding query filter params (type=image) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:31.319610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053e9d7-a1cf-44cb-8171-7b3d4d8ba82d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:31.321006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053e9d7-a1cf-44cb-8171-7b3d4d8ba82d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:31.326154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 541/1069] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:31.331505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053e9d7-a1cf-44cb-8171-7b3d4d8ba82d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:31.423421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2838ae-39fe-4f06-9e9a-7468dc7482e7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:31.443729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053e9d7-a1cf-44cb-8171-7b3d4d8ba82d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:31.460505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a3b04-a1dd-4710-a3b4-f249e90b1216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:31.461130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3b04-a1dd-4710-a3b4-f249e90b1216 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:31.461415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3b04-a1dd-4710-a3b4-f249e90b1216 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:31.461695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3b04-a1dd-4710-a3b4-f249e90b1216 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:31.462443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a3b04-a1dd-4710-a3b4-f249e90b1216 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:31.462761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a3b04-a1dd-4710-a3b4-f249e90b1216 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:31.464208 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a3b04-a1dd-4710-a3b4-f249e90b1216 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:31.476813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 529/1070] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:41:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:31.482697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a3b04-a1dd-4710-a3b4-f249e90b1216 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:31.482855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a0b5b-a66c-4733-803c-c7603239c5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:31.483464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a0b5b-a66c-4733-803c-c7603239c5a7 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:31.483754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a0b5b-a66c-4733-803c-c7603239c5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:31.484036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a0b5b-a66c-4733-803c-c7603239c5a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:31.484786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a0b5b-a66c-4733-803c-c7603239c5a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:31.486161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a0b5b-a66c-4733-803c-c7603239c5a7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:31.486753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:31.507450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 542/1071] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:41:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:41:31.642118 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a3b04-a1dd-4710-a3b4-f249e90b1216 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:31.684763 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b903f9-bac8-49c6-9ee7-24da055860a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:31.685442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b903f9-bac8-49c6-9ee7-24da055860a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:31.685724 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b903f9-bac8-49c6-9ee7-24da055860a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:31.686003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b903f9-bac8-49c6-9ee7-24da055860a6 None admin] PATH_INFO: `/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/e1de289ba7ae4140a421127b8f18901f/roles/3812c2fc466047f29e976571d85ca6d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:31.688237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b903f9-bac8-49c6-9ee7-24da055860a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e1649f32d3d494682dc06e05ae34f3d, user_id=e1de289ba7ae4140a421127b8f18901f, role_id=3812c2fc466047f29e976571d85ca6d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:31.689667 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b903f9-bac8-49c6-9ee7-24da055860a6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:31.704885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 530/1072] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:41:31 2022] PUT /identity/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/e1de289ba7ae4140a421127b8f18901f/roles/3812c2fc466047f29e976571d85ca6d8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:41:33.107691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c822d-da35-4ff4-ac7b-e263e3f1804f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:33.108394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c822d-da35-4ff4-ac7b-e263e3f1804f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:33.108394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c822d-da35-4ff4-ac7b-e263e3f1804f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:33.109699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 543/1073] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:33.114880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a34d7-d262-40be-937a-b8616dc6fe54 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:33.115326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a34d7-d262-40be-937a-b8616dc6fe54 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:33.115504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a34d7-d262-40be-937a-b8616dc6fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:33.135198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-084a34d7-d262-40be-937a-b8616dc6fe54 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:33.136420 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-084a34d7-d262-40be-937a-b8616dc6fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:33.193538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:33.211773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 531/1074] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:33.233493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c822d-da35-4ff4-ac7b-e263e3f1804f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:33.265373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:33.340001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c822d-da35-4ff4-ac7b-e263e3f1804f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:33.373790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab281ec8-8fcc-43e7-8ad4-4d3a3e76306f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:33.374356 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab281ec8-8fcc-43e7-8ad4-4d3a3e76306f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:33.374645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab281ec8-8fcc-43e7-8ad4-4d3a3e76306f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:33.374924 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab281ec8-8fcc-43e7-8ad4-4d3a3e76306f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:33.386158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab281ec8-8fcc-43e7-8ad4-4d3a3e76306f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ab281ec8-8fcc-43e7-8ad4-4d3a3e76306f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:33.391110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:33.392059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:33.392980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:33.392980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:33.392980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:33.392980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:33.392980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:33.392980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:33.392980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:33.392980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:33.392980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:33.392980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:33.392980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:41:33.392980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:33.396447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 544/1075] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:41:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:33.398456 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a34d7-d262-40be-937a-b8616dc6fe54 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:33.501093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a34d7-d262-40be-937a-b8616dc6fe54 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:33.535465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55be45f-8919-4275-a74b-dd3495034677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:33.536086 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55be45f-8919-4275-a74b-dd3495034677 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:33.536400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55be45f-8919-4275-a74b-dd3495034677 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:33.536678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55be45f-8919-4275-a74b-dd3495034677 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:33.537441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55be45f-8919-4275-a74b-dd3495034677 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:33.537752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55be45f-8919-4275-a74b-dd3495034677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:33.539152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55be45f-8919-4275-a74b-dd3495034677 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:33.552100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 532/1076] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:41:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:33.554365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab281ec8-8fcc-43e7-8ad4-4d3a3e76306f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:33.603404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76062c-3de5-4371-b427-986614a6676e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:33.603744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76062c-3de5-4371-b427-986614a6676e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:33.603971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76062c-3de5-4371-b427-986614a6676e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:33.605600 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 533/1077] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:41:33.610474 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ffe93-7000-4828-a8e6-42f98a9eaa5e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:33.610854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ffe93-7000-4828-a8e6-42f98a9eaa5e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:33.611139 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ffe93-7000-4828-a8e6-42f98a9eaa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:33.629925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-084ffe93-7000-4828-a8e6-42f98a9eaa5e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:33.631034 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-084ffe93-7000-4828-a8e6-42f98a9eaa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:33.655116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:33.666590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab281ec8-8fcc-43e7-8ad4-4d3a3e76306f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:33.683310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:33.706597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555b076-9fa8-425d-a450-a83616a326f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:33.707253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555b076-9fa8-425d-a450-a83616a326f6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:33.707538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555b076-9fa8-425d-a450-a83616a326f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:33.707819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555b076-9fa8-425d-a450-a83616a326f6 None admin] PATH_INFO: `/v3/users/b15c53ec1a46434284223dd5dce73199` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:33.712455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 534/1078] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:33.713091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555b076-9fa8-425d-a450-a83616a326f6 None admin] RBAC: Authorizing `identity:get_user(user_id=b15c53ec1a46434284223dd5dce73199)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:33.714456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555b076-9fa8-425d-a450-a83616a326f6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:33.720916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 545/1079] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:41:33 2022] GET /identity/v3/users/b15c53ec1a46434284223dd5dce73199 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:33.722989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ffe93-7000-4828-a8e6-42f98a9eaa5e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:33.726643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7637-d9a2-45fb-a6ba-ff0bdd7f6860 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:33.726931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7637-d9a2-45fb-a6ba-ff0bdd7f6860 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:33.727211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7637-d9a2-45fb-a6ba-ff0bdd7f6860 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:33.729736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 546/1080] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:33.730454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d7637-d9a2-45fb-a6ba-ff0bdd7f6860 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:33.832462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ffe93-7000-4828-a8e6-42f98a9eaa5e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:33.833858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d7637-d9a2-45fb-a6ba-ff0bdd7f6860 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:33.868600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad76ed0-2f18-431d-89c5-100f06e997da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:33.868991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2cea2-1f5e-4804-a410-a7461bd9c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:33.869224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad76ed0-2f18-431d-89c5-100f06e997da None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:33.869561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad76ed0-2f18-431d-89c5-100f06e997da None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:33.869679 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2cea2-1f5e-4804-a410-a7461bd9c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:33.869854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad76ed0-2f18-431d-89c5-100f06e997da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:33.869956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2cea2-1f5e-4804-a410-a7461bd9c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:33.870160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2cea2-1f5e-4804-a410-a7461bd9c5e4 None admin] PATH_INFO: `/v3/projects/583f5b2131f942779222b3d41255e104` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:33.871321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2cea2-1f5e-4804-a410-a7461bd9c5e4 None admin] RBAC: Authorizing `identity:get_project(project_id=583f5b2131f942779222b3d41255e104)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:33.872778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2cea2-1f5e-4804-a410-a7461bd9c5e4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:33.874464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 535/1081] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:41:33 2022] GET /identity/v3/projects/583f5b2131f942779222b3d41255e104 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:33.875597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57707a41-debb-4e80-b8f9-5405192b589e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:33.875880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57707a41-debb-4e80-b8f9-5405192b589e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:33.876175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57707a41-debb-4e80-b8f9-5405192b589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:33.893793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-57707a41-debb-4e80-b8f9-5405192b589e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:33.894899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-57707a41-debb-4e80-b8f9-5405192b589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:33.900528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:33.939560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:33.943020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad76ed0-2f18-431d-89c5-100f06e997da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:33.944552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad76ed0-2f18-431d-89c5-100f06e997da None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:33.963891 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 536/1082] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:33.964735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57707a41-debb-4e80-b8f9-5405192b589e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:34.049413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 547/1083] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:41:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:41:34.050270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad76ed0-2f18-431d-89c5-100f06e997da None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:34.067372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57707a41-debb-4e80-b8f9-5405192b589e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:34.102998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefda7a-1a4b-48d8-a163-480b09f0e538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:34.103662 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefda7a-1a4b-48d8-a163-480b09f0e538 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:34.103939 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefda7a-1a4b-48d8-a163-480b09f0e538 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:34.104261 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefda7a-1a4b-48d8-a163-480b09f0e538 None admin] PATH_INFO: `/v3/projects/583f5b2131f942779222b3d41255e104/users/b15c53ec1a46434284223dd5dce73199/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:34.106244 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefda7a-1a4b-48d8-a163-480b09f0e538 None admin] RBAC: Authorizing `identity:create_grant(project_id=583f5b2131f942779222b3d41255e104, user_id=b15c53ec1a46434284223dd5dce73199, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:34.107786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefda7a-1a4b-48d8-a163-480b09f0e538 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:34.108933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:34.124033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 537/1084] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:41:33 2022] PUT /identity/v3/projects/583f5b2131f942779222b3d41255e104/users/b15c53ec1a46434284223dd5dce73199/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:41:34.124874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefda7a-1a4b-48d8-a163-480b09f0e538 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:34.159545 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad76ed0-2f18-431d-89c5-100f06e997da None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:34.172339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:34.203663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f8b5d-2402-4edd-8e62-eaef23939b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:34.204481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f8b5d-2402-4edd-8e62-eaef23939b7d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:34.204762 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f8b5d-2402-4edd-8e62-eaef23939b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:34.205037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f8b5d-2402-4edd-8e62-eaef23939b7d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:34.217715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f8b5d-2402-4edd-8e62-eaef23939b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-3c9f8b5d-2402-4edd-8e62-eaef23939b7d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:34.222767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:34.223744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:34.224807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 548/1085] 10.222.0.17 () {56 vars in 1120 bytes} [Tue Aug 2 08:41:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:34.230931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f8b5d-2402-4edd-8e62-eaef23939b7d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:34.249655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefda7a-1a4b-48d8-a163-480b09f0e538 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:34.297288 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40517d-c87a-43f2-9cd7-a1bb9050eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:34.297947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40517d-c87a-43f2-9cd7-a1bb9050eef6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:34.298236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40517d-c87a-43f2-9cd7-a1bb9050eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:34.298519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40517d-c87a-43f2-9cd7-a1bb9050eef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:34.309816 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40517d-c87a-43f2-9cd7-a1bb9050eef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:34.311272 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40517d-c87a-43f2-9cd7-a1bb9050eef6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-1b40517d-c87a-43f2-9cd7-a1bb9050eef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:34.327806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:34.328924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:34.329855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:34.329855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:34.329855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:34.329855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:34.329855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 538/1086] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:34.335781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40517d-c87a-43f2-9cd7-a1bb9050eef6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:34.348886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f8b5d-2402-4edd-8e62-eaef23939b7d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:34.370594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:34.388027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5e859-6d0e-427b-bae3-536110942897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:34.389002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5e859-6d0e-427b-bae3-536110942897 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:34.389298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5e859-6d0e-427b-bae3-536110942897 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:34.389585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5e859-6d0e-427b-bae3-536110942897 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:34.390307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5e859-6d0e-427b-bae3-536110942897 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:34.390624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5e859-6d0e-427b-bae3-536110942897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:34.392005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5e859-6d0e-427b-bae3-536110942897 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:34.405843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 549/1087] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Aug 2 08:41:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:34.411519 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5e859-6d0e-427b-bae3-536110942897 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:34.445594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:34.456211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40517d-c87a-43f2-9cd7-a1bb9050eef6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:34.491451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ab51a-cc08-43df-a953-d413936112c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:34.492443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ab51a-cc08-43df-a953-d413936112c3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:34.492880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ab51a-cc08-43df-a953-d413936112c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:34.493298 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ab51a-cc08-43df-a953-d413936112c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:34.494145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ab51a-cc08-43df-a953-d413936112c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:34.494623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ab51a-cc08-43df-a953-d413936112c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:34.496315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ab51a-cc08-43df-a953-d413936112c3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:34.510927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 539/1088] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:34.531006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5e859-6d0e-427b-bae3-536110942897 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:34.570113 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e4d15-aa24-4ad2-a0f5-f33ceb61be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:34.570775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4d15-aa24-4ad2-a0f5-f33ceb61be14 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:34.571056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4d15-aa24-4ad2-a0f5-f33ceb61be14 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:34.571333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4d15-aa24-4ad2-a0f5-f33ceb61be14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:34.586062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e4d15-aa24-4ad2-a0f5-f33ceb61be14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:34.586379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e4d15-aa24-4ad2-a0f5-f33ceb61be14 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1e1e4d15-aa24-4ad2-a0f5-f33ceb61be14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:34.603202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:34.604524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:34.605444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:34.605444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:34.605444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:34.605444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:34.608566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 550/1089] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:34.611268 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ab51a-cc08-43df-a953-d413936112c3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:34.744611 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ab51a-cc08-43df-a953-d413936112c3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:34.781635 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537badd8-cf3e-4554-a41f-a9963e85ee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:34.782409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537badd8-cf3e-4554-a41f-a9963e85ee0f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:34.782804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537badd8-cf3e-4554-a41f-a9963e85ee0f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:34.783181 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537badd8-cf3e-4554-a41f-a9963e85ee0f None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:34.783886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537badd8-cf3e-4554-a41f-a9963e85ee0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:34.784223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537badd8-cf3e-4554-a41f-a9963e85ee0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:34.785602 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537badd8-cf3e-4554-a41f-a9963e85ee0f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:34.797591 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 540/1090] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:41:34.804924 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e4d15-aa24-4ad2-a0f5-f33ceb61be14 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:34.843050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:34.908886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e4d15-aa24-4ad2-a0f5-f33ceb61be14 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:34.941782 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27a489-4a8f-4557-87d9-0b5f11d6f55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:34.942418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27a489-4a8f-4557-87d9-0b5f11d6f55b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:34.942702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27a489-4a8f-4557-87d9-0b5f11d6f55b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:34.942976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27a489-4a8f-4557-87d9-0b5f11d6f55b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:34.951028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27a489-4a8f-4557-87d9-0b5f11d6f55b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:34.952532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27a489-4a8f-4557-87d9-0b5f11d6f55b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ff27a489-4a8f-4557-87d9-0b5f11d6f55b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:41:34.964150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:34.965240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:34.966208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:34.966208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:34.966208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:41:34.966208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:41:34.966208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:41:34.966208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:41:34.966208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:41:34.966208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:41:34.966208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:41:34.966208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:34.966208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 551/1091] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Aug 2 08:41:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:34.971517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537badd8-cf3e-4554-a41f-a9963e85ee0f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:34.984545 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:35.075300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537badd8-cf3e-4554-a41f-a9963e85ee0f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:35.110161 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74543b-a3db-45af-833c-f11e05c0af1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:35.110776 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74543b-a3db-45af-833c-f11e05c0af1c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:35.111058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74543b-a3db-45af-833c-f11e05c0af1c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:35.111332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74543b-a3db-45af-833c-f11e05c0af1c None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:35.112128 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74543b-a3db-45af-833c-f11e05c0af1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:35.112452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74543b-a3db-45af-833c-f11e05c0af1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:35.113870 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74543b-a3db-45af-833c-f11e05c0af1c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:35.130877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 541/1092] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Aug 2 08:41:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:35.137141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27a489-4a8f-4557-87d9-0b5f11d6f55b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:35.230684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:35.238275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27a489-4a8f-4557-87d9-0b5f11d6f55b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:35.273591 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a57ac7-b844-4129-a792-72111c4a7d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:35.274199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a57ac7-b844-4129-a792-72111c4a7d77 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:35.274478 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a57ac7-b844-4129-a792-72111c4a7d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:35.274751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a57ac7-b844-4129-a792-72111c4a7d77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:35.353236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a57ac7-b844-4129-a792-72111c4a7d77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:35.354664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a57ac7-b844-4129-a792-72111c4a7d77 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:35.443159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:35.451751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 552/1093] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:41:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:41:35.457482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74543b-a3db-45af-833c-f11e05c0af1c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:35.524622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:35.557220 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74543b-a3db-45af-833c-f11e05c0af1c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:35.591354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f5c57-724e-46e8-bcf8-6cccf21b0b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:35.591991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5c57-724e-46e8-bcf8-6cccf21b0b9f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:35.592352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5c57-724e-46e8-bcf8-6cccf21b0b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:35.592574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5c57-724e-46e8-bcf8-6cccf21b0b9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:35.602417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f5c57-724e-46e8-bcf8-6cccf21b0b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:35.603916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f5c57-724e-46e8-bcf8-6cccf21b0b9f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d27f5c57-724e-46e8-bcf8-6cccf21b0b9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:41:35.622344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:35.623454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:35.624620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:41:35.624620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:41:35.624620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:41:35.624620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:35.624620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 542/1094] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:35.630844 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a57ac7-b844-4129-a792-72111c4a7d77 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:35.748509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a57ac7-b844-4129-a792-72111c4a7d77 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:35.782407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f063d89-d539-455d-b31b-8400a293c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:35.783024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f063d89-d539-455d-b31b-8400a293c330 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:35.783310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f063d89-d539-455d-b31b-8400a293c330 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:35.783591 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f063d89-d539-455d-b31b-8400a293c330 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:35.784315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f063d89-d539-455d-b31b-8400a293c330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:35.784629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f063d89-d539-455d-b31b-8400a293c330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:35.786002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f063d89-d539-455d-b31b-8400a293c330 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:35.797248 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 553/1095] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:35.803256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f5c57-724e-46e8-bcf8-6cccf21b0b9f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:35.904154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f5c57-724e-46e8-bcf8-6cccf21b0b9f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:35.923895 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:35.938631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e13a0-f0d7-401e-ab53-bbb8229b547f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:35.939271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e13a0-f0d7-401e-ab53-bbb8229b547f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:35.939557 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e13a0-f0d7-401e-ab53-bbb8229b547f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:35.939831 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e13a0-f0d7-401e-ab53-bbb8229b547f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:35.947500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e13a0-f0d7-401e-ab53-bbb8229b547f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:35.948976 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e13a0-f0d7-401e-ab53-bbb8229b547f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d51e13a0-f0d7-401e-ab53-bbb8229b547f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:41:35.961357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:35.962346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:35.963251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:41:35.963251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:41:35.963251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:41:35.963251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:41:35.963251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:41:35.963251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:41:35.963251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:41:35.963251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:41:35.964407 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 543/1096] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:41:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:35.968456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f063d89-d539-455d-b31b-8400a293c330 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:36.034288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:36.080084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f063d89-d539-455d-b31b-8400a293c330 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:36.114307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1955e-fdfa-4d05-9e79-6be9aae122f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:36.114929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1955e-fdfa-4d05-9e79-6be9aae122f4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:36.115212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1955e-fdfa-4d05-9e79-6be9aae122f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:36.115489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1955e-fdfa-4d05-9e79-6be9aae122f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:36.116306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1955e-fdfa-4d05-9e79-6be9aae122f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:36.116613 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1955e-fdfa-4d05-9e79-6be9aae122f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:36.118126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1955e-fdfa-4d05-9e79-6be9aae122f4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:36.130140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 554/1097] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:41:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:36.136757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e13a0-f0d7-401e-ab53-bbb8229b547f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:36.163133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24af99-8cbb-4fe8-ae6b-8b920add7f93 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:36.163595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24af99-8cbb-4fe8-ae6b-8b920add7f93 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:36.163595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24af99-8cbb-4fe8-ae6b-8b920add7f93 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:36.164960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 555/1098] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:41:36.169973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eeda7-312b-4684-9ef1-c46ede1485f9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:36.170561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eeda7-312b-4684-9ef1-c46ede1485f9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:36.170849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eeda7-312b-4684-9ef1-c46ede1485f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:36.188211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-595eeda7-312b-4684-9ef1-c46ede1485f9 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:36.189391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-595eeda7-312b-4684-9ef1-c46ede1485f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:36.239873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e13a0-f0d7-401e-ab53-bbb8229b547f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:36.258269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 556/1099] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:41:36.273519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085eb944-6f2d-4ad2-bd6d-ac24f6f29a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:36.274131 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085eb944-6f2d-4ad2-bd6d-ac24f6f29a89 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:36.274417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085eb944-6f2d-4ad2-bd6d-ac24f6f29a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:36.274694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085eb944-6f2d-4ad2-bd6d-ac24f6f29a89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:36.275479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085eb944-6f2d-4ad2-bd6d-ac24f6f29a89 None admin] RBAC: Adding query filter params (role.id=3812c2fc466047f29e976571d85ca6d8, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=e1de289ba7ae4140a421127b8f18901f) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:36.275792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085eb944-6f2d-4ad2-bd6d-ac24f6f29a89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:36.277247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085eb944-6f2d-4ad2-bd6d-ac24f6f29a89 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:36.281876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eeda7-312b-4684-9ef1-c46ede1485f9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:36.292626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 544/1100] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:41:36 2022] GET /identity/v3/role_assignments?user.id=e1de289ba7ae4140a421127b8f18901f&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=3812c2fc466047f29e976571d85ca6d8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:36.331617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:36.391111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eeda7-312b-4684-9ef1-c46ede1485f9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:36.426533 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aebc2-8baa-4ce8-a81c-2d65098eae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:36.427095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aebc2-8baa-4ce8-a81c-2d65098eae8e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:36.427380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aebc2-8baa-4ce8-a81c-2d65098eae8e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:36.427657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aebc2-8baa-4ce8-a81c-2d65098eae8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:36.441693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327aebc2-8baa-4ce8-a81c-2d65098eae8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-327aebc2-8baa-4ce8-a81c-2d65098eae8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:36.447483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:36.448506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:36.449544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 557/1101] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:41:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:41:36.454761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085eb944-6f2d-4ad2-bd6d-ac24f6f29a89 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:36.504687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:36.563043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085eb944-6f2d-4ad2-bd6d-ac24f6f29a89 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:36.598387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49627415-c122-4491-a178-ae97d965d51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:36.599004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627415-c122-4491-a178-ae97d965d51d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:36.599337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627415-c122-4491-a178-ae97d965d51d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:36.599598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627415-c122-4491-a178-ae97d965d51d None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:36.600349 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49627415-c122-4491-a178-ae97d965d51d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:36.600659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49627415-c122-4491-a178-ae97d965d51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:36.602023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49627415-c122-4491-a178-ae97d965d51d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:36.610867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 545/1102] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:41:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:36.617204 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aebc2-8baa-4ce8-a81c-2d65098eae8e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:36.724785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aebc2-8baa-4ce8-a81c-2d65098eae8e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:36.727661 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:36.760486 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c646ef7-97bb-4343-8f77-61fc7b43033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:36.761134 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c646ef7-97bb-4343-8f77-61fc7b43033e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:36.761418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c646ef7-97bb-4343-8f77-61fc7b43033e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:36.761699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c646ef7-97bb-4343-8f77-61fc7b43033e None admin] PATH_INFO: `/v3/users/b15c53ec1a46434284223dd5dce73199` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:36.762941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c646ef7-97bb-4343-8f77-61fc7b43033e None admin] RBAC: Authorizing `identity:get_user(user_id=b15c53ec1a46434284223dd5dce73199)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:36.764433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c646ef7-97bb-4343-8f77-61fc7b43033e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:36.766056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 558/1103] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:41:36 2022] GET /identity/v3/users/b15c53ec1a46434284223dd5dce73199 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:36.771899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49627415-c122-4491-a178-ae97d965d51d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:36.879175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49627415-c122-4491-a178-ae97d965d51d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:36.886794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:36.915443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ca5f2-4e18-4baa-8cf0-605f98df6e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:36.916062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ca5f2-4e18-4baa-8cf0-605f98df6e34 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:36.916379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ca5f2-4e18-4baa-8cf0-605f98df6e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:36.916659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ca5f2-4e18-4baa-8cf0-605f98df6e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:37.001169 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ca5f2-4e18-4baa-8cf0-605f98df6e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:37.002559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ca5f2-4e18-4baa-8cf0-605f98df6e34 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:37.117909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 546/1104] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:41:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:41:37.123694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c646ef7-97bb-4343-8f77-61fc7b43033e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:37.244304 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c646ef7-97bb-4343-8f77-61fc7b43033e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:37.277930 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d710919-7f97-492e-87a8-335c6a169a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:37.278497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d710919-7f97-492e-87a8-335c6a169a0a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:37.278783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d710919-7f97-492e-87a8-335c6a169a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:37.279062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d710919-7f97-492e-87a8-335c6a169a0a None admin] PATH_INFO: `/v3/projects/583f5b2131f942779222b3d41255e104` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:37.280235 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d710919-7f97-492e-87a8-335c6a169a0a None admin] RBAC: Authorizing `identity:get_project(project_id=583f5b2131f942779222b3d41255e104)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:37.281678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d710919-7f97-492e-87a8-335c6a169a0a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:37.283337 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 559/1105] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:41:37 2022] GET /identity/v3/projects/583f5b2131f942779222b3d41255e104 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:37.290063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ca5f2-4e18-4baa-8cf0-605f98df6e34 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:37.298068 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:37.390729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ca5f2-4e18-4baa-8cf0-605f98df6e34 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:37.423694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d07c38-5122-4a13-9314-441e5a8780c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:37.424322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d07c38-5122-4a13-9314-441e5a8780c7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:37.424607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d07c38-5122-4a13-9314-441e5a8780c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:37.424878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d07c38-5122-4a13-9314-441e5a8780c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:37.425661 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d07c38-5122-4a13-9314-441e5a8780c7 None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=583f5b2131f942779222b3d41255e104, user.id=b15c53ec1a46434284223dd5dce73199) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:37.425970 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d07c38-5122-4a13-9314-441e5a8780c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:37.427392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d07c38-5122-4a13-9314-441e5a8780c7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:37.433014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 547/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:41:37 2022] GET /identity/v3/role_assignments?user.id=b15c53ec1a46434284223dd5dce73199&scope.project.id=583f5b2131f942779222b3d41255e104&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:39.434786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f907836-0796-4b9d-b6f5-8be739eb0ecf None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:39.435336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f907836-0796-4b9d-b6f5-8be739eb0ecf None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:39.435336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f907836-0796-4b9d-b6f5-8be739eb0ecf None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:39.437194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 560/1107] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:39.442278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b4159-3c79-4ea0-bd3e-1d0b7541064b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:39.442708 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b4159-3c79-4ea0-bd3e-1d0b7541064b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:39.442834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b4159-3c79-4ea0-bd3e-1d0b7541064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:39.461284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2d0b4159-3c79-4ea0-bd3e-1d0b7541064b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:39.462471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2d0b4159-3c79-4ea0-bd3e-1d0b7541064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:39.523072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:39.528090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 548/1108] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:39.552672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f907836-0796-4b9d-b6f5-8be739eb0ecf None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:39.595270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:39.653296 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f907836-0796-4b9d-b6f5-8be739eb0ecf None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:39.685203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10fc9e-f7d3-4f8a-b4d1-ea0908cf951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:39.685764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10fc9e-f7d3-4f8a-b4d1-ea0908cf951f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:39.686043 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10fc9e-f7d3-4f8a-b4d1-ea0908cf951f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:39.686315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10fc9e-f7d3-4f8a-b4d1-ea0908cf951f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:39.687438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10fc9e-f7d3-4f8a-b4d1-ea0908cf951f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:39.688883 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10fc9e-f7d3-4f8a-b4d1-ea0908cf951f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:39.690468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 561/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:39.696668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b4159-3c79-4ea0-bd3e-1d0b7541064b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:39.791744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b4159-3c79-4ea0-bd3e-1d0b7541064b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:39.825271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23f709-49cc-4d29-8cac-e80e71854cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:39.825896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23f709-49cc-4d29-8cac-e80e71854cf6 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:39.826180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23f709-49cc-4d29-8cac-e80e71854cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:39.826456 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23f709-49cc-4d29-8cac-e80e71854cf6 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:39.827142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23f709-49cc-4d29-8cac-e80e71854cf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:39.828607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23f709-49cc-4d29-8cac-e80e71854cf6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:39.850172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 549/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:41:39 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:41:41.882113 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6b215-6526-4ecd-9e5f-6f338e3bfe56 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:41.882695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6b215-6526-4ecd-9e5f-6f338e3bfe56 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:41.882695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6b215-6526-4ecd-9e5f-6f338e3bfe56 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:41.884001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 562/1111] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:41.889214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f9762-49bd-4b80-b4f0-093db3d59b9e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:41.889637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f9762-49bd-4b80-b4f0-093db3d59b9e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:41.889778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f9762-49bd-4b80-b4f0-093db3d59b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:41.908023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f18f9762-49bd-4b80-b4f0-093db3d59b9e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:41.909322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f18f9762-49bd-4b80-b4f0-093db3d59b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:41.957785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:41.976324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 550/1112] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:41.998877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6b215-6526-4ecd-9e5f-6f338e3bfe56 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:42.098587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6b215-6526-4ecd-9e5f-6f338e3bfe56 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:42.107474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:42.131435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a0ce8-db5c-4dd5-aa33-cc9b962907e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:42.132614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0ce8-db5c-4dd5-aa33-cc9b962907e5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:42.132898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0ce8-db5c-4dd5-aa33-cc9b962907e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:42.133173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0ce8-db5c-4dd5-aa33-cc9b962907e5 None admin] PATH_INFO: `/v3/roles/da75e75c3ada4bf1b93ec17d36ff9a0d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:42.134596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a0ce8-db5c-4dd5-aa33-cc9b962907e5 None admin] RBAC: Authorizing `identity:get_role(role_id=da75e75c3ada4bf1b93ec17d36ff9a0d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:42.135964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a0ce8-db5c-4dd5-aa33-cc9b962907e5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:42.137324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 563/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:41:41 2022] GET /identity/v3/roles/da75e75c3ada4bf1b93ec17d36ff9a0d => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:42.143105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f9762-49bd-4b80-b4f0-093db3d59b9e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:42.240083 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f9762-49bd-4b80-b4f0-093db3d59b9e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:42.274368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01e645-7b08-46d1-a19c-54babc55a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:42.275001 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01e645-7b08-46d1-a19c-54babc55a57d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:42.275832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01e645-7b08-46d1-a19c-54babc55a57d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:42.276142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01e645-7b08-46d1-a19c-54babc55a57d None admin] PATH_INFO: `/v3/users/1b1f6312c9214d68aae141d331f50b9e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:42.289542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01e645-7b08-46d1-a19c-54babc55a57d None admin] RBAC: Authorizing `identity:get_user(user_id=1b1f6312c9214d68aae141d331f50b9e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:42.290999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01e645-7b08-46d1-a19c-54babc55a57d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:42.292652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 551/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:41:42 2022] GET /identity/v3/users/1b1f6312c9214d68aae141d331f50b9e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:42.298342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a0ce8-db5c-4dd5-aa33-cc9b962907e5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:42.396810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a0ce8-db5c-4dd5-aa33-cc9b962907e5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:42.429883 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165262c-f6b3-4f91-bd11-aabe4971dcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:42.430492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165262c-f6b3-4f91-bd11-aabe4971dcda None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:42.430774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165262c-f6b3-4f91-bd11-aabe4971dcda None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:42.431050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165262c-f6b3-4f91-bd11-aabe4971dcda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:42.473760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:42.500975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165262c-f6b3-4f91-bd11-aabe4971dcda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:42.502423 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165262c-f6b3-4f91-bd11-aabe4971dcda None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:42.597884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 564/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:41:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:41:42.604356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01e645-7b08-46d1-a19c-54babc55a57d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:42.649324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:42.701747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01e645-7b08-46d1-a19c-54babc55a57d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:42.735577 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187937c5-e2a8-4220-9618-ecc626c18e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:42.736231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187937c5-e2a8-4220-9618-ecc626c18e21 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:42.736517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187937c5-e2a8-4220-9618-ecc626c18e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:42.736792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187937c5-e2a8-4220-9618-ecc626c18e21 None admin] PATH_INFO: `/v3/projects/583f5b2131f942779222b3d41255e104` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:42.737923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187937c5-e2a8-4220-9618-ecc626c18e21 None admin] RBAC: Authorizing `identity:get_project(project_id=583f5b2131f942779222b3d41255e104)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:42.739350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187937c5-e2a8-4220-9618-ecc626c18e21 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:42.741567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 552/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:41:42 2022] GET /identity/v3/projects/583f5b2131f942779222b3d41255e104 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:42.747588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165262c-f6b3-4f91-bd11-aabe4971dcda None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:42.827393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:42.850875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165262c-f6b3-4f91-bd11-aabe4971dcda None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:42.883779 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51a9b-b409-495f-8509-d7d30cc12824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:42.884422 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51a9b-b409-495f-8509-d7d30cc12824 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:42.884703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51a9b-b409-495f-8509-d7d30cc12824 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:42.884973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51a9b-b409-495f-8509-d7d30cc12824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:42.885747 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e51a9b-b409-495f-8509-d7d30cc12824 None admin] RBAC: Adding query filter params (role.id=da75e75c3ada4bf1b93ec17d36ff9a0d, scope.project.id=583f5b2131f942779222b3d41255e104, user.id=1b1f6312c9214d68aae141d331f50b9e) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:42.886061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e51a9b-b409-495f-8509-d7d30cc12824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:42.887473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e51a9b-b409-495f-8509-d7d30cc12824 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:42.892711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 565/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:41:42 2022] GET /identity/v3/role_assignments?user.id=1b1f6312c9214d68aae141d331f50b9e&scope.project.id=583f5b2131f942779222b3d41255e104&role.id=da75e75c3ada4bf1b93ec17d36ff9a0d => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:44.906575 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098324bd-18d4-48d2-8936-202c44ee2c84 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:44.907116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098324bd-18d4-48d2-8936-202c44ee2c84 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:44.907116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098324bd-18d4-48d2-8936-202c44ee2c84 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:44.908528 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 553/1118] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:44.913575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c8c08-ce67-4578-8f9a-2bfc46997d10 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:44.913998 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c8c08-ce67-4578-8f9a-2bfc46997d10 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:44.914130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c8c08-ce67-4578-8f9a-2bfc46997d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:44.931555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-636c8c08-ce67-4578-8f9a-2bfc46997d10 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:44.932749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-636c8c08-ce67-4578-8f9a-2bfc46997d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:44.997672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 566/1119] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:45.020034 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098324bd-18d4-48d2-8936-202c44ee2c84 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:45.118949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098324bd-18d4-48d2-8936-202c44ee2c84 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:45.132195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:45.153542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26725e51-1e27-483a-a014-f2d9ad66d993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:45.154172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26725e51-1e27-483a-a014-f2d9ad66d993 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:45.154454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26725e51-1e27-483a-a014-f2d9ad66d993 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:45.154729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26725e51-1e27-483a-a014-f2d9ad66d993 None admin] PATH_INFO: `/v3/roles/da75e75c3ada4bf1b93ec17d36ff9a0d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:45.156169 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26725e51-1e27-483a-a014-f2d9ad66d993 None admin] RBAC: Authorizing `identity:get_role(role_id=da75e75c3ada4bf1b93ec17d36ff9a0d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:45.157534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26725e51-1e27-483a-a014-f2d9ad66d993 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:45.158867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 554/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:41:45 2022] GET /identity/v3/roles/da75e75c3ada4bf1b93ec17d36ff9a0d => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:45.165255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c8c08-ce67-4578-8f9a-2bfc46997d10 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:45.235400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:45.264918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c8c08-ce67-4578-8f9a-2bfc46997d10 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:45.297706 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29524e-451a-482f-a89f-29d8280da1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:45.298332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29524e-451a-482f-a89f-29d8280da1ec None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:45.298611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29524e-451a-482f-a89f-29d8280da1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:45.298881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29524e-451a-482f-a89f-29d8280da1ec None admin] PATH_INFO: `/v3/users/1b1f6312c9214d68aae141d331f50b9e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:45.300015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29524e-451a-482f-a89f-29d8280da1ec None admin] RBAC: Authorizing `identity:get_user(user_id=1b1f6312c9214d68aae141d331f50b9e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:45.301463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29524e-451a-482f-a89f-29d8280da1ec None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:45.303040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 567/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:41:45 2022] GET /identity/v3/users/1b1f6312c9214d68aae141d331f50b9e => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:45.309684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26725e51-1e27-483a-a014-f2d9ad66d993 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:45.407769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26725e51-1e27-483a-a014-f2d9ad66d993 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:45.440976 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7558b5-ce5d-438d-b682-8696e4579764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:45.441607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7558b5-ce5d-438d-b682-8696e4579764 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:45.441889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7558b5-ce5d-438d-b682-8696e4579764 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:45.442165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7558b5-ce5d-438d-b682-8696e4579764 None admin] PATH_INFO: `/v3/projects/583f5b2131f942779222b3d41255e104` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:45.443777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7558b5-ce5d-438d-b682-8696e4579764 None admin] RBAC: Authorizing `identity:get_project(project_id=583f5b2131f942779222b3d41255e104)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:45.445838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7558b5-ce5d-438d-b682-8696e4579764 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:45.447487 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 555/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:41:45 2022] GET /identity/v3/projects/583f5b2131f942779222b3d41255e104 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:45.453591 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29524e-451a-482f-a89f-29d8280da1ec None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:45.549586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29524e-451a-482f-a89f-29d8280da1ec None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:45.582799 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33463a73-3dd4-4272-8fa1-6e410cb5e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:45.583724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33463a73-3dd4-4272-8fa1-6e410cb5e645 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:45.584008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33463a73-3dd4-4272-8fa1-6e410cb5e645 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:45.584317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33463a73-3dd4-4272-8fa1-6e410cb5e645 None admin] PATH_INFO: `/v3/projects/583f5b2131f942779222b3d41255e104/users/1b1f6312c9214d68aae141d331f50b9e/roles/da75e75c3ada4bf1b93ec17d36ff9a0d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:45.586531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33463a73-3dd4-4272-8fa1-6e410cb5e645 None admin] RBAC: Authorizing `identity:create_grant(project_id=583f5b2131f942779222b3d41255e104, user_id=1b1f6312c9214d68aae141d331f50b9e, role_id=da75e75c3ada4bf1b93ec17d36ff9a0d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:45.587961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33463a73-3dd4-4272-8fa1-6e410cb5e645 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:45.595653 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:45.601938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 568/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:41:45 2022] PUT /identity/v3/projects/583f5b2131f942779222b3d41255e104/users/1b1f6312c9214d68aae141d331f50b9e/roles/da75e75c3ada4bf1b93ec17d36ff9a0d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:41:47.551111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab8909-f333-4eaf-8366-570becd15056 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:47.551666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab8909-f333-4eaf-8366-570becd15056 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:47.551666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab8909-f333-4eaf-8366-570becd15056 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:47.553047 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 556/1124] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:47.558655 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c4d1-6e0d-433f-924d-35b25a79aa6e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:47.559055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c4d1-6e0d-433f-924d-35b25a79aa6e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:47.559218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c4d1-6e0d-433f-924d-35b25a79aa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:47.577370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2271c4d1-6e0d-433f-924d-35b25a79aa6e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:47.578607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2271c4d1-6e0d-433f-924d-35b25a79aa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:47.642610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 569/1125] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:47.665260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab8909-f333-4eaf-8366-570becd15056 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:47.715856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:47.784469 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab8909-f333-4eaf-8366-570becd15056 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:47.818252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ddc73-e7f1-4ce9-bbb2-38d38e940a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:47.818897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ddc73-e7f1-4ce9-bbb2-38d38e940a0d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:47.819785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ddc73-e7f1-4ce9-bbb2-38d38e940a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:47.820064 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ddc73-e7f1-4ce9-bbb2-38d38e940a0d None admin] PATH_INFO: `/v3/roles/da75e75c3ada4bf1b93ec17d36ff9a0d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:47.821596 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ddc73-e7f1-4ce9-bbb2-38d38e940a0d None admin] RBAC: Authorizing `identity:get_role(role_id=da75e75c3ada4bf1b93ec17d36ff9a0d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:47.822971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ddc73-e7f1-4ce9-bbb2-38d38e940a0d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:47.824355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 557/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:41:47 2022] GET /identity/v3/roles/da75e75c3ada4bf1b93ec17d36ff9a0d => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:47.830163 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c4d1-6e0d-433f-924d-35b25a79aa6e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:47.926749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c4d1-6e0d-433f-924d-35b25a79aa6e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:47.952657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:47.961084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af5eb6-6908-497e-b9e8-918ad34c1122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:47.961723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af5eb6-6908-497e-b9e8-918ad34c1122 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:47.962011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af5eb6-6908-497e-b9e8-918ad34c1122 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:47.962293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af5eb6-6908-497e-b9e8-918ad34c1122 None admin] PATH_INFO: `/v3/users/1b1f6312c9214d68aae141d331f50b9e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:47.963446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af5eb6-6908-497e-b9e8-918ad34c1122 None admin] RBAC: Authorizing `identity:get_user(user_id=1b1f6312c9214d68aae141d331f50b9e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:47.964915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af5eb6-6908-497e-b9e8-918ad34c1122 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:47.966504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 570/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:41:47 2022] GET /identity/v3/users/1b1f6312c9214d68aae141d331f50b9e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:47.972233 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ddc73-e7f1-4ce9-bbb2-38d38e940a0d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:48.072163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ddc73-e7f1-4ce9-bbb2-38d38e940a0d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:48.089075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:48.107605 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93279e7-de04-423e-8ffd-fd21774f27b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:48.108265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93279e7-de04-423e-8ffd-fd21774f27b5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:48.108554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93279e7-de04-423e-8ffd-fd21774f27b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:48.108833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93279e7-de04-423e-8ffd-fd21774f27b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:48.174957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93279e7-de04-423e-8ffd-fd21774f27b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:48.176428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93279e7-de04-423e-8ffd-fd21774f27b5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:48.271288 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 558/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:41:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:41:48.277778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af5eb6-6908-497e-b9e8-918ad34c1122 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:48.374833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af5eb6-6908-497e-b9e8-918ad34c1122 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:48.407600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc33385-c7de-435b-bc9b-9a2b930e2f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:48.408263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc33385-c7de-435b-bc9b-9a2b930e2f00 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:48.408548 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc33385-c7de-435b-bc9b-9a2b930e2f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:48.408826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc33385-c7de-435b-bc9b-9a2b930e2f00 None admin] PATH_INFO: `/v3/projects/583f5b2131f942779222b3d41255e104` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:48.409962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc33385-c7de-435b-bc9b-9a2b930e2f00 None admin] RBAC: Authorizing `identity:get_project(project_id=583f5b2131f942779222b3d41255e104)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:48.411395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc33385-c7de-435b-bc9b-9a2b930e2f00 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:48.413087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 571/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:41:48 2022] GET /identity/v3/projects/583f5b2131f942779222b3d41255e104 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:48.419188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93279e7-de04-423e-8ffd-fd21774f27b5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:48.436827 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:48.517482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93279e7-de04-423e-8ffd-fd21774f27b5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:48.551073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6368c-2684-459c-813d-f492696f6ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:48.551678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6368c-2684-459c-813d-f492696f6ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:48.552237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6368c-2684-459c-813d-f492696f6ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:48.552350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6368c-2684-459c-813d-f492696f6ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:48.553036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6368c-2684-459c-813d-f492696f6ee1 None admin] RBAC: Adding query filter params (role.id=da75e75c3ada4bf1b93ec17d36ff9a0d, scope.project.id=583f5b2131f942779222b3d41255e104, user.id=1b1f6312c9214d68aae141d331f50b9e) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:48.553992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6368c-2684-459c-813d-f492696f6ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:48.555419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6368c-2684-459c-813d-f492696f6ee1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:48.563252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 559/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:41:48 2022] GET /identity/v3/role_assignments?user.id=1b1f6312c9214d68aae141d331f50b9e&scope.project.id=583f5b2131f942779222b3d41255e104&role.id=da75e75c3ada4bf1b93ec17d36ff9a0d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:50.574058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8808a-31b1-4b7d-ad84-d66a087c05fb None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:50.574665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8808a-31b1-4b7d-ad84-d66a087c05fb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:50.574665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8808a-31b1-4b7d-ad84-d66a087c05fb None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:50.575974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 572/1131] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:50.581381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a65a7-2ca5-46f2-b7c2-dba74efe76d3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:50.581792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a65a7-2ca5-46f2-b7c2-dba74efe76d3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:50.581935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a65a7-2ca5-46f2-b7c2-dba74efe76d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:50.600009 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0b2a65a7-2ca5-46f2-b7c2-dba74efe76d3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:50.601202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0b2a65a7-2ca5-46f2-b7c2-dba74efe76d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:50.666382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 560/1132] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:50.689459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8808a-31b1-4b7d-ad84-d66a087c05fb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:50.752580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:50.796404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8808a-31b1-4b7d-ad84-d66a087c05fb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:50.833673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3043e22-86fc-4773-93b4-f1204f01bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:50.834237 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3043e22-86fc-4773-93b4-f1204f01bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:50.834543 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3043e22-86fc-4773-93b4-f1204f01bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:50.834817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3043e22-86fc-4773-93b4-f1204f01bbcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:50.835951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3043e22-86fc-4773-93b4-f1204f01bbcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:50.837422 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3043e22-86fc-4773-93b4-f1204f01bbcf None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:50.838996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 573/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:50.844969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a65a7-2ca5-46f2-b7c2-dba74efe76d3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:50.856470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:50.940654 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a65a7-2ca5-46f2-b7c2-dba74efe76d3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:50.972860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5b0e4-71f3-47ee-9a6b-32d958042e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:50.973461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5b0e4-71f3-47ee-9a6b-32d958042e4b None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:50.973755 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5b0e4-71f3-47ee-9a6b-32d958042e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:50.974008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5b0e4-71f3-47ee-9a6b-32d958042e4b None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:50.974668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5b0e4-71f3-47ee-9a6b-32d958042e4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:50.976622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5b0e4-71f3-47ee-9a6b-32d958042e4b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:51.004401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 561/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:41:50 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:41:53.054497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf31bd-c293-427a-a950-3f615b88f0e8 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:53.055013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf31bd-c293-427a-a950-3f615b88f0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:53.055013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf31bd-c293-427a-a950-3f615b88f0e8 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:53.056321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 574/1135] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:53.062283 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1319b6-b2e6-4568-96d8-980c13f11342 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:53.062723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1319b6-b2e6-4568-96d8-980c13f11342 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:53.062816 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1319b6-b2e6-4568-96d8-980c13f11342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:53.080681 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8f1319b6-b2e6-4568-96d8-980c13f11342 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:53.081896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8f1319b6-b2e6-4568-96d8-980c13f11342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:53.137674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:53.149533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 562/1136] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:53.173311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf31bd-c293-427a-a950-3f615b88f0e8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:53.272783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf31bd-c293-427a-a950-3f615b88f0e8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:53.300879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:53.306385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c955f5-6784-40d7-924f-0f094bbdcc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:53.306953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c955f5-6784-40d7-924f-0f094bbdcc93 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:53.307235 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c955f5-6784-40d7-924f-0f094bbdcc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:53.307509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c955f5-6784-40d7-924f-0f094bbdcc93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:53.308666 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c955f5-6784-40d7-924f-0f094bbdcc93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:53.310089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c955f5-6784-40d7-924f-0f094bbdcc93 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:53.311661 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 575/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:41:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:53.317447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1319b6-b2e6-4568-96d8-980c13f11342 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:53.417255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1319b6-b2e6-4568-96d8-980c13f11342 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:53.450775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443a8be-15ac-4fa0-8eac-aab73bf018ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:53.451413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443a8be-15ac-4fa0-8eac-aab73bf018ac None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:53.451723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443a8be-15ac-4fa0-8eac-aab73bf018ac None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:53.452000 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443a8be-15ac-4fa0-8eac-aab73bf018ac None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:53.452716 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443a8be-15ac-4fa0-8eac-aab73bf018ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:53.454140 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443a8be-15ac-4fa0-8eac-aab73bf018ac None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:53.475172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 563/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:41:53 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:41:55.512809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528a8a4-c7f8-444b-8cd0-faede2a8ce62 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:55.513373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528a8a4-c7f8-444b-8cd0-faede2a8ce62 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:55.513373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528a8a4-c7f8-444b-8cd0-faede2a8ce62 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:55.514728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 576/1139] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:55.519922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81eec98-b6b1-4e5c-b3bc-87a45504a6d0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:55.520327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81eec98-b6b1-4e5c-b3bc-87a45504a6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:55.520513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81eec98-b6b1-4e5c-b3bc-87a45504a6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:55.538557 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b81eec98-b6b1-4e5c-b3bc-87a45504a6d0 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:55.539748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b81eec98-b6b1-4e5c-b3bc-87a45504a6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:55.581604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:55.605262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 564/1140] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:55.628459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528a8a4-c7f8-444b-8cd0-faede2a8ce62 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:55.726358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528a8a4-c7f8-444b-8cd0-faede2a8ce62 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:55.762952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e9e47-95cd-41e2-9cba-f7a6f2630987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:55.763658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e9e47-95cd-41e2-9cba-f7a6f2630987 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:55.764002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e9e47-95cd-41e2-9cba-f7a6f2630987 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:55.764366 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e9e47-95cd-41e2-9cba-f7a6f2630987 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:55.776938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e9e47-95cd-41e2-9cba-f7a6f2630987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-764e9e47-95cd-41e2-9cba-f7a6f2630987 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:55.782470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:55.783647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:55.784971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 577/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:41:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:55.790324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81eec98-b6b1-4e5c-b3bc-87a45504a6d0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:55.891238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81eec98-b6b1-4e5c-b3bc-87a45504a6d0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:55.932964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fb8c6-57a2-4ab5-9d9c-74fa76a60c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:55.933589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fb8c6-57a2-4ab5-9d9c-74fa76a60c3d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:55.933862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fb8c6-57a2-4ab5-9d9c-74fa76a60c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:55.934135 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fb8c6-57a2-4ab5-9d9c-74fa76a60c3d None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:55.934843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fb8c6-57a2-4ab5-9d9c-74fa76a60c3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:55.935145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fb8c6-57a2-4ab5-9d9c-74fa76a60c3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:55.936527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fb8c6-57a2-4ab5-9d9c-74fa76a60c3d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:55.944495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 565/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:41:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:55.950771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e9e47-95cd-41e2-9cba-f7a6f2630987 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:56.013688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:56.055372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e9e47-95cd-41e2-9cba-f7a6f2630987 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:56.088545 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06383cc-5915-4234-9bb8-2fc87366cee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:56.089178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06383cc-5915-4234-9bb8-2fc87366cee5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:56.089460 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06383cc-5915-4234-9bb8-2fc87366cee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:56.089739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06383cc-5915-4234-9bb8-2fc87366cee5 None admin] PATH_INFO: `/v3/users/338d8ab92cf6403aab993d63479e91ba` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:56.103097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06383cc-5915-4234-9bb8-2fc87366cee5 None admin] RBAC: Authorizing `identity:get_user(user_id=338d8ab92cf6403aab993d63479e91ba)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:56.104575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06383cc-5915-4234-9bb8-2fc87366cee5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:56.106189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 578/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:41:55 2022] GET /identity/v3/users/338d8ab92cf6403aab993d63479e91ba => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:56.111929 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fb8c6-57a2-4ab5-9d9c-74fa76a60c3d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:56.155395 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:56.219264 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fb8c6-57a2-4ab5-9d9c-74fa76a60c3d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:56.259851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25093b-f69d-4e8f-a701-bb6c45c52afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:56.260495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25093b-f69d-4e8f-a701-bb6c45c52afc None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:56.260781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25093b-f69d-4e8f-a701-bb6c45c52afc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:56.261059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25093b-f69d-4e8f-a701-bb6c45c52afc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:56.329325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25093b-f69d-4e8f-a701-bb6c45c52afc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:56.330762 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25093b-f69d-4e8f-a701-bb6c45c52afc None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:56.371430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:56.432229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 566/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:41:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:41:56.440581 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06383cc-5915-4234-9bb8-2fc87366cee5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:56.540196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06383cc-5915-4234-9bb8-2fc87366cee5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:56.558346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:56.575691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d9e05-8471-4d0b-a647-0ca3036e7304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:56.576360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d9e05-8471-4d0b-a647-0ca3036e7304 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:56.576641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d9e05-8471-4d0b-a647-0ca3036e7304 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:56.576913 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d9e05-8471-4d0b-a647-0ca3036e7304 None admin] PATH_INFO: `/v3/projects/3e7ac12bfe204863a43d692fc584a779` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:56.578045 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d9e05-8471-4d0b-a647-0ca3036e7304 None admin] RBAC: Authorizing `identity:get_project(project_id=3e7ac12bfe204863a43d692fc584a779)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:56.579517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d9e05-8471-4d0b-a647-0ca3036e7304 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:56.581153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 579/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:41:56 2022] GET /identity/v3/projects/3e7ac12bfe204863a43d692fc584a779 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:56.587640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25093b-f69d-4e8f-a701-bb6c45c52afc None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:56.689159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25093b-f69d-4e8f-a701-bb6c45c52afc None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:56.724496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7258a2-93db-4593-b0a7-56a11afb2008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:56.725125 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7258a2-93db-4593-b0a7-56a11afb2008 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:56.725404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7258a2-93db-4593-b0a7-56a11afb2008 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:56.725675 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7258a2-93db-4593-b0a7-56a11afb2008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:56.726452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7258a2-93db-4593-b0a7-56a11afb2008 None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=3e7ac12bfe204863a43d692fc584a779, user.id=338d8ab92cf6403aab993d63479e91ba) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:56.726758 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7258a2-93db-4593-b0a7-56a11afb2008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:56.728190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7258a2-93db-4593-b0a7-56a11afb2008 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:56.733497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 567/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:41:56 2022] GET /identity/v3/role_assignments?user.id=338d8ab92cf6403aab993d63479e91ba&scope.project.id=3e7ac12bfe204863a43d692fc584a779&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:58.724941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a2273-e800-4f92-b97f-e609ea697cee None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:58.725566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a2273-e800-4f92-b97f-e609ea697cee None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:58.725566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a2273-e800-4f92-b97f-e609ea697cee None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:58.726876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 580/1147] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:41:58.732264 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ea072-715c-4160-97d8-efbfd66f67fa None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:58.732660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ea072-715c-4160-97d8-efbfd66f67fa None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:58.732832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ea072-715c-4160-97d8-efbfd66f67fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:58.740029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:58.751703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-340ea072-715c-4160-97d8-efbfd66f67fa None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:41:58.752902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-340ea072-715c-4160-97d8-efbfd66f67fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:41:58.818423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 568/1148] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:41:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:41:58.842503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a2273-e800-4f92-b97f-e609ea697cee None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:58.958709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a2273-e800-4f92-b97f-e609ea697cee None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:58.994142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88271d36-7ab1-4f90-a180-31549c180878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:58.994709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88271d36-7ab1-4f90-a180-31549c180878 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:58.994992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88271d36-7ab1-4f90-a180-31549c180878 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:58.995267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88271d36-7ab1-4f90-a180-31549c180878 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:59.005201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88271d36-7ab1-4f90-a180-31549c180878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-88271d36-7ab1-4f90-a180-31549c180878 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:41:59.011052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:41:59.012220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:41:59.013226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 581/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:41:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:41:59.018402 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ea072-715c-4160-97d8-efbfd66f67fa None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:59.118167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ea072-715c-4160-97d8-efbfd66f67fa None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:59.151222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1fe3d-a246-46c6-8fb3-349789104e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:59.151850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1fe3d-a246-46c6-8fb3-349789104e3f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:59.152162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1fe3d-a246-46c6-8fb3-349789104e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:59.152532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1fe3d-a246-46c6-8fb3-349789104e3f None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:59.153310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1fe3d-a246-46c6-8fb3-349789104e3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:41:59.153637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1fe3d-a246-46c6-8fb3-349789104e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:59.155041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1fe3d-a246-46c6-8fb3-349789104e3f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:59.156422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:59.164848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 569/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:41:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:59.170626 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88271d36-7ab1-4f90-a180-31549c180878 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:59.215694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:59.277997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88271d36-7ab1-4f90-a180-31549c180878 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:59.312537 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefcb41-aec6-424b-b3b6-80b97382d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:59.313173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefcb41-aec6-424b-b3b6-80b97382d2bb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:59.313458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefcb41-aec6-424b-b3b6-80b97382d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:59.313736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefcb41-aec6-424b-b3b6-80b97382d2bb None admin] PATH_INFO: `/v3/users/338d8ab92cf6403aab993d63479e91ba` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:59.314892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefcb41-aec6-424b-b3b6-80b97382d2bb None admin] RBAC: Authorizing `identity:get_user(user_id=338d8ab92cf6403aab993d63479e91ba)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:59.316363 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefcb41-aec6-424b-b3b6-80b97382d2bb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:59.317969 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 582/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:41:59 2022] GET /identity/v3/users/338d8ab92cf6403aab993d63479e91ba => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:59.323832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1fe3d-a246-46c6-8fb3-349789104e3f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:59.425927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1fe3d-a246-46c6-8fb3-349789104e3f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:59.460206 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2d7a3-3b05-446b-91e1-255579619fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:59.460845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2d7a3-3b05-446b-91e1-255579619fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:59.461133 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2d7a3-3b05-446b-91e1-255579619fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:59.461410 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2d7a3-3b05-446b-91e1-255579619fa9 None admin] PATH_INFO: `/v3/projects/3e7ac12bfe204863a43d692fc584a779` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:59.462554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2d7a3-3b05-446b-91e1-255579619fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=3e7ac12bfe204863a43d692fc584a779)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:59.463984 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2d7a3-3b05-446b-91e1-255579619fa9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:59.465682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 570/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:41:59 2022] GET /identity/v3/projects/3e7ac12bfe204863a43d692fc584a779 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:41:59.472064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefcb41-aec6-424b-b3b6-80b97382d2bb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:41:59.573154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefcb41-aec6-424b-b3b6-80b97382d2bb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:41:59.587502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:41:59.607691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f486e-38f1-4a1d-ae46-3f7513a3bae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:41:59.608386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f486e-38f1-4a1d-ae46-3f7513a3bae3 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:41:59.608669 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f486e-38f1-4a1d-ae46-3f7513a3bae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:41:59.608936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f486e-38f1-4a1d-ae46-3f7513a3bae3 None admin] PATH_INFO: `/v3/projects/3e7ac12bfe204863a43d692fc584a779/users/338d8ab92cf6403aab993d63479e91ba/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:41:59.610899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f486e-38f1-4a1d-ae46-3f7513a3bae3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e7ac12bfe204863a43d692fc584a779, user_id=338d8ab92cf6403aab993d63479e91ba, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:41:59.612348 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f486e-38f1-4a1d-ae46-3f7513a3bae3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:41:59.625467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 583/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:41:59 2022] PUT /identity/v3/projects/3e7ac12bfe204863a43d692fc584a779/users/338d8ab92cf6403aab993d63479e91ba/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:42:01.589269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fd528-c501-4473-a5ce-8a1d8c70ed85 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:01.589800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fd528-c501-4473-a5ce-8a1d8c70ed85 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:01.589800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fd528-c501-4473-a5ce-8a1d8c70ed85 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:01.591166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 571/1154] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:42:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:42:01.596358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc399d4-373a-431f-9d98-d3411345c2c4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:01.596759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc399d4-373a-431f-9d98-d3411345c2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:01.596916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc399d4-373a-431f-9d98-d3411345c2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:01.619744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-adc399d4-373a-431f-9d98-d3411345c2c4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:42:01.620954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-adc399d4-373a-431f-9d98-d3411345c2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:42:01.684602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 584/1155] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:42:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:42:01.708678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fd528-c501-4473-a5ce-8a1d8c70ed85 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:01.770486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:01.809086 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fd528-c501-4473-a5ce-8a1d8c70ed85 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:01.842450 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4fb9b-7a8e-4a5b-aef5-5fac317e1ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:01.843002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4fb9b-7a8e-4a5b-aef5-5fac317e1ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:01.843280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4fb9b-7a8e-4a5b-aef5-5fac317e1ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:01.843550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4fb9b-7a8e-4a5b-aef5-5fac317e1ee6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:01.854035 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4fb9b-7a8e-4a5b-aef5-5fac317e1ee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-70a4fb9b-7a8e-4a5b-aef5-5fac317e1ee6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:42:01.858893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:42:01.859991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:42:01.861176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 572/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:42:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:42:01.866026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc399d4-373a-431f-9d98-d3411345c2c4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:01.974081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc399d4-373a-431f-9d98-d3411345c2c4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:01.977021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:02.013250 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd99b60-b3b5-40fb-a26c-b6885ca5d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:02.013859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd99b60-b3b5-40fb-a26c-b6885ca5d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:02.014140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd99b60-b3b5-40fb-a26c-b6885ca5d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:02.014413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd99b60-b3b5-40fb-a26c-b6885ca5d9e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:02.015187 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd99b60-b3b5-40fb-a26c-b6885ca5d9e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:42:02.015493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd99b60-b3b5-40fb-a26c-b6885ca5d9e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:02.016891 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd99b60-b3b5-40fb-a26c-b6885ca5d9e3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:02.025340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 585/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:02.031145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4fb9b-7a8e-4a5b-aef5-5fac317e1ee6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:02.129490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4fb9b-7a8e-4a5b-aef5-5fac317e1ee6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:02.153462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:02.164502 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e9cc-eca6-4a50-9bef-01ab9e3505d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:02.165137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e9cc-eca6-4a50-9bef-01ab9e3505d5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:02.165422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e9cc-eca6-4a50-9bef-01ab9e3505d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:02.165707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e9cc-eca6-4a50-9bef-01ab9e3505d5 None admin] PATH_INFO: `/v3/users/338d8ab92cf6403aab993d63479e91ba` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:02.166859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5e9cc-eca6-4a50-9bef-01ab9e3505d5 None admin] RBAC: Authorizing `identity:get_user(user_id=338d8ab92cf6403aab993d63479e91ba)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:02.168326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5e9cc-eca6-4a50-9bef-01ab9e3505d5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:02.169917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 573/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:42:02 2022] GET /identity/v3/users/338d8ab92cf6403aab993d63479e91ba => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:02.175638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd99b60-b3b5-40fb-a26c-b6885ca5d9e3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:02.273234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd99b60-b3b5-40fb-a26c-b6885ca5d9e3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:02.305350 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde0a84-ff55-42bf-85a7-51826c8525a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:02.305959 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde0a84-ff55-42bf-85a7-51826c8525a3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:02.306248 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde0a84-ff55-42bf-85a7-51826c8525a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:02.306529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde0a84-ff55-42bf-85a7-51826c8525a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:02.340372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:02.374751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde0a84-ff55-42bf-85a7-51826c8525a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:02.376228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde0a84-ff55-42bf-85a7-51826c8525a3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:02.474109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 586/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:42:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:42:02.480063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e9cc-eca6-4a50-9bef-01ab9e3505d5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:02.579011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e9cc-eca6-4a50-9bef-01ab9e3505d5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:02.611794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02fb4c-c5d1-41e6-8b74-441002963788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:02.612453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02fb4c-c5d1-41e6-8b74-441002963788 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:02.612737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02fb4c-c5d1-41e6-8b74-441002963788 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:02.613016 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02fb4c-c5d1-41e6-8b74-441002963788 None admin] PATH_INFO: `/v3/projects/3e7ac12bfe204863a43d692fc584a779` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:02.614379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02fb4c-c5d1-41e6-8b74-441002963788 None admin] RBAC: Authorizing `identity:get_project(project_id=3e7ac12bfe204863a43d692fc584a779)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:02.616352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02fb4c-c5d1-41e6-8b74-441002963788 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:02.618004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 574/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:42:02 2022] GET /identity/v3/projects/3e7ac12bfe204863a43d692fc584a779 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:02.624260 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde0a84-ff55-42bf-85a7-51826c8525a3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:02.688965 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:02.723274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde0a84-ff55-42bf-85a7-51826c8525a3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:02.759966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74154ff-a973-4cd9-827f-99a4c6f09b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:02.760529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74154ff-a973-4cd9-827f-99a4c6f09b0c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:02.760813 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74154ff-a973-4cd9-827f-99a4c6f09b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:02.761089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74154ff-a973-4cd9-827f-99a4c6f09b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:02.761873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74154ff-a973-4cd9-827f-99a4c6f09b0c None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=3e7ac12bfe204863a43d692fc584a779, user.id=338d8ab92cf6403aab993d63479e91ba) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:42:02.762185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74154ff-a973-4cd9-827f-99a4c6f09b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:02.763608 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74154ff-a973-4cd9-827f-99a4c6f09b0c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:02.769389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 587/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:42:02 2022] GET /identity/v3/role_assignments?user.id=338d8ab92cf6403aab993d63479e91ba&scope.project.id=3e7ac12bfe204863a43d692fc584a779&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:04.790152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da707ab-0704-4c93-90ce-cb1815093e33 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:04.790709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da707ab-0704-4c93-90ce-cb1815093e33 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:04.790709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da707ab-0704-4c93-90ce-cb1815093e33 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:04.792045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 575/1162] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:42:04.797158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb91bc-9632-4c2a-ae86-29f30caa1c02 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:04.797673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb91bc-9632-4c2a-ae86-29f30caa1c02 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:04.797821 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb91bc-9632-4c2a-ae86-29f30caa1c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:04.816090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-82eb91bc-9632-4c2a-ae86-29f30caa1c02 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:42:04.817313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-82eb91bc-9632-4c2a-ae86-29f30caa1c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:42:04.884021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 588/1163] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:42:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:42:04.905563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da707ab-0704-4c93-90ce-cb1815093e33 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:04.969078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:05.010259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da707ab-0704-4c93-90ce-cb1815093e33 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:05.042683 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e91877-b3d7-46f4-9e3d-a5dab99dbbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:05.043182 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e91877-b3d7-46f4-9e3d-a5dab99dbbac None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:05.043468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e91877-b3d7-46f4-9e3d-a5dab99dbbac None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:05.043746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e91877-b3d7-46f4-9e3d-a5dab99dbbac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:05.109774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e91877-b3d7-46f4-9e3d-a5dab99dbbac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:05.111225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e91877-b3d7-46f4-9e3d-a5dab99dbbac None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:05.167806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:05.208020 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 576/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:42:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:42:05.214384 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb91bc-9632-4c2a-ae86-29f30caa1c02 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:05.272256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:05.312019 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb91bc-9632-4c2a-ae86-29f30caa1c02 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:05.344441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15adf45-96b3-4fb8-891e-d6fef88f6660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:05.345077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15adf45-96b3-4fb8-891e-d6fef88f6660 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:05.345362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15adf45-96b3-4fb8-891e-d6fef88f6660 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:05.345638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15adf45-96b3-4fb8-891e-d6fef88f6660 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:05.353049 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15adf45-96b3-4fb8-891e-d6fef88f6660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:05.354495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15adf45-96b3-4fb8-891e-d6fef88f6660 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c15adf45-96b3-4fb8-891e-d6fef88f6660 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:42:05.366473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:42:05.367665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:42:05.368739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 589/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Aug 2 08:42:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:42:05.374521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e91877-b3d7-46f4-9e3d-a5dab99dbbac None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:05.471334 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e91877-b3d7-46f4-9e3d-a5dab99dbbac None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:05.507488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e26195-fe91-4c66-a63e-bfb257851d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:05.508080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e26195-fe91-4c66-a63e-bfb257851d18 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:05.508388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e26195-fe91-4c66-a63e-bfb257851d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:05.508665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e26195-fe91-4c66-a63e-bfb257851d18 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:05.509338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e26195-fe91-4c66-a63e-bfb257851d18 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:42:05.509643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e26195-fe91-4c66-a63e-bfb257851d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:05.510993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e26195-fe91-4c66-a63e-bfb257851d18 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:05.517958 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 577/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Aug 2 08:42:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:07.583068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a93a5b-ec64-48cf-9451-6d3845332146 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:07.583968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a93a5b-ec64-48cf-9451-6d3845332146 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:07.583968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a93a5b-ec64-48cf-9451-6d3845332146 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:07.585391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 590/1167] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:42:07.591229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36a756-cd49-48cf-be1d-dad89d6f8b52 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:07.591651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36a756-cd49-48cf-be1d-dad89d6f8b52 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:07.591785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36a756-cd49-48cf-be1d-dad89d6f8b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:07.609568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1e36a756-cd49-48cf-be1d-dad89d6f8b52 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:42:07.610743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1e36a756-cd49-48cf-be1d-dad89d6f8b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:42:07.627561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:07.676697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 578/1168] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:42:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:42:07.699216 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a93a5b-ec64-48cf-9451-6d3845332146 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:07.799424 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a93a5b-ec64-48cf-9451-6d3845332146 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:07.822234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:07.836683 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa810d27-9f5e-480c-9fc9-a8f319b6e75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:07.837241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa810d27-9f5e-480c-9fc9-a8f319b6e75d None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:07.837527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa810d27-9f5e-480c-9fc9-a8f319b6e75d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:07.837805 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa810d27-9f5e-480c-9fc9-a8f319b6e75d None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:07.838523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa810d27-9f5e-480c-9fc9-a8f319b6e75d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:07.839891 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa810d27-9f5e-480c-9fc9-a8f319b6e75d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:07.855837 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 591/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Tue Aug 2 08:42:07 2022] POST /identity/v3/domains => generated 267 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:42:09.869488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd061df1-76a9-4052-8ac8-b7d3fc94529f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:09.870037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd061df1-76a9-4052-8ac8-b7d3fc94529f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:09.870037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd061df1-76a9-4052-8ac8-b7d3fc94529f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:09.871419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 579/1170] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:42:09.876707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb0eda-9c44-4413-b8bd-85e95ab07dbe None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:09.877105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb0eda-9c44-4413-b8bd-85e95ab07dbe None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:09.877268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb0eda-9c44-4413-b8bd-85e95ab07dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:09.894922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-efdb0eda-9c44-4413-b8bd-85e95ab07dbe None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:42:09.896104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-efdb0eda-9c44-4413-b8bd-85e95ab07dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:42:09.961778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 592/1171] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:42:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:42:09.984960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd061df1-76a9-4052-8ac8-b7d3fc94529f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:10.083862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd061df1-76a9-4052-8ac8-b7d3fc94529f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:10.117917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec798895-0532-420a-ae0a-6470f2f5d184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:10.118547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec798895-0532-420a-ae0a-6470f2f5d184 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:10.118830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec798895-0532-420a-ae0a-6470f2f5d184 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:10.119106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec798895-0532-420a-ae0a-6470f2f5d184 None admin] PATH_INFO: `/v3/domains/f0f7505848b44761bf7bb3626e584a82` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:10.129282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec798895-0532-420a-ae0a-6470f2f5d184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f0f7505848b44761bf7bb3626e584a82)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:10.130731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec798895-0532-420a-ae0a-6470f2f5d184 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:10.132381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 580/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Tue Aug 2 08:42:09 2022] GET /identity/v3/domains/f0f7505848b44761bf7bb3626e584a82 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:10.138410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb0eda-9c44-4413-b8bd-85e95ab07dbe None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:10.236000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb0eda-9c44-4413-b8bd-85e95ab07dbe None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:10.246446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:10.269889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc2f59-dea4-49bf-820b-6b78ef901c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:10.270500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc2f59-dea4-49bf-820b-6b78ef901c36 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:10.270782 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc2f59-dea4-49bf-820b-6b78ef901c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:10.271076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc2f59-dea4-49bf-820b-6b78ef901c36 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:10.272343 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc2f59-dea4-49bf-820b-6b78ef901c36 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:10.273803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc2f59-dea4-49bf-820b-6b78ef901c36 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:10.299459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 593/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:42:10 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:42:12.312911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72367dfb-12e4-4f99-a985-0646ac9eb0d2 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:12.313467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72367dfb-12e4-4f99-a985-0646ac9eb0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:12.313467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72367dfb-12e4-4f99-a985-0646ac9eb0d2 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:12.314836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 581/1174] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:42:12.320608 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdfa43-5889-4e3c-ba02-fd4fadfc9091 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:12.321042 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdfa43-5889-4e3c-ba02-fd4fadfc9091 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:12.321153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdfa43-5889-4e3c-ba02-fd4fadfc9091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:12.338986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-59fdfa43-5889-4e3c-ba02-fd4fadfc9091 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:42:12.340181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-59fdfa43-5889-4e3c-ba02-fd4fadfc9091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:42:12.405137 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 594/1175] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:42:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:42:12.429792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72367dfb-12e4-4f99-a985-0646ac9eb0d2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:12.446128 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:12.530045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72367dfb-12e4-4f99-a985-0646ac9eb0d2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:12.563393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4818c-c93c-4f84-89ec-bf9f06246dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:12.563963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4818c-c93c-4f84-89ec-bf9f06246dbe None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:12.564273 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4818c-c93c-4f84-89ec-bf9f06246dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:12.564552 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4818c-c93c-4f84-89ec-bf9f06246dbe None admin] PATH_INFO: `/v3/domains/f0f7505848b44761bf7bb3626e584a82` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:12.565723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4818c-c93c-4f84-89ec-bf9f06246dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=f0f7505848b44761bf7bb3626e584a82)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:12.567145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4818c-c93c-4f84-89ec-bf9f06246dbe None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:12.569304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 582/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Tue Aug 2 08:42:12 2022] GET /identity/v3/domains/f0f7505848b44761bf7bb3626e584a82 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:12.575182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdfa43-5889-4e3c-ba02-fd4fadfc9091 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:12.663442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:12.673168 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdfa43-5889-4e3c-ba02-fd4fadfc9091 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:12.706893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acff72-cabd-4a89-ae94-df89136e9b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:12.707505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acff72-cabd-4a89-ae94-df89136e9b97 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:12.707790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acff72-cabd-4a89-ae94-df89136e9b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:12.708062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acff72-cabd-4a89-ae94-df89136e9b97 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:12.709030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acff72-cabd-4a89-ae94-df89136e9b97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:12.710512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acff72-cabd-4a89-ae94-df89136e9b97 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:12.731738 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 595/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:42:12 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:42:14.769897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7fc89-533e-47ff-b6fb-65f3b822a3fe None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:14.770457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7fc89-533e-47ff-b6fb-65f3b822a3fe None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:14.770457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7fc89-533e-47ff-b6fb-65f3b822a3fe None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:14.771781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 583/1178] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:42:14.777330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bede-bf78-4b29-9543-d18c72f11dbd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:14.777738 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bede-bf78-4b29-9543-d18c72f11dbd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:14.777877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bede-bf78-4b29-9543-d18c72f11dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:14.795744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-64d3bede-bf78-4b29-9543-d18c72f11dbd None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:42:14.796977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-64d3bede-bf78-4b29-9543-d18c72f11dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:42:14.863177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 596/1179] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:42:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:42:14.886696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7fc89-533e-47ff-b6fb-65f3b822a3fe None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:14.967810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:14.987028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7fc89-533e-47ff-b6fb-65f3b822a3fe None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:15.020013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520dc1c-fe67-4d83-a483-27568f0571cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:15.020615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520dc1c-fe67-4d83-a483-27568f0571cb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:15.020900 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520dc1c-fe67-4d83-a483-27568f0571cb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:15.021180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520dc1c-fe67-4d83-a483-27568f0571cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:15.031248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520dc1c-fe67-4d83-a483-27568f0571cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-0520dc1c-fe67-4d83-a483-27568f0571cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:42:15.036162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:42:15.038393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:42:15.040082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 584/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:42:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:42:15.044044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3bede-bf78-4b29-9543-d18c72f11dbd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:15.122611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:15.144888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3bede-bf78-4b29-9543-d18c72f11dbd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:15.179399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026570-1aec-4ceb-917a-b049187f5bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:15.180020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026570-1aec-4ceb-917a-b049187f5bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:15.180339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026570-1aec-4ceb-917a-b049187f5bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:15.180620 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026570-1aec-4ceb-917a-b049187f5bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:15.181329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91026570-1aec-4ceb-917a-b049187f5bc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:42:15.181638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91026570-1aec-4ceb-917a-b049187f5bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:15.183019 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91026570-1aec-4ceb-917a-b049187f5bc8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:15.191005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 597/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:15.196892 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520dc1c-fe67-4d83-a483-27568f0571cb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:15.295127 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520dc1c-fe67-4d83-a483-27568f0571cb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:15.329555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc872de-d998-428c-bc8b-2b9b7eed05e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:15.330203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc872de-d998-428c-bc8b-2b9b7eed05e9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:15.330481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc872de-d998-428c-bc8b-2b9b7eed05e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:15.330756 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc872de-d998-428c-bc8b-2b9b7eed05e9 None admin] PATH_INFO: `/v3/users/39a6e2b485e341eea1aa058e5a18a2e2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:15.342366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:15.345044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc872de-d998-428c-bc8b-2b9b7eed05e9 None admin] RBAC: Authorizing `identity:get_user(user_id=39a6e2b485e341eea1aa058e5a18a2e2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:15.346907 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc872de-d998-428c-bc8b-2b9b7eed05e9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:15.348970 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 585/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:42:15 2022] GET /identity/v3/users/39a6e2b485e341eea1aa058e5a18a2e2 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:15.355373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026570-1aec-4ceb-917a-b049187f5bc8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:15.454644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026570-1aec-4ceb-917a-b049187f5bc8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:15.488570 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc3504-886f-49da-ae4c-f5e012131317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:15.489180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc3504-886f-49da-ae4c-f5e012131317 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:15.489461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc3504-886f-49da-ae4c-f5e012131317 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:15.489737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc3504-886f-49da-ae4c-f5e012131317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:15.500427 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:15.557958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc3504-886f-49da-ae4c-f5e012131317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:15.559317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc3504-886f-49da-ae4c-f5e012131317 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:15.655201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 598/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:42:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:42:15.661149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc872de-d998-428c-bc8b-2b9b7eed05e9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:15.760251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc872de-d998-428c-bc8b-2b9b7eed05e9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:15.794625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa63806-86ca-4d55-8959-ac687f853043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:15.795245 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa63806-86ca-4d55-8959-ac687f853043 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:15.795532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa63806-86ca-4d55-8959-ac687f853043 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:15.795807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa63806-86ca-4d55-8959-ac687f853043 None admin] PATH_INFO: `/v3/projects/62253d98a6c347e4836880d732c29cc5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:15.796997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa63806-86ca-4d55-8959-ac687f853043 None admin] RBAC: Authorizing `identity:get_project(project_id=62253d98a6c347e4836880d732c29cc5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:15.798452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa63806-86ca-4d55-8959-ac687f853043 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:15.800331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 586/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:42:15 2022] GET /identity/v3/projects/62253d98a6c347e4836880d732c29cc5 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:15.806395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc3504-886f-49da-ae4c-f5e012131317 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:15.850495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:15.907389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc3504-886f-49da-ae4c-f5e012131317 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:15.940388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e334c2-b8e7-4164-87ba-2a6e81be711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:15.940999 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e334c2-b8e7-4164-87ba-2a6e81be711a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:15.941281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e334c2-b8e7-4164-87ba-2a6e81be711a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:15.941555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e334c2-b8e7-4164-87ba-2a6e81be711a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:15.942333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e334c2-b8e7-4164-87ba-2a6e81be711a None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=62253d98a6c347e4836880d732c29cc5, user.id=39a6e2b485e341eea1aa058e5a18a2e2) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:42:15.942646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e334c2-b8e7-4164-87ba-2a6e81be711a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:15.944612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e334c2-b8e7-4164-87ba-2a6e81be711a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:15.949919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 599/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:42:15 2022] GET /identity/v3/role_assignments?user.id=39a6e2b485e341eea1aa058e5a18a2e2&scope.project.id=62253d98a6c347e4836880d732c29cc5&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:17.893479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683dc21-6def-4504-9ade-b0f4c59e92ca None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:17.894012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683dc21-6def-4504-9ade-b0f4c59e92ca None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:17.894012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683dc21-6def-4504-9ade-b0f4c59e92ca None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:17.895360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 587/1186] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:42:17.900485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b05e3-47a5-4294-9ba7-cc8ee813dbc8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:17.900879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b05e3-47a5-4294-9ba7-cc8ee813dbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:17.901041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b05e3-47a5-4294-9ba7-cc8ee813dbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:17.919132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4d2b05e3-47a5-4294-9ba7-cc8ee813dbc8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:42:17.920339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4d2b05e3-47a5-4294-9ba7-cc8ee813dbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:42:17.984536 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 600/1187] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:42:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:42:18.006524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683dc21-6def-4504-9ade-b0f4c59e92ca None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:18.072996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:18.107563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683dc21-6def-4504-9ade-b0f4c59e92ca None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:18.141513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba60d65-a0eb-4298-ae52-2a62b1802823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:18.142136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba60d65-a0eb-4298-ae52-2a62b1802823 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:18.142414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba60d65-a0eb-4298-ae52-2a62b1802823 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:18.142684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba60d65-a0eb-4298-ae52-2a62b1802823 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:18.152563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba60d65-a0eb-4298-ae52-2a62b1802823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-2ba60d65-a0eb-4298-ae52-2a62b1802823 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:42:18.157422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:42:18.158375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:42:18.159342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 588/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:42:18.165122 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b05e3-47a5-4294-9ba7-cc8ee813dbc8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:18.197739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:18.262030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b05e3-47a5-4294-9ba7-cc8ee813dbc8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:18.296628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ec202-098d-41f7-b2d5-f7b5a6667191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:18.297241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ec202-098d-41f7-b2d5-f7b5a6667191 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:18.297528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ec202-098d-41f7-b2d5-f7b5a6667191 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:18.297810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ec202-098d-41f7-b2d5-f7b5a6667191 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:18.298523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ec202-098d-41f7-b2d5-f7b5a6667191 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:42:18.298834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ec202-098d-41f7-b2d5-f7b5a6667191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:18.300230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ec202-098d-41f7-b2d5-f7b5a6667191 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:18.308183 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 601/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:18.313936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba60d65-a0eb-4298-ae52-2a62b1802823 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:18.413515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba60d65-a0eb-4298-ae52-2a62b1802823 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:18.439374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:18.447860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422fba7-a60f-4ef6-8a40-55934292d017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:18.448520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422fba7-a60f-4ef6-8a40-55934292d017 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:18.448808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422fba7-a60f-4ef6-8a40-55934292d017 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:18.449089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422fba7-a60f-4ef6-8a40-55934292d017 None admin] PATH_INFO: `/v3/users/39a6e2b485e341eea1aa058e5a18a2e2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:18.450241 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422fba7-a60f-4ef6-8a40-55934292d017 None admin] RBAC: Authorizing `identity:get_user(user_id=39a6e2b485e341eea1aa058e5a18a2e2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:18.451684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422fba7-a60f-4ef6-8a40-55934292d017 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:18.453319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 589/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:42:18 2022] GET /identity/v3/users/39a6e2b485e341eea1aa058e5a18a2e2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:18.459278 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ec202-098d-41f7-b2d5-f7b5a6667191 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:18.559092 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:18.565392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ec202-098d-41f7-b2d5-f7b5a6667191 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:18.599939 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818817cd-f6e6-4512-8ce9-f314f8820f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:18.600629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818817cd-f6e6-4512-8ce9-f314f8820f63 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:18.600911 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818817cd-f6e6-4512-8ce9-f314f8820f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:18.601186 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818817cd-f6e6-4512-8ce9-f314f8820f63 None admin] PATH_INFO: `/v3/projects/62253d98a6c347e4836880d732c29cc5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:18.602332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818817cd-f6e6-4512-8ce9-f314f8820f63 None admin] RBAC: Authorizing `identity:get_project(project_id=62253d98a6c347e4836880d732c29cc5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:18.603769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818817cd-f6e6-4512-8ce9-f314f8820f63 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:18.605471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 602/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:42:18 2022] GET /identity/v3/projects/62253d98a6c347e4836880d732c29cc5 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:18.611610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422fba7-a60f-4ef6-8a40-55934292d017 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:18.709598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422fba7-a60f-4ef6-8a40-55934292d017 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:18.747226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b56364-2809-4b2c-980f-25501b1ae4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:18.748738 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b56364-2809-4b2c-980f-25501b1ae4e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:18.749072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b56364-2809-4b2c-980f-25501b1ae4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:18.749438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b56364-2809-4b2c-980f-25501b1ae4e8 None admin] PATH_INFO: `/v3/projects/62253d98a6c347e4836880d732c29cc5/users/39a6e2b485e341eea1aa058e5a18a2e2/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:18.752088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b56364-2809-4b2c-980f-25501b1ae4e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=62253d98a6c347e4836880d732c29cc5, user_id=39a6e2b485e341eea1aa058e5a18a2e2, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:18.753575 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b56364-2809-4b2c-980f-25501b1ae4e8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:18.777663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 590/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:42:18 2022] PUT /identity/v3/projects/62253d98a6c347e4836880d732c29cc5/users/39a6e2b485e341eea1aa058e5a18a2e2/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:42:20.770201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b81eb-af55-4756-8b55-619d5b023d43 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:20.770788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b81eb-af55-4756-8b55-619d5b023d43 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:20.770788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b81eb-af55-4756-8b55-619d5b023d43 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:20.772146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 603/1193] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:42:20.777235 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69dc1-1c51-422c-8e5a-1c9f8197bc84 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:20.777618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69dc1-1c51-422c-8e5a-1c9f8197bc84 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:20.777806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69dc1-1c51-422c-8e5a-1c9f8197bc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:20.795438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d4c69dc1-1c51-422c-8e5a-1c9f8197bc84 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:42:20.796661 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d4c69dc1-1c51-422c-8e5a-1c9f8197bc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:42:20.848081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:20.864998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 591/1194] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:42:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:42:20.892526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b81eb-af55-4756-8b55-619d5b023d43 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:20.991816 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b81eb-af55-4756-8b55-619d5b023d43 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:21.023087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816f262-0a3d-4b59-b30e-0f78fd2947de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:21.023649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816f262-0a3d-4b59-b30e-0f78fd2947de None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:21.023927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816f262-0a3d-4b59-b30e-0f78fd2947de None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:21.024225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816f262-0a3d-4b59-b30e-0f78fd2947de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:21.034272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816f262-0a3d-4b59-b30e-0f78fd2947de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6816f262-0a3d-4b59-b30e-0f78fd2947de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:42:21.039617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:42:21.040971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:42:21.042133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 604/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:42:21.046790 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c69dc1-1c51-422c-8e5a-1c9f8197bc84 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:21.143002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c69dc1-1c51-422c-8e5a-1c9f8197bc84 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:21.175670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1943128-b361-47ae-92e4-62e3c4a9c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:21.176309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1943128-b361-47ae-92e4-62e3c4a9c6fb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:21.176592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1943128-b361-47ae-92e4-62e3c4a9c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:21.176867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1943128-b361-47ae-92e4-62e3c4a9c6fb None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:21.177577 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1943128-b361-47ae-92e4-62e3c4a9c6fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:42:21.177884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1943128-b361-47ae-92e4-62e3c4a9c6fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:21.179273 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1943128-b361-47ae-92e4-62e3c4a9c6fb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:21.187380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 592/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:21.193273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816f262-0a3d-4b59-b30e-0f78fd2947de None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:21.219662 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:21.296143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816f262-0a3d-4b59-b30e-0f78fd2947de None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:21.329614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672c15c-7b25-4d28-8aed-9b899fb42bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:21.330245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672c15c-7b25-4d28-8aed-9b899fb42bca None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:21.330528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672c15c-7b25-4d28-8aed-9b899fb42bca None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:21.330812 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672c15c-7b25-4d28-8aed-9b899fb42bca None admin] PATH_INFO: `/v3/users/39a6e2b485e341eea1aa058e5a18a2e2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:21.331951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672c15c-7b25-4d28-8aed-9b899fb42bca None admin] RBAC: Authorizing `identity:get_user(user_id=39a6e2b485e341eea1aa058e5a18a2e2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:21.333674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672c15c-7b25-4d28-8aed-9b899fb42bca None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:21.335771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 605/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Aug 2 08:42:21 2022] GET /identity/v3/users/39a6e2b485e341eea1aa058e5a18a2e2 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:21.341712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1943128-b361-47ae-92e4-62e3c4a9c6fb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:21.390856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:21.442195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1943128-b361-47ae-92e4-62e3c4a9c6fb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:21.474797 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5629345-0224-4db4-b853-7fe93c37289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:21.475882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5629345-0224-4db4-b853-7fe93c37289b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:21.476184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5629345-0224-4db4-b853-7fe93c37289b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:21.476457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5629345-0224-4db4-b853-7fe93c37289b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:21.543642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5629345-0224-4db4-b853-7fe93c37289b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:21.545118 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5629345-0224-4db4-b853-7fe93c37289b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:21.592031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:21.643198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 593/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:42:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:42:21.649670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672c15c-7b25-4d28-8aed-9b899fb42bca None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:21.739624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:21.748417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672c15c-7b25-4d28-8aed-9b899fb42bca None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:21.781444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a15f6-08df-4bf7-ade1-0c6bd6ea29ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:21.782071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a15f6-08df-4bf7-ade1-0c6bd6ea29ad None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:21.782357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a15f6-08df-4bf7-ade1-0c6bd6ea29ad None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:21.782637 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a15f6-08df-4bf7-ade1-0c6bd6ea29ad None admin] PATH_INFO: `/v3/projects/62253d98a6c347e4836880d732c29cc5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:21.783780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a15f6-08df-4bf7-ade1-0c6bd6ea29ad None admin] RBAC: Authorizing `identity:get_project(project_id=62253d98a6c347e4836880d732c29cc5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:21.785253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a15f6-08df-4bf7-ade1-0c6bd6ea29ad None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:21.786906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 606/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Aug 2 08:42:21 2022] GET /identity/v3/projects/62253d98a6c347e4836880d732c29cc5 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:21.793090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5629345-0224-4db4-b853-7fe93c37289b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:42:21.907252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5629345-0224-4db4-b853-7fe93c37289b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:42:21.939448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6610ca8-40e3-4b6d-8400-b25221f14c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:42:21.940064 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6610ca8-40e3-4b6d-8400-b25221f14c5c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:42:21.940377 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6610ca8-40e3-4b6d-8400-b25221f14c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:42:21.940655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6610ca8-40e3-4b6d-8400-b25221f14c5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:42:21.941441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6610ca8-40e3-4b6d-8400-b25221f14c5c None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=62253d98a6c347e4836880d732c29cc5, user.id=39a6e2b485e341eea1aa058e5a18a2e2) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:42:21.941753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6610ca8-40e3-4b6d-8400-b25221f14c5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:42:21.943179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6610ca8-40e3-4b6d-8400-b25221f14c5c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:42:21.949411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 594/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:42:21 2022] GET /identity/v3/role_assignments?user.id=39a6e2b485e341eea1aa058e5a18a2e2&scope.project.id=62253d98a6c347e4836880d732c29cc5&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:42:31.777406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=20 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:42:31.946906 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:18.111276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27daa5-22a0-4f58-af33-ac0ed6f38b0d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:18.111854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27daa5-22a0-4f58-af33-ac0ed6f38b0d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:18.111854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27daa5-22a0-4f58-af33-ac0ed6f38b0d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:18.113182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 607/1201] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:43:18.119061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b3971-2d03-49f2-ac65-7247d32b8f3e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:18.119594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b3971-2d03-49f2-ac65-7247d32b8f3e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:18.119696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b3971-2d03-49f2-ac65-7247d32b8f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:18.139907 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9d1b3971-2d03-49f2-ac65-7247d32b8f3e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:43:18.141186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9d1b3971-2d03-49f2-ac65-7247d32b8f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:43:18.253384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 595/1202] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:43:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:43:18.278907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27daa5-22a0-4f58-af33-ac0ed6f38b0d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:18.430481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27daa5-22a0-4f58-af33-ac0ed6f38b0d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:18.472029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7ee72-a537-4170-a1c8-245248c957e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:18.472694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7ee72-a537-4170-a1c8-245248c957e8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:18.472990 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7ee72-a537-4170-a1c8-245248c957e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:18.473259 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7ee72-a537-4170-a1c8-245248c957e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:18.488396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7ee72-a537-4170-a1c8-245248c957e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:18.488396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7ee72-a537-4170-a1c8-245248c957e8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-95d7ee72-a537-4170-a1c8-245248c957e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:18.502506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:18.503564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:18.504602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:18.504602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:18.504602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:18.504602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:18.504602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 608/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:18.512639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b3971-2d03-49f2-ac65-7247d32b8f3e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:18.648050 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b3971-2d03-49f2-ac65-7247d32b8f3e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:18.684470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:18.691024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be06385-1de1-4951-8105-390b1b5f3e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:18.691753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be06385-1de1-4951-8105-390b1b5f3e47 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:18.692043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be06385-1de1-4951-8105-390b1b5f3e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:18.692361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be06385-1de1-4951-8105-390b1b5f3e47 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:18.693589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be06385-1de1-4951-8105-390b1b5f3e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:18.693887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be06385-1de1-4951-8105-390b1b5f3e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:18.695259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be06385-1de1-4951-8105-390b1b5f3e47 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:18.717559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 596/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:43:18.719502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7ee72-a537-4170-a1c8-245248c957e8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:18.803145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:18.888559 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7ee72-a537-4170-a1c8-245248c957e8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:18.924625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b18aed-2623-4fd3-a8c5-9ed3011716e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:18.925219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b18aed-2623-4fd3-a8c5-9ed3011716e8 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:18.925515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b18aed-2623-4fd3-a8c5-9ed3011716e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:18.925802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b18aed-2623-4fd3-a8c5-9ed3011716e8 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:18.926470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b18aed-2623-4fd3-a8c5-9ed3011716e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:18.927955 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b18aed-2623-4fd3-a8c5-9ed3011716e8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:18.952436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 609/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Aug 2 08:43:18 2022] POST /identity/v3/users => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:43:21.120910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365592ee-df87-436d-903f-02193ea88408 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:21.121456 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365592ee-df87-436d-903f-02193ea88408 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:21.121456 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365592ee-df87-436d-903f-02193ea88408 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:21.123114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 597/1206] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:43:21.128149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d41ade-4356-4722-a879-2827b7dc0f07 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:21.128629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d41ade-4356-4722-a879-2827b7dc0f07 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:21.128843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d41ade-4356-4722-a879-2827b7dc0f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:21.152512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-53d41ade-4356-4722-a879-2827b7dc0f07 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:43:21.153943 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-53d41ade-4356-4722-a879-2827b7dc0f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:43:21.239434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 610/1207] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:43:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:43:21.264562 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365592ee-df87-436d-903f-02193ea88408 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:21.392395 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365592ee-df87-436d-903f-02193ea88408 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:21.449619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02010f-77f1-4270-a449-2367748aedd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:21.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02010f-77f1-4270-a449-2367748aedd9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:21.450643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02010f-77f1-4270-a449-2367748aedd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:21.450978 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02010f-77f1-4270-a449-2367748aedd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:21.463636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02010f-77f1-4270-a449-2367748aedd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-4f02010f-77f1-4270-a449-2367748aedd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:43:21.469223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:21.470221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:21.473250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 598/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:21.478625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d41ade-4356-4722-a879-2827b7dc0f07 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:21.540870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:21.631395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d41ade-4356-4722-a879-2827b7dc0f07 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:21.688589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a8269-7eaf-4eaa-8ee6-abfd4eb62ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:21.689142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a8269-7eaf-4eaa-8ee6-abfd4eb62ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:21.689420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a8269-7eaf-4eaa-8ee6-abfd4eb62ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:21.689694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a8269-7eaf-4eaa-8ee6-abfd4eb62ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:21.690412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a8269-7eaf-4eaa-8ee6-abfd4eb62ea6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:21.690718 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a8269-7eaf-4eaa-8ee6-abfd4eb62ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:21.692090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a8269-7eaf-4eaa-8ee6-abfd4eb62ea6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:21.701634 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 611/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:21.707284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02010f-77f1-4270-a449-2367748aedd9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:21.782183 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:21.845303 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02010f-77f1-4270-a449-2367748aedd9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:21.898903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c6fac-a9f8-4cef-8531-941a64c18ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:21.899575 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c6fac-a9f8-4cef-8531-941a64c18ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:21.899861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c6fac-a9f8-4cef-8531-941a64c18ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:21.900160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c6fac-a9f8-4cef-8531-941a64c18ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:21.916563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c6fac-a9f8-4cef-8531-941a64c18ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:21.918068 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c6fac-a9f8-4cef-8531-941a64c18ee6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8c3c6fac-a9f8-4cef-8531-941a64c18ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:21.935007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:21.936039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:21.936979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:21.936979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:21.936979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:21.936979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:21.936979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 599/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:21.942432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a8269-7eaf-4eaa-8ee6-abfd4eb62ea6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:22.064396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:22.068024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a8269-7eaf-4eaa-8ee6-abfd4eb62ea6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:22.125166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf67cec-591f-4983-acd7-e0cb2ec11fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:22.125819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf67cec-591f-4983-acd7-e0cb2ec11fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:22.126107 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf67cec-591f-4983-acd7-e0cb2ec11fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:22.126389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf67cec-591f-4983-acd7-e0cb2ec11fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:22.127211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf67cec-591f-4983-acd7-e0cb2ec11fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:22.127522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf67cec-591f-4983-acd7-e0cb2ec11fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:22.129036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf67cec-591f-4983-acd7-e0cb2ec11fb8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:22.142976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 612/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:22.149433 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c6fac-a9f8-4cef-8531-941a64c18ee6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:22.285714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c6fac-a9f8-4cef-8531-941a64c18ee6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:22.288664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:22.332647 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288e63b-5700-4378-b3d5-9462fc8d88d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:22.334334 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e63b-5700-4378-b3d5-9462fc8d88d5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:22.334818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e63b-5700-4378-b3d5-9462fc8d88d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:22.335096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e63b-5700-4378-b3d5-9462fc8d88d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:22.344905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288e63b-5700-4378-b3d5-9462fc8d88d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:22.346816 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288e63b-5700-4378-b3d5-9462fc8d88d5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8288e63b-5700-4378-b3d5-9462fc8d88d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:43:22.366468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:22.367609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:22.368648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:22.368648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:22.368648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:43:22.368648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:43:22.368648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:43:22.368648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:43:22.368648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:43:22.368648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:43:22.368648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:43:22.368648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:22.368648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 600/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:43:22.374173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf67cec-591f-4983-acd7-e0cb2ec11fb8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:22.500377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf67cec-591f-4983-acd7-e0cb2ec11fb8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:22.549780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38700e82-7d98-4fba-93cd-5a4b598012d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:22.550741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38700e82-7d98-4fba-93cd-5a4b598012d8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:22.550741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38700e82-7d98-4fba-93cd-5a4b598012d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:22.551046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38700e82-7d98-4fba-93cd-5a4b598012d8 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:22.551855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38700e82-7d98-4fba-93cd-5a4b598012d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:22.552388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38700e82-7d98-4fba-93cd-5a4b598012d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:22.553846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38700e82-7d98-4fba-93cd-5a4b598012d8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:22.579530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 613/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Tue Aug 2 08:43:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:22.580946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288e63b-5700-4378-b3d5-9462fc8d88d5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:22.711631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288e63b-5700-4378-b3d5-9462fc8d88d5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:22.754146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41cbaf-91b4-41a0-9323-03f7311abe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:22.755711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41cbaf-91b4-41a0-9323-03f7311abe88 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:22.756007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41cbaf-91b4-41a0-9323-03f7311abe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:22.756336 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41cbaf-91b4-41a0-9323-03f7311abe88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:22.795325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:22.860102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41cbaf-91b4-41a0-9323-03f7311abe88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:22.861652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41cbaf-91b4-41a0-9323-03f7311abe88 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:23.009510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 601/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:43:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:43:23.016590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38700e82-7d98-4fba-93cd-5a4b598012d8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:23.037684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:23.155547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38700e82-7d98-4fba-93cd-5a4b598012d8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:23.195313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d7c39-c5e4-4e9f-8b41-e0801c874a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:23.196110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d7c39-c5e4-4e9f-8b41-e0801c874a7a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:23.196447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d7c39-c5e4-4e9f-8b41-e0801c874a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:23.196757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d7c39-c5e4-4e9f-8b41-e0801c874a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:23.209439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d7c39-c5e4-4e9f-8b41-e0801c874a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:23.211057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d7c39-c5e4-4e9f-8b41-e0801c874a7a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-427d7c39-c5e4-4e9f-8b41-e0801c874a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:23.232558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:23.234177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:23.235182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:23.235182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:23.235182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:23.235182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:23.237360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 614/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:23.244149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41cbaf-91b4-41a0-9323-03f7311abe88 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:23.321625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:23.374724 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41cbaf-91b4-41a0-9323-03f7311abe88 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:23.420818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63442975-5e7f-4d5b-86bd-823013cefc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:23.421561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63442975-5e7f-4d5b-86bd-823013cefc03 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:23.421895 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63442975-5e7f-4d5b-86bd-823013cefc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:23.422245 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63442975-5e7f-4d5b-86bd-823013cefc03 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:23.423070 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63442975-5e7f-4d5b-86bd-823013cefc03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:23.423418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63442975-5e7f-4d5b-86bd-823013cefc03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:23.425052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63442975-5e7f-4d5b-86bd-823013cefc03 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:23.445124 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 602/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:23.451906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d7c39-c5e4-4e9f-8b41-e0801c874a7a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:23.541895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:23.581458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d7c39-c5e4-4e9f-8b41-e0801c874a7a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:23.624841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46a3f6-dba9-4de1-bc0e-e6e495036208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:23.625553 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46a3f6-dba9-4de1-bc0e-e6e495036208 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:23.625840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46a3f6-dba9-4de1-bc0e-e6e495036208 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:23.626242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46a3f6-dba9-4de1-bc0e-e6e495036208 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:23.637653 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46a3f6-dba9-4de1-bc0e-e6e495036208 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:23.639299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46a3f6-dba9-4de1-bc0e-e6e495036208 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1c46a3f6-dba9-4de1-bc0e-e6e495036208 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:43:23.658956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:23.660201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:23.661126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:43:23.661126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:43:23.661126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:43:23.661126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:43:23.661126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:43:23.661126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:43:23.661126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:43:23.661126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:23.661126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 615/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:23.668133 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63442975-5e7f-4d5b-86bd-823013cefc03 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:23.792751 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63442975-5e7f-4d5b-86bd-823013cefc03 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:23.823897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:23.841231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32643b-3b76-4cdd-8082-1192c104d116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:23.841897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32643b-3b76-4cdd-8082-1192c104d116 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:23.842182 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32643b-3b76-4cdd-8082-1192c104d116 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:23.842463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32643b-3b76-4cdd-8082-1192c104d116 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:23.843231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32643b-3b76-4cdd-8082-1192c104d116 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:23.843542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32643b-3b76-4cdd-8082-1192c104d116 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:23.845048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32643b-3b76-4cdd-8082-1192c104d116 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:23.858890 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 603/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:23.865522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46a3f6-dba9-4de1-bc0e-e6e495036208 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:23.976573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46a3f6-dba9-4de1-bc0e-e6e495036208 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:24.010406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:24.018122 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37858b-0a4f-4f10-a3ca-ea166aff2720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:24.018778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37858b-0a4f-4f10-a3ca-ea166aff2720 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:24.019105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37858b-0a4f-4f10-a3ca-ea166aff2720 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:24.019400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37858b-0a4f-4f10-a3ca-ea166aff2720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:24.020226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37858b-0a4f-4f10-a3ca-ea166aff2720 None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=cd9f2dc3c1c442b4b1b09964ff7c000b) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:24.020514 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37858b-0a4f-4f10-a3ca-ea166aff2720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:24.022061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37858b-0a4f-4f10-a3ca-ea166aff2720 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:24.028724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 616/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:43:23 2022] GET /identity/v3/role_assignments?user.id=cd9f2dc3c1c442b4b1b09964ff7c000b&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:26.090200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405349a-36e8-488b-bc35-50fbfd8e1b2c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:26.090743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405349a-36e8-488b-bc35-50fbfd8e1b2c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:26.090743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405349a-36e8-488b-bc35-50fbfd8e1b2c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:26.092226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 604/1220] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:43:26.098199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c7a59-34fa-4696-9f11-2bf96bc14e78 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:26.098648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c7a59-34fa-4696-9f11-2bf96bc14e78 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:26.098748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c7a59-34fa-4696-9f11-2bf96bc14e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:26.119444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3d5c7a59-34fa-4696-9f11-2bf96bc14e78 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:43:26.120764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3d5c7a59-34fa-4696-9f11-2bf96bc14e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:43:26.193201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 617/1221] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:43:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:43:26.218845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405349a-36e8-488b-bc35-50fbfd8e1b2c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:26.336386 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405349a-36e8-488b-bc35-50fbfd8e1b2c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:26.379425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5615e-1eff-4d9f-ae76-1d2bce47c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:26.379986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5615e-1eff-4d9f-ae76-1d2bce47c743 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:26.380996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5615e-1eff-4d9f-ae76-1d2bce47c743 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:26.381117 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5615e-1eff-4d9f-ae76-1d2bce47c743 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:26.392369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5615e-1eff-4d9f-ae76-1d2bce47c743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-04a5615e-1eff-4d9f-ae76-1d2bce47c743 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:43:26.398132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:26.400007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:26.401275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 605/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:26.405631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c7a59-34fa-4696-9f11-2bf96bc14e78 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:26.518976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c7a59-34fa-4696-9f11-2bf96bc14e78 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:26.547993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:26.561431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1465cbf-1716-4393-9ae2-80da04f4b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:26.562169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1465cbf-1716-4393-9ae2-80da04f4b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:26.562470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1465cbf-1716-4393-9ae2-80da04f4b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:26.562911 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1465cbf-1716-4393-9ae2-80da04f4b6d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:26.563763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1465cbf-1716-4393-9ae2-80da04f4b6d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:26.564100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1465cbf-1716-4393-9ae2-80da04f4b6d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:26.565809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1465cbf-1716-4393-9ae2-80da04f4b6d5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:26.578353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 618/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:26.584447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5615e-1eff-4d9f-ae76-1d2bce47c743 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:26.645351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:26.722823 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5615e-1eff-4d9f-ae76-1d2bce47c743 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:26.771291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1babd71-050b-4817-adad-ef81817c5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:26.771944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1babd71-050b-4817-adad-ef81817c5044 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:26.772270 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1babd71-050b-4817-adad-ef81817c5044 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:26.772553 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1babd71-050b-4817-adad-ef81817c5044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:26.783541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1babd71-050b-4817-adad-ef81817c5044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:26.785058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1babd71-050b-4817-adad-ef81817c5044 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c1babd71-050b-4817-adad-ef81817c5044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:26.802537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:26.803533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:26.804610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:26.804610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:26.804610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:26.804610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:26.804610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 606/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:26.810245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1465cbf-1716-4393-9ae2-80da04f4b6d5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:26.931652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1465cbf-1716-4393-9ae2-80da04f4b6d5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:26.970362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843e57b-b88c-4327-90d5-c7a803aaf8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:26.971008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843e57b-b88c-4327-90d5-c7a803aaf8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:26.971267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843e57b-b88c-4327-90d5-c7a803aaf8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:26.971528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843e57b-b88c-4327-90d5-c7a803aaf8f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:26.972272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843e57b-b88c-4327-90d5-c7a803aaf8f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:26.972584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843e57b-b88c-4327-90d5-c7a803aaf8f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:26.974482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843e57b-b88c-4327-90d5-c7a803aaf8f8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:26.988038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 619/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:26.994461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1babd71-050b-4817-adad-ef81817c5044 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:27.102421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:27.109786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1babd71-050b-4817-adad-ef81817c5044 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:27.146640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e1a39-3b88-458b-97be-b22679b45211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:27.147367 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e1a39-3b88-458b-97be-b22679b45211 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:27.147659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e1a39-3b88-458b-97be-b22679b45211 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:27.147991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e1a39-3b88-458b-97be-b22679b45211 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:27.156391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e1a39-3b88-458b-97be-b22679b45211 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:27.157923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e1a39-3b88-458b-97be-b22679b45211 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-bb0e1a39-3b88-458b-97be-b22679b45211 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:43:27.177392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:27.178483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:27.179473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:27.179473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:27.179473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:43:27.179473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:43:27.179473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:43:27.179473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:43:27.179473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:43:27.179473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:43:27.179473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:43:27.179473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:27.179473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 607/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:27.192100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843e57b-b88c-4327-90d5-c7a803aaf8f8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:27.257954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:27.329472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843e57b-b88c-4327-90d5-c7a803aaf8f8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:27.368639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdeeb53-0a8b-40d2-8956-c83dd1ce3a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:27.369266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdeeb53-0a8b-40d2-8956-c83dd1ce3a0c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:27.369540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdeeb53-0a8b-40d2-8956-c83dd1ce3a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:27.369818 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdeeb53-0a8b-40d2-8956-c83dd1ce3a0c None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:27.370642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdeeb53-0a8b-40d2-8956-c83dd1ce3a0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:27.371099 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdeeb53-0a8b-40d2-8956-c83dd1ce3a0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:27.372564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdeeb53-0a8b-40d2-8956-c83dd1ce3a0c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:27.392405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 620/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Tue Aug 2 08:43:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:27.399079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e1a39-3b88-458b-97be-b22679b45211 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:27.509886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e1a39-3b88-458b-97be-b22679b45211 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:27.544355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378286c-5d1e-4d63-8a63-5d5746c24abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:27.545172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378286c-5d1e-4d63-8a63-5d5746c24abd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:27.545455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378286c-5d1e-4d63-8a63-5d5746c24abd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:27.545718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378286c-5d1e-4d63-8a63-5d5746c24abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:27.558098 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378286c-5d1e-4d63-8a63-5d5746c24abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:27.559554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378286c-5d1e-4d63-8a63-5d5746c24abd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c378286c-5d1e-4d63-8a63-5d5746c24abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:27.575973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:27.577178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:27.578165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:27.578165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:27.578165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:27.578165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:27.578165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 608/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:27.584083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdeeb53-0a8b-40d2-8956-c83dd1ce3a0c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:27.696609 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdeeb53-0a8b-40d2-8956-c83dd1ce3a0c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:27.699959 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:27.743110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a3cb4-950e-491b-a7b2-896e1b5760f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:27.743751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a3cb4-950e-491b-a7b2-896e1b5760f8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:27.744040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a3cb4-950e-491b-a7b2-896e1b5760f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:27.744353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a3cb4-950e-491b-a7b2-896e1b5760f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:27.745551 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a3cb4-950e-491b-a7b2-896e1b5760f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:27.745916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a3cb4-950e-491b-a7b2-896e1b5760f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:27.748111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a3cb4-950e-491b-a7b2-896e1b5760f8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:27.761503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 621/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:27.767366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378286c-5d1e-4d63-8a63-5d5746c24abd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:27.776791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:27.884713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378286c-5d1e-4d63-8a63-5d5746c24abd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:27.922904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bdf62-fd43-4c93-9a3c-153f8910c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:27.923538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bdf62-fd43-4c93-9a3c-153f8910c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:27.923825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bdf62-fd43-4c93-9a3c-153f8910c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:27.924113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bdf62-fd43-4c93-9a3c-153f8910c4a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:27.932002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bdf62-fd43-4c93-9a3c-153f8910c4a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:27.933509 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bdf62-fd43-4c93-9a3c-153f8910c4a7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-790bdf62-fd43-4c93-9a3c-153f8910c4a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:43:27.945342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:27.946453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:27.947372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:43:27.947372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:43:27.947372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:43:27.947372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:43:27.947372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:43:27.947372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:43:27.947372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:43:27.947372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:27.947372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 609/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:43:27.952742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a3cb4-950e-491b-a7b2-896e1b5760f8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:28.067027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a3cb4-950e-491b-a7b2-896e1b5760f8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:28.106717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0856f94-e451-441c-93ca-28476cf2ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:28.107315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0856f94-e451-441c-93ca-28476cf2ca52 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:28.107601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0856f94-e451-441c-93ca-28476cf2ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:28.107884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0856f94-e451-441c-93ca-28476cf2ca52 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:28.108685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0856f94-e451-441c-93ca-28476cf2ca52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:28.109024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0856f94-e451-441c-93ca-28476cf2ca52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:28.110473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0856f94-e451-441c-93ca-28476cf2ca52 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:28.126265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 622/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:28.132284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bdf62-fd43-4c93-9a3c-153f8910c4a7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:28.209654 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:28.256955 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bdf62-fd43-4c93-9a3c-153f8910c4a7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:28.293882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763db02-23d9-4bf2-ae01-5daf31dd0913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:28.294549 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763db02-23d9-4bf2-ae01-5daf31dd0913 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:28.294844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763db02-23d9-4bf2-ae01-5daf31dd0913 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:28.295210 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763db02-23d9-4bf2-ae01-5daf31dd0913 None admin] PATH_INFO: `/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/cd9f2dc3c1c442b4b1b09964ff7c000b/roles/508a2d8d86e0445e83f4adfdbe4c1b43` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:28.313664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763db02-23d9-4bf2-ae01-5daf31dd0913 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e1649f32d3d494682dc06e05ae34f3d, user_id=cd9f2dc3c1c442b4b1b09964ff7c000b, role_id=508a2d8d86e0445e83f4adfdbe4c1b43)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:28.315541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763db02-23d9-4bf2-ae01-5daf31dd0913 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:28.331307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 610/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:43:28 2022] PUT /identity/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/cd9f2dc3c1c442b4b1b09964ff7c000b/roles/508a2d8d86e0445e83f4adfdbe4c1b43 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:43:30.666711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c54323-54a1-4114-bd42-e788667b0c92 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:30.667247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c54323-54a1-4114-bd42-e788667b0c92 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:30.667247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c54323-54a1-4114-bd42-e788667b0c92 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:30.668800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 623/1233] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:43:30.675413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306dbc6-015f-482d-8716-cf3df69f5adf None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:30.675866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306dbc6-015f-482d-8716-cf3df69f5adf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:30.675980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306dbc6-015f-482d-8716-cf3df69f5adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:30.698814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a306dbc6-015f-482d-8716-cf3df69f5adf None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:43:30.700017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a306dbc6-015f-482d-8716-cf3df69f5adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:43:30.786948 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 611/1234] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:43:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:43:30.816114 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c54323-54a1-4114-bd42-e788667b0c92 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:30.847921 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:30.943475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c54323-54a1-4114-bd42-e788667b0c92 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:30.985286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94176c2a-ce21-4740-a0e9-8742a567199a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:30.985949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94176c2a-ce21-4740-a0e9-8742a567199a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:30.986238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94176c2a-ce21-4740-a0e9-8742a567199a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:30.986519 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94176c2a-ce21-4740-a0e9-8742a567199a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:30.998332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94176c2a-ce21-4740-a0e9-8742a567199a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-94176c2a-ce21-4740-a0e9-8742a567199a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:43:31.003376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:31.006937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:31.007940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 624/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Aug 2 08:43:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:43:31.011692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306dbc6-015f-482d-8716-cf3df69f5adf None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:31.061603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:31.137340 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306dbc6-015f-482d-8716-cf3df69f5adf None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:31.176312 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af331039-6ee7-48de-ad24-cc33da4640dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:31.177463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af331039-6ee7-48de-ad24-cc33da4640dd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:31.177750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af331039-6ee7-48de-ad24-cc33da4640dd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:31.178030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af331039-6ee7-48de-ad24-cc33da4640dd None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:31.178744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af331039-6ee7-48de-ad24-cc33da4640dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:31.179052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af331039-6ee7-48de-ad24-cc33da4640dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:31.180454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af331039-6ee7-48de-ad24-cc33da4640dd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:31.188864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 612/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Aug 2 08:43:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:31.195144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94176c2a-ce21-4740-a0e9-8742a567199a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:31.293303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:31.323764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94176c2a-ce21-4740-a0e9-8742a567199a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:31.365397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787dcaa-a33b-43bc-9e22-8c07ef3abadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:31.366049 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787dcaa-a33b-43bc-9e22-8c07ef3abadb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:31.366329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787dcaa-a33b-43bc-9e22-8c07ef3abadb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:31.366606 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787dcaa-a33b-43bc-9e22-8c07ef3abadb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:31.382422 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787dcaa-a33b-43bc-9e22-8c07ef3abadb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:31.384308 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787dcaa-a33b-43bc-9e22-8c07ef3abadb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1787dcaa-a33b-43bc-9e22-8c07ef3abadb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:31.408097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:31.409120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:31.410044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:31.410044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:31.410044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:31.410044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:31.410044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 625/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:31.416243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af331039-6ee7-48de-ad24-cc33da4640dd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:31.534266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af331039-6ee7-48de-ad24-cc33da4640dd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:31.546347 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:31.574424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd07a5-ea4d-4047-9938-3f3f0ef3a73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:31.575297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd07a5-ea4d-4047-9938-3f3f0ef3a73d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:31.575709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd07a5-ea4d-4047-9938-3f3f0ef3a73d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:31.576059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd07a5-ea4d-4047-9938-3f3f0ef3a73d None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:31.577086 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd07a5-ea4d-4047-9938-3f3f0ef3a73d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:31.577616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd07a5-ea4d-4047-9938-3f3f0ef3a73d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:31.579786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd07a5-ea4d-4047-9938-3f3f0ef3a73d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:31.594356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 613/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:31.600919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787dcaa-a33b-43bc-9e22-8c07ef3abadb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:31.716406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787dcaa-a33b-43bc-9e22-8c07ef3abadb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:31.760945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a1f82-c295-4c1c-adf6-768ba5b445b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:31.762030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a1f82-c295-4c1c-adf6-768ba5b445b1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:31.762313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a1f82-c295-4c1c-adf6-768ba5b445b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:31.762595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a1f82-c295-4c1c-adf6-768ba5b445b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:31.766429 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:31.772995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a1f82-c295-4c1c-adf6-768ba5b445b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:31.774841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a1f82-c295-4c1c-adf6-768ba5b445b1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c47a1f82-c295-4c1c-adf6-768ba5b445b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:43:31.787996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:31.789926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:31.791100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:31.791100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:31.791100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:43:31.791100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:43:31.791100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:43:31.791100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:43:31.791100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:43:31.791100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:43:31.791100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:43:31.791100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:31.791100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 626/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:31.796169 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd07a5-ea4d-4047-9938-3f3f0ef3a73d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:31.912140 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd07a5-ea4d-4047-9938-3f3f0ef3a73d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:31.948486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec8afb-2d60-4526-be2b-8e176a2699a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:31.949103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec8afb-2d60-4526-be2b-8e176a2699a2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:31.949386 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec8afb-2d60-4526-be2b-8e176a2699a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:31.949660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec8afb-2d60-4526-be2b-8e176a2699a2 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:31.950451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec8afb-2d60-4526-be2b-8e176a2699a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:31.950760 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec8afb-2d60-4526-be2b-8e176a2699a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:31.952628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec8afb-2d60-4526-be2b-8e176a2699a2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:31.979945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 614/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Tue Aug 2 08:43:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:31.986288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a1f82-c295-4c1c-adf6-768ba5b445b1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:32.097722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a1f82-c295-4c1c-adf6-768ba5b445b1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:32.135867 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fb0ed-f2d7-4cfd-aa5a-19491b8a2d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:32.136524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fb0ed-f2d7-4cfd-aa5a-19491b8a2d3e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:32.136814 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fb0ed-f2d7-4cfd-aa5a-19491b8a2d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:32.137106 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fb0ed-f2d7-4cfd-aa5a-19491b8a2d3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:32.205636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:32.214003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fb0ed-f2d7-4cfd-aa5a-19491b8a2d3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:32.215508 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fb0ed-f2d7-4cfd-aa5a-19491b8a2d3e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:32.331657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 627/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:43:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:43:32.338301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec8afb-2d60-4526-be2b-8e176a2699a2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:32.370092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:32.479112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec8afb-2d60-4526-be2b-8e176a2699a2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:32.522600 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a9b19-add1-4f83-8742-d36c14d4f76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:32.523401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a9b19-add1-4f83-8742-d36c14d4f76b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:32.523686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a9b19-add1-4f83-8742-d36c14d4f76b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:32.523964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a9b19-add1-4f83-8742-d36c14d4f76b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:32.534713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a9b19-add1-4f83-8742-d36c14d4f76b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:32.536225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a9b19-add1-4f83-8742-d36c14d4f76b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-740a9b19-add1-4f83-8742-d36c14d4f76b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:32.554039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:32.555213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:32.556361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:32.556361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:32.556361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:32.556361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:32.556361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 615/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:32.561361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fb0ed-f2d7-4cfd-aa5a-19491b8a2d3e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:32.666395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:32.673686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fb0ed-f2d7-4cfd-aa5a-19491b8a2d3e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:32.716840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1a41f-38d6-4243-ba2d-e61c74cc74c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:32.717697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1a41f-38d6-4243-ba2d-e61c74cc74c1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:32.717800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1a41f-38d6-4243-ba2d-e61c74cc74c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:32.718093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1a41f-38d6-4243-ba2d-e61c74cc74c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:32.718887 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1a41f-38d6-4243-ba2d-e61c74cc74c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:32.719230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1a41f-38d6-4243-ba2d-e61c74cc74c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:32.720713 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1a41f-38d6-4243-ba2d-e61c74cc74c1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:32.733198 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 628/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:32.739215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a9b19-add1-4f83-8742-d36c14d4f76b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:32.839430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:32.863648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a9b19-add1-4f83-8742-d36c14d4f76b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:32.901685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d2ab1-3f28-4a78-99f3-b5681001749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:32.902327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d2ab1-3f28-4a78-99f3-b5681001749a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:32.902611 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d2ab1-3f28-4a78-99f3-b5681001749a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:32.902889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d2ab1-3f28-4a78-99f3-b5681001749a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:32.909721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d2ab1-3f28-4a78-99f3-b5681001749a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:32.911827 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d2ab1-3f28-4a78-99f3-b5681001749a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-103d2ab1-3f28-4a78-99f3-b5681001749a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:43:32.924269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:32.925372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:32.926439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:43:32.926439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:43:32.926439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:43:32.926439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:43:32.926439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:43:32.926439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:43:32.926439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:43:32.926439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:32.926439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 616/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:32.931999 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1a41f-38d6-4243-ba2d-e61c74cc74c1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:33.039274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1a41f-38d6-4243-ba2d-e61c74cc74c1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:33.078719 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa31a9-4bd6-4b82-b8b0-3b4d0bad5320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:33.079336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa31a9-4bd6-4b82-b8b0-3b4d0bad5320 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:33.079615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa31a9-4bd6-4b82-b8b0-3b4d0bad5320 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:33.079886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa31a9-4bd6-4b82-b8b0-3b4d0bad5320 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:33.080674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa31a9-4bd6-4b82-b8b0-3b4d0bad5320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:33.081009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa31a9-4bd6-4b82-b8b0-3b4d0bad5320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:33.082574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa31a9-4bd6-4b82-b8b0-3b4d0bad5320 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:33.097167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 629/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:33.104501 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d2ab1-3f28-4a78-99f3-b5681001749a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:33.220648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d2ab1-3f28-4a78-99f3-b5681001749a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:33.263007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa2833-dccf-4947-ad5a-75d2f0fa0ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:33.263807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2833-dccf-4947-ad5a-75d2f0fa0ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:33.264087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2833-dccf-4947-ad5a-75d2f0fa0ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:33.264394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2833-dccf-4947-ad5a-75d2f0fa0ad5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:33.265271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa2833-dccf-4947-ad5a-75d2f0fa0ad5 None admin] RBAC: Adding query filter params (role.id=508a2d8d86e0445e83f4adfdbe4c1b43, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=cd9f2dc3c1c442b4b1b09964ff7c000b) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:33.265656 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa2833-dccf-4947-ad5a-75d2f0fa0ad5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:33.267284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa2833-dccf-4947-ad5a-75d2f0fa0ad5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:33.276669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 617/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:43:33 2022] GET /identity/v3/role_assignments?user.id=cd9f2dc3c1c442b4b1b09964ff7c000b&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=508a2d8d86e0445e83f4adfdbe4c1b43 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:35.557387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46177ed-ebaa-4295-b775-8cbbce8fb5c5 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:35.557962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46177ed-ebaa-4295-b775-8cbbce8fb5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:35.557962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46177ed-ebaa-4295-b775-8cbbce8fb5c5 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:35.559581 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 630/1247] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:43:35.565380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3c602-23b1-477a-8edd-5cff65f10d58 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:35.565876 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3c602-23b1-477a-8edd-5cff65f10d58 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:35.566079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3c602-23b1-477a-8edd-5cff65f10d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:35.573989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:35.588032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-50b3c602-23b1-477a-8edd-5cff65f10d58 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:43:35.589268 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-50b3c602-23b1-477a-8edd-5cff65f10d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:43:35.664538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 618/1248] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:43:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:43:35.689777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46177ed-ebaa-4295-b775-8cbbce8fb5c5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:35.712145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:35.827928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46177ed-ebaa-4295-b775-8cbbce8fb5c5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:35.869020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb8d69-3512-495a-9a94-4223628d46ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:35.869755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb8d69-3512-495a-9a94-4223628d46ed None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:35.870036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb8d69-3512-495a-9a94-4223628d46ed None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:35.870315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb8d69-3512-495a-9a94-4223628d46ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:35.885205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb8d69-3512-495a-9a94-4223628d46ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-accb8d69-3512-495a-9a94-4223628d46ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:43:35.896269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:35.897641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:35.898703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 631/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:43:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:35.907243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3c602-23b1-477a-8edd-5cff65f10d58 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:36.026049 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3c602-23b1-477a-8edd-5cff65f10d58 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:36.060609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:36.066506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed72055-7699-425f-bf96-c1dd70d8b448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:36.067174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed72055-7699-425f-bf96-c1dd70d8b448 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:36.067492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed72055-7699-425f-bf96-c1dd70d8b448 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:36.067771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed72055-7699-425f-bf96-c1dd70d8b448 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:36.068613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed72055-7699-425f-bf96-c1dd70d8b448 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:36.068949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed72055-7699-425f-bf96-c1dd70d8b448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:36.070464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed72055-7699-425f-bf96-c1dd70d8b448 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:36.081444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 619/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:36.091008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb8d69-3512-495a-9a94-4223628d46ed None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:36.192952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:36.226188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb8d69-3512-495a-9a94-4223628d46ed None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:36.273164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b1f6f-42f0-4c90-89bb-b751dca48da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:36.273811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1f6f-42f0-4c90-89bb-b751dca48da3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:36.274095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1f6f-42f0-4c90-89bb-b751dca48da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:36.274375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1f6f-42f0-4c90-89bb-b751dca48da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:36.285802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b1f6f-42f0-4c90-89bb-b751dca48da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:36.288023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b1f6f-42f0-4c90-89bb-b751dca48da3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9f7b1f6f-42f0-4c90-89bb-b751dca48da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:36.304435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:36.306483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:36.308464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:36.308464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:36.308464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:36.308464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:36.308464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 632/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:36.312787 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed72055-7699-425f-bf96-c1dd70d8b448 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:36.456393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed72055-7699-425f-bf96-c1dd70d8b448 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:36.498168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccccd69-7e47-406e-a0d9-b94ed48e8f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:36.499679 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccccd69-7e47-406e-a0d9-b94ed48e8f81 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:36.500015 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccccd69-7e47-406e-a0d9-b94ed48e8f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:36.500345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccccd69-7e47-406e-a0d9-b94ed48e8f81 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:36.501060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccccd69-7e47-406e-a0d9-b94ed48e8f81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:36.501371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccccd69-7e47-406e-a0d9-b94ed48e8f81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:36.502783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccccd69-7e47-406e-a0d9-b94ed48e8f81 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:36.517414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 620/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:36.524139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b1f6f-42f0-4c90-89bb-b751dca48da3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:36.659705 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b1f6f-42f0-4c90-89bb-b751dca48da3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:36.696329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:36.706065 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53c29a-ab2f-44c7-af67-a942d4959434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:36.706777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53c29a-ab2f-44c7-af67-a942d4959434 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:36.707020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53c29a-ab2f-44c7-af67-a942d4959434 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:36.707296 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53c29a-ab2f-44c7-af67-a942d4959434 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:36.717783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53c29a-ab2f-44c7-af67-a942d4959434 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:36.719262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53c29a-ab2f-44c7-af67-a942d4959434 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ab53c29a-ab2f-44c7-af67-a942d4959434 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:43:36.731727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:36.732914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:36.739226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:36.739226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:36.739226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:43:36.739226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:43:36.739226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:43:36.739226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:43:36.739226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:43:36.739226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:43:36.739226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:43:36.739226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:36.739226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 633/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:36.739946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccccd69-7e47-406e-a0d9-b94ed48e8f81 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:36.802181 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:36.860143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccccd69-7e47-406e-a0d9-b94ed48e8f81 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:36.899978 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a0a67-9c5c-4259-be26-fefa9c16375c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:36.900676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a0a67-9c5c-4259-be26-fefa9c16375c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:36.900962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a0a67-9c5c-4259-be26-fefa9c16375c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:36.901236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a0a67-9c5c-4259-be26-fefa9c16375c None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:36.902104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a0a67-9c5c-4259-be26-fefa9c16375c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:36.902471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a0a67-9c5c-4259-be26-fefa9c16375c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:36.904330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a0a67-9c5c-4259-be26-fefa9c16375c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:36.926629 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 621/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Tue Aug 2 08:43:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:36.932927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53c29a-ab2f-44c7-af67-a942d4959434 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:37.052920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53c29a-ab2f-44c7-af67-a942d4959434 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:37.091206 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e212e-40cd-4188-b8cb-de65426f4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:37.091826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e212e-40cd-4188-b8cb-de65426f4b59 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:37.092176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e212e-40cd-4188-b8cb-de65426f4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:37.092589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e212e-40cd-4188-b8cb-de65426f4b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:37.173567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:37.195420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e212e-40cd-4188-b8cb-de65426f4b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:37.197108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e212e-40cd-4188-b8cb-de65426f4b59 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:37.320951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 634/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:43:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:43:37.327170 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a0a67-9c5c-4259-be26-fefa9c16375c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:37.454981 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a0a67-9c5c-4259-be26-fefa9c16375c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:37.469773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:37.497353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a62b7-2cf2-4aa7-aefa-9e3f89f9b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:37.498398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a62b7-2cf2-4aa7-aefa-9e3f89f9b28d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:37.498879 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a62b7-2cf2-4aa7-aefa-9e3f89f9b28d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:37.499366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a62b7-2cf2-4aa7-aefa-9e3f89f9b28d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:37.514834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a62b7-2cf2-4aa7-aefa-9e3f89f9b28d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:37.516988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a62b7-2cf2-4aa7-aefa-9e3f89f9b28d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-599a62b7-2cf2-4aa7-aefa-9e3f89f9b28d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:37.536937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:37.538029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:37.539114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:37.539114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:37.539114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:37.539114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:37.539114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 622/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:37.546284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e212e-40cd-4188-b8cb-de65426f4b59 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:37.650880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:37.666205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e212e-40cd-4188-b8cb-de65426f4b59 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:37.708528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bb692-7fa0-4a15-bab6-342b0f6a446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:37.709186 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb692-7fa0-4a15-bab6-342b0f6a446a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:37.709465 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb692-7fa0-4a15-bab6-342b0f6a446a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:37.709742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb692-7fa0-4a15-bab6-342b0f6a446a None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:37.710512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bb692-7fa0-4a15-bab6-342b0f6a446a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:37.710858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bb692-7fa0-4a15-bab6-342b0f6a446a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:37.712280 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bb692-7fa0-4a15-bab6-342b0f6a446a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:37.725584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 635/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:37.731803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a62b7-2cf2-4aa7-aefa-9e3f89f9b28d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:37.853676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a62b7-2cf2-4aa7-aefa-9e3f89f9b28d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:37.901807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06eae-22b3-4cd4-8084-778788345593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:37.902380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06eae-22b3-4cd4-8084-778788345593 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:37.902667 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06eae-22b3-4cd4-8084-778788345593 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:37.902941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06eae-22b3-4cd4-8084-778788345593 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:37.910585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f06eae-22b3-4cd4-8084-778788345593 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:37.912686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f06eae-22b3-4cd4-8084-778788345593 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-91f06eae-22b3-4cd4-8084-778788345593 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:43:37.924479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:37.925737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:37.927076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:43:37.927076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:43:37.927076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:43:37.927076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:43:37.927076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:43:37.927076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:43:37.927076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:43:37.927076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:37.927076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 623/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:37.932378 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bb692-7fa0-4a15-bab6-342b0f6a446a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:38.056423 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bb692-7fa0-4a15-bab6-342b0f6a446a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:38.095816 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf60dd-d35a-4e20-a573-f9bc81b86730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:38.096472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf60dd-d35a-4e20-a573-f9bc81b86730 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:38.096751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf60dd-d35a-4e20-a573-f9bc81b86730 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:38.097032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf60dd-d35a-4e20-a573-f9bc81b86730 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:38.097912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf60dd-d35a-4e20-a573-f9bc81b86730 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:38.098257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf60dd-d35a-4e20-a573-f9bc81b86730 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:38.100505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf60dd-d35a-4e20-a573-f9bc81b86730 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:38.113598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 636/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:38.119660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06eae-22b3-4cd4-8084-778788345593 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:38.146396 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:38.237736 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06eae-22b3-4cd4-8084-778788345593 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:38.280541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea05563-c078-4169-b250-1169a96d2c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:38.281155 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05563-c078-4169-b250-1169a96d2c13 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:38.281428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05563-c078-4169-b250-1169a96d2c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:38.281699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05563-c078-4169-b250-1169a96d2c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:38.282485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea05563-c078-4169-b250-1169a96d2c13 None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=cd9f2dc3c1c442b4b1b09964ff7c000b) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:38.282796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea05563-c078-4169-b250-1169a96d2c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:38.284491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea05563-c078-4169-b250-1169a96d2c13 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:38.291752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 624/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:43:38 2022] GET /identity/v3/role_assignments?user.id=cd9f2dc3c1c442b4b1b09964ff7c000b&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:40.393743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b603b7-ea6c-4036-954c-e88dedf9818e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:40.394335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b603b7-ea6c-4036-954c-e88dedf9818e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:40.394451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b603b7-ea6c-4036-954c-e88dedf9818e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:40.396632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 637/1261] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:43:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:43:40.402727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce1671-41ae-41b8-95b2-bc98fbd1c5c4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:40.403173 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce1671-41ae-41b8-95b2-bc98fbd1c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:40.403301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce1671-41ae-41b8-95b2-bc98fbd1c5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:40.422731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6dce1671-41ae-41b8-95b2-bc98fbd1c5c4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:43:40.423923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6dce1671-41ae-41b8-95b2-bc98fbd1c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:43:40.488576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 625/1262] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:43:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:43:40.511103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b603b7-ea6c-4036-954c-e88dedf9818e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:40.522509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:40.624072 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b603b7-ea6c-4036-954c-e88dedf9818e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:40.658102 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dfbaa-fe36-4c2a-ba64-9d39fc0674df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:40.658664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dfbaa-fe36-4c2a-ba64-9d39fc0674df None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:40.658943 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dfbaa-fe36-4c2a-ba64-9d39fc0674df None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:40.659215 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dfbaa-fe36-4c2a-ba64-9d39fc0674df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:40.668848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dfbaa-fe36-4c2a-ba64-9d39fc0674df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-259dfbaa-fe36-4c2a-ba64-9d39fc0674df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:43:40.673737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:40.675066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:40.676315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 638/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:40.680908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce1671-41ae-41b8-95b2-bc98fbd1c5c4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:40.699317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:40.779070 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce1671-41ae-41b8-95b2-bc98fbd1c5c4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:40.812505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f063ba-5a24-4664-afc6-c1a9d54d4c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:40.813130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f063ba-5a24-4664-afc6-c1a9d54d4c19 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:40.813411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f063ba-5a24-4664-afc6-c1a9d54d4c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:40.813687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f063ba-5a24-4664-afc6-c1a9d54d4c19 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:40.814400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f063ba-5a24-4664-afc6-c1a9d54d4c19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:40.814710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f063ba-5a24-4664-afc6-c1a9d54d4c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:40.816071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f063ba-5a24-4664-afc6-c1a9d54d4c19 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:40.824139 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 626/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:43:40.829818 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dfbaa-fe36-4c2a-ba64-9d39fc0674df None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:40.917505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:40.950060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dfbaa-fe36-4c2a-ba64-9d39fc0674df None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:40.982644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8485c1e-a3bb-4a24-8120-43789803669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:40.983268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8485c1e-a3bb-4a24-8120-43789803669b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:40.983548 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8485c1e-a3bb-4a24-8120-43789803669b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:40.983823 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8485c1e-a3bb-4a24-8120-43789803669b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:40.994115 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8485c1e-a3bb-4a24-8120-43789803669b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:40.995554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8485c1e-a3bb-4a24-8120-43789803669b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a8485c1e-a3bb-4a24-8120-43789803669b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:41.009227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:41.010276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:41.011258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:41.011258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:41.011258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:41.011258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:41.011258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 639/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:41.016581 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f063ba-5a24-4664-afc6-c1a9d54d4c19 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:41.101789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:41.121450 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f063ba-5a24-4664-afc6-c1a9d54d4c19 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:41.153739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e9c3-8dc3-47a9-9710-705bc537df44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:41.154344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e9c3-8dc3-47a9-9710-705bc537df44 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:41.154623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e9c3-8dc3-47a9-9710-705bc537df44 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:41.154893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e9c3-8dc3-47a9-9710-705bc537df44 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:41.155572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e9c3-8dc3-47a9-9710-705bc537df44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:41.155874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e9c3-8dc3-47a9-9710-705bc537df44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:41.157252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e9c3-8dc3-47a9-9710-705bc537df44 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:41.169245 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 627/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:43:41.174896 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8485c1e-a3bb-4a24-8120-43789803669b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:41.271795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8485c1e-a3bb-4a24-8120-43789803669b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:41.290775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:41.305474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627e576-6827-4b95-8dee-43d0aabc638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:41.306103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e576-6827-4b95-8dee-43d0aabc638a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:41.306385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e576-6827-4b95-8dee-43d0aabc638a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:41.306730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e576-6827-4b95-8dee-43d0aabc638a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:41.313949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627e576-6827-4b95-8dee-43d0aabc638a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:41.315394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627e576-6827-4b95-8dee-43d0aabc638a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f627e576-6827-4b95-8dee-43d0aabc638a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:43:41.326406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:41.327371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:41.328640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:41.328640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:41.328640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:43:41.328640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:43:41.328640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:43:41.328640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:43:41.328640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:43:41.328640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:43:41.328640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:43:41.328640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:41.328640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 640/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:41.333589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e9c3-8dc3-47a9-9710-705bc537df44 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:41.445136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e9c3-8dc3-47a9-9710-705bc537df44 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:41.477788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4009cf7-799e-47d5-8e41-9d657cb6e03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:41.478487 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4009cf7-799e-47d5-8e41-9d657cb6e03e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:41.478765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4009cf7-799e-47d5-8e41-9d657cb6e03e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:41.479039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4009cf7-799e-47d5-8e41-9d657cb6e03e None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:41.479820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4009cf7-799e-47d5-8e41-9d657cb6e03e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:41.480149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4009cf7-799e-47d5-8e41-9d657cb6e03e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:41.481571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4009cf7-799e-47d5-8e41-9d657cb6e03e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:41.490695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:41.499042 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 628/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Tue Aug 2 08:43:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:41.504732 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627e576-6827-4b95-8dee-43d0aabc638a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:41.603003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627e576-6827-4b95-8dee-43d0aabc638a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:41.635039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945b06c-0c24-4df1-a06f-0ae902b527fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:41.635664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945b06c-0c24-4df1-a06f-0ae902b527fc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:41.635942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945b06c-0c24-4df1-a06f-0ae902b527fc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:41.636243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945b06c-0c24-4df1-a06f-0ae902b527fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:41.646870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945b06c-0c24-4df1-a06f-0ae902b527fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:41.648343 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945b06c-0c24-4df1-a06f-0ae902b527fc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-0945b06c-0c24-4df1-a06f-0ae902b527fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:41.662659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:41.663695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:41.664905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:41.664905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:41.664905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:41.664905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:41.664905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 641/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:41.669448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4009cf7-799e-47d5-8e41-9d657cb6e03e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:41.765804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4009cf7-799e-47d5-8e41-9d657cb6e03e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:41.800551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2e2dc-9504-4acf-a7ac-5cc6cfe25629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:41.801179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2e2dc-9504-4acf-a7ac-5cc6cfe25629 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:41.801463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2e2dc-9504-4acf-a7ac-5cc6cfe25629 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:41.801740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2e2dc-9504-4acf-a7ac-5cc6cfe25629 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:41.802443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2e2dc-9504-4acf-a7ac-5cc6cfe25629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:41.802745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2e2dc-9504-4acf-a7ac-5cc6cfe25629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:41.804153 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2e2dc-9504-4acf-a7ac-5cc6cfe25629 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:41.817905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 629/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:41.823751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945b06c-0c24-4df1-a06f-0ae902b527fc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:41.856349 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:41.930959 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945b06c-0c24-4df1-a06f-0ae902b527fc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:41.967049 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e5df-19e5-4cd9-8934-ee62dd13339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:41.967700 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e5df-19e5-4cd9-8934-ee62dd13339e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:41.967987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e5df-19e5-4cd9-8934-ee62dd13339e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:41.968297 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e5df-19e5-4cd9-8934-ee62dd13339e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:41.975008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5e5df-19e5-4cd9-8934-ee62dd13339e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:41.976480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5e5df-19e5-4cd9-8934-ee62dd13339e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-2bd5e5df-19e5-4cd9-8934-ee62dd13339e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:43:41.988450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:41.989675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:41.990589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:43:41.990589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:43:41.990589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:43:41.990589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:43:41.990589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:43:41.990589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:43:41.990589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:43:41.990589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:41.990589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 642/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:41.995819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2e2dc-9504-4acf-a7ac-5cc6cfe25629 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:42.061017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:42.104622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2e2dc-9504-4acf-a7ac-5cc6cfe25629 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:42.138268 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d5434-5637-4f3e-b8ee-00634acd04cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:42.138953 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d5434-5637-4f3e-b8ee-00634acd04cd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:42.139233 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d5434-5637-4f3e-b8ee-00634acd04cd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:42.139607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d5434-5637-4f3e-b8ee-00634acd04cd None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:42.140384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d5434-5637-4f3e-b8ee-00634acd04cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:42.140759 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d5434-5637-4f3e-b8ee-00634acd04cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:42.142380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d5434-5637-4f3e-b8ee-00634acd04cd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:42.156484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 630/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:42.162806 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e5df-19e5-4cd9-8934-ee62dd13339e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:42.258035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:42.266873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e5df-19e5-4cd9-8934-ee62dd13339e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:42.298606 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7950f64-d6c8-4ccd-91a7-44ab89062d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:42.299270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950f64-d6c8-4ccd-91a7-44ab89062d1d None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:42.299585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950f64-d6c8-4ccd-91a7-44ab89062d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:42.299864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950f64-d6c8-4ccd-91a7-44ab89062d1d None admin] PATH_INFO: `/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/cd9f2dc3c1c442b4b1b09964ff7c000b/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:42.302294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7950f64-d6c8-4ccd-91a7-44ab89062d1d None admin] RBAC: Authorizing `identity:create_grant(project_id=7e1649f32d3d494682dc06e05ae34f3d, user_id=cd9f2dc3c1c442b4b1b09964ff7c000b, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:42.303732 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7950f64-d6c8-4ccd-91a7-44ab89062d1d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:42.316625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 643/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Aug 2 08:43:42 2022] PUT /identity/v3/projects/7e1649f32d3d494682dc06e05ae34f3d/users/cd9f2dc3c1c442b4b1b09964ff7c000b/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:43:44.346266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5d0b3-99cc-42b9-a815-24eb23ba9104 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:44.346821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5d0b3-99cc-42b9-a815-24eb23ba9104 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:44.346821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5d0b3-99cc-42b9-a815-24eb23ba9104 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:44.348265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 631/1274] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:43:44.354466 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec164a97-5992-421e-a46e-1821fa6180ce None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:44.355112 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec164a97-5992-421e-a46e-1821fa6180ce None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:44.355112 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec164a97-5992-421e-a46e-1821fa6180ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:44.374442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ec164a97-5992-421e-a46e-1821fa6180ce None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:43:44.375662 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ec164a97-5992-421e-a46e-1821fa6180ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:43:44.448993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 644/1275] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:43:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:43:44.475998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5d0b3-99cc-42b9-a815-24eb23ba9104 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:44.579655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5d0b3-99cc-42b9-a815-24eb23ba9104 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:44.598223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:44.618740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc336f-cb84-40fc-8b42-6f34589db2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:44.619383 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc336f-cb84-40fc-8b42-6f34589db2ee None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:44.619665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc336f-cb84-40fc-8b42-6f34589db2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:44.619942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc336f-cb84-40fc-8b42-6f34589db2ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:44.630566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc336f-cb84-40fc-8b42-6f34589db2ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-15dc336f-cb84-40fc-8b42-6f34589db2ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:43:44.635519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:44.636664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:44.637548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 632/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Aug 2 08:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:44.642873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec164a97-5992-421e-a46e-1821fa6180ce None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:44.726399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:44.747080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec164a97-5992-421e-a46e-1821fa6180ce None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:44.781350 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1e282-3e1f-4de0-a33b-c9bb6cb31574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:44.781973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e282-3e1f-4de0-a33b-c9bb6cb31574 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:44.782260 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e282-3e1f-4de0-a33b-c9bb6cb31574 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:44.782538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e282-3e1f-4de0-a33b-c9bb6cb31574 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:44.783255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1e282-3e1f-4de0-a33b-c9bb6cb31574 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:44.783562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1e282-3e1f-4de0-a33b-c9bb6cb31574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:44.784960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1e282-3e1f-4de0-a33b-c9bb6cb31574 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:44.793725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 645/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Aug 2 08:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:44.799755 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc336f-cb84-40fc-8b42-6f34589db2ee None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:44.901312 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc336f-cb84-40fc-8b42-6f34589db2ee None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:44.933557 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a6363-8097-4bd4-a62e-5b8b9242c257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:44.934188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6363-8097-4bd4-a62e-5b8b9242c257 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:44.934470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6363-8097-4bd4-a62e-5b8b9242c257 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:44.934743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6363-8097-4bd4-a62e-5b8b9242c257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:44.944864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a6363-8097-4bd4-a62e-5b8b9242c257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:44.946303 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a6363-8097-4bd4-a62e-5b8b9242c257 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b11a6363-8097-4bd4-a62e-5b8b9242c257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:44.961033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:44.963044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:44.964352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:44.964352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:44.964352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:44.964352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:44.964352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 633/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:44.969285 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1e282-3e1f-4de0-a33b-c9bb6cb31574 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:45.067099 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1e282-3e1f-4de0-a33b-c9bb6cb31574 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:45.100149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff926b8-a821-4f49-ab80-779dd8fd00c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:45.100769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff926b8-a821-4f49-ab80-779dd8fd00c4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:45.101054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff926b8-a821-4f49-ab80-779dd8fd00c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:45.101330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff926b8-a821-4f49-ab80-779dd8fd00c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:45.102021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff926b8-a821-4f49-ab80-779dd8fd00c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:45.102331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff926b8-a821-4f49-ab80-779dd8fd00c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:45.103703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff926b8-a821-4f49-ab80-779dd8fd00c4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:45.115278 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 646/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:45.121057 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a6363-8097-4bd4-a62e-5b8b9242c257 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:45.152189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:45.220483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a6363-8097-4bd4-a62e-5b8b9242c257 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:45.261839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6f3e7-b918-4829-939a-98e2cc251474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:45.262482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6f3e7-b918-4829-939a-98e2cc251474 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:45.262777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6f3e7-b918-4829-939a-98e2cc251474 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:45.263057 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6f3e7-b918-4829-939a-98e2cc251474 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:45.278063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6f3e7-b918-4829-939a-98e2cc251474 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:45.279509 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6f3e7-b918-4829-939a-98e2cc251474 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-76f6f3e7-b918-4829-939a-98e2cc251474 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:43:45.295238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:45.296476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:45.297488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:45.297488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:45.297488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:43:45.297488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:43:45.297488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:43:45.297488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:43:45.297488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:43:45.297488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:43:45.297488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:43:45.297488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:45.297488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 634/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:45.302758 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff926b8-a821-4f49-ab80-779dd8fd00c4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:45.306797 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:45.408693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff926b8-a821-4f49-ab80-779dd8fd00c4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:45.441880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fcf5a-1187-4224-a496-f6440ddc01c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:45.443115 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fcf5a-1187-4224-a496-f6440ddc01c2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:45.443394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fcf5a-1187-4224-a496-f6440ddc01c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:45.443665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fcf5a-1187-4224-a496-f6440ddc01c2 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:45.444483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fcf5a-1187-4224-a496-f6440ddc01c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:45.444789 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fcf5a-1187-4224-a496-f6440ddc01c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:45.446207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fcf5a-1187-4224-a496-f6440ddc01c2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:45.464338 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 647/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Tue Aug 2 08:43:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:45.470082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6f3e7-b918-4829-939a-98e2cc251474 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:45.568874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:45.578983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6f3e7-b918-4829-939a-98e2cc251474 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:45.621825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c0387-fa78-4120-82e6-5542ef73923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:45.622462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c0387-fa78-4120-82e6-5542ef73923e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:45.622747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c0387-fa78-4120-82e6-5542ef73923e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:45.623026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c0387-fa78-4120-82e6-5542ef73923e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:45.690826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c0387-fa78-4120-82e6-5542ef73923e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:45.692243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c0387-fa78-4120-82e6-5542ef73923e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:45.777548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:45.788858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 635/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Aug 2 08:43:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:43:45.794668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fcf5a-1187-4224-a496-f6440ddc01c2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:45.854894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:45.893045 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fcf5a-1187-4224-a496-f6440ddc01c2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:45.926247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b291d-dfe0-4a20-a42e-481559d0d192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:45.927472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b291d-dfe0-4a20-a42e-481559d0d192 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:45.927756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b291d-dfe0-4a20-a42e-481559d0d192 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:45.928030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b291d-dfe0-4a20-a42e-481559d0d192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:45.937857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b291d-dfe0-4a20-a42e-481559d0d192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:45.939306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b291d-dfe0-4a20-a42e-481559d0d192 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-287b291d-dfe0-4a20-a42e-481559d0d192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:43:45.955947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:45.956909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:45.957849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:43:45.957849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:43:45.957849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:43:45.957849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:45.957849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 648/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:45.963200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c0387-fa78-4120-82e6-5542ef73923e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:46.062502 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c0387-fa78-4120-82e6-5542ef73923e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:46.096038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a39ee-91d4-494b-9210-21ada30c938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:46.096678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a39ee-91d4-494b-9210-21ada30c938f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:46.096963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a39ee-91d4-494b-9210-21ada30c938f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:46.097238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a39ee-91d4-494b-9210-21ada30c938f None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:46.097926 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a39ee-91d4-494b-9210-21ada30c938f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:46.098231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a39ee-91d4-494b-9210-21ada30c938f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:46.100299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a39ee-91d4-494b-9210-21ada30c938f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:46.111204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 636/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Aug 2 08:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:46.116949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b291d-dfe0-4a20-a42e-481559d0d192 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:46.214040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b291d-dfe0-4a20-a42e-481559d0d192 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:46.227532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:46.247092 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93832bd-0278-46b5-bf31-920f7064d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:46.247722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93832bd-0278-46b5-bf31-920f7064d4fc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:46.248005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93832bd-0278-46b5-bf31-920f7064d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:46.248320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93832bd-0278-46b5-bf31-920f7064d4fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:46.254783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93832bd-0278-46b5-bf31-920f7064d4fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:46.256272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93832bd-0278-46b5-bf31-920f7064d4fc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e93832bd-0278-46b5-bf31-920f7064d4fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:43:46.267345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:46.268413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:46.269596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:43:46.269596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:43:46.269596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:43:46.269596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:43:46.269596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:43:46.269596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:43:46.269596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:43:46.269596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: ERROR keystone.server.flask.application Aug 02 08:43:46.269596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 649/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Aug 2 08:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:46.274812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a39ee-91d4-494b-9210-21ada30c938f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:46.323342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:46.377025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a39ee-91d4-494b-9210-21ada30c938f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:46.410885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafe856-a904-423d-b038-0aa5621e2d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:46.411496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafe856-a904-423d-b038-0aa5621e2d54 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:46.411778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafe856-a904-423d-b038-0aa5621e2d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:46.412052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafe856-a904-423d-b038-0aa5621e2d54 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:46.412823 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafe856-a904-423d-b038-0aa5621e2d54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:46.413131 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafe856-a904-423d-b038-0aa5621e2d54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:46.414547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafe856-a904-423d-b038-0aa5621e2d54 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:46.426145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 637/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Aug 2 08:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:46.432299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93832bd-0278-46b5-bf31-920f7064d4fc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:46.531757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93832bd-0278-46b5-bf31-920f7064d4fc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:46.564054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91108c-3741-45f5-8d8f-e0cbcb49cae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:46.564702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91108c-3741-45f5-8d8f-e0cbcb49cae4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:46.564989 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91108c-3741-45f5-8d8f-e0cbcb49cae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:46.565270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91108c-3741-45f5-8d8f-e0cbcb49cae4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:46.566054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91108c-3741-45f5-8d8f-e0cbcb49cae4 None admin] RBAC: Adding query filter params (role.id=55eadb7f82cc444296a433ecdbcdb69b, scope.project.id=7e1649f32d3d494682dc06e05ae34f3d, user.id=cd9f2dc3c1c442b4b1b09964ff7c000b) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:46.566371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91108c-3741-45f5-8d8f-e0cbcb49cae4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:46.568333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91108c-3741-45f5-8d8f-e0cbcb49cae4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:46.574061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 650/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Aug 2 08:43:46 2022] GET /identity/v3/role_assignments?user.id=cd9f2dc3c1c442b4b1b09964ff7c000b&scope.project.id=7e1649f32d3d494682dc06e05ae34f3d&role.id=55eadb7f82cc444296a433ecdbcdb69b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:43:48.588547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a781-77a3-40df-9c10-43c5bef16853 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:48.589073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a781-77a3-40df-9c10-43c5bef16853 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:48.589073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a781-77a3-40df-9c10-43c5bef16853 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:48.590421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 638/1288] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:43:48.595536 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f5078-50cd-400d-937b-d8965b5df959 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:48.595966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f5078-50cd-400d-937b-d8965b5df959 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:48.596096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f5078-50cd-400d-937b-d8965b5df959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:48.614539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c29f5078-50cd-400d-937b-d8965b5df959 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:43:48.615713 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c29f5078-50cd-400d-937b-d8965b5df959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:43:48.644563 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:48.684923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 651/1289] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:43:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:43:48.706554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a781-77a3-40df-9c10-43c5bef16853 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:48.808095 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a781-77a3-40df-9c10-43c5bef16853 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:48.818964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:48.842230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89366488-ed42-4224-9754-3402001d4057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:48.842803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89366488-ed42-4224-9754-3402001d4057 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:48.843089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89366488-ed42-4224-9754-3402001d4057 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:48.843365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89366488-ed42-4224-9754-3402001d4057 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:48.843994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89366488-ed42-4224-9754-3402001d4057 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:48.845412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89366488-ed42-4224-9754-3402001d4057 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-89366488-ed42-4224-9754-3402001d4057 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:48.854815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:48.856077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:48.857160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 639/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Aug 2 08:43:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:48.862087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f5078-50cd-400d-937b-d8965b5df959 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:48.960140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f5078-50cd-400d-937b-d8965b5df959 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:48.994449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d981752-fecf-48aa-a35d-8daa1ce3d6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:48.995058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d981752-fecf-48aa-a35d-8daa1ce3d6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:48.995346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d981752-fecf-48aa-a35d-8daa1ce3d6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:48.995611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d981752-fecf-48aa-a35d-8daa1ce3d6f2 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:48.996314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d981752-fecf-48aa-a35d-8daa1ce3d6f2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:48.996622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d981752-fecf-48aa-a35d-8daa1ce3d6f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:48.997981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d981752-fecf-48aa-a35d-8daa1ce3d6f2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:49.002679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 652/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Tue Aug 2 08:43:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:49.008636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89366488-ed42-4224-9754-3402001d4057 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:49.107900 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89366488-ed42-4224-9754-3402001d4057 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:49.140676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa4456-8dc9-43aa-98ef-699d1323046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:49.141282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa4456-8dc9-43aa-98ef-699d1323046e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:49.141566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa4456-8dc9-43aa-98ef-699d1323046e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:49.141843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa4456-8dc9-43aa-98ef-699d1323046e None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:49.142519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa4456-8dc9-43aa-98ef-699d1323046e None admin] RBAC: Adding query filter params (type=placement) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:49.142830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa4456-8dc9-43aa-98ef-699d1323046e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:49.144213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa4456-8dc9-43aa-98ef-699d1323046e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:49.149125 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 640/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Tue Aug 2 08:43:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:51.147725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30740b4b-1759-465a-82e5-1689462863ff None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:51.148275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30740b4b-1759-465a-82e5-1689462863ff None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:51.148275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30740b4b-1759-465a-82e5-1689462863ff None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:51.149613 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 653/1293] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:43:51.154740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742d489-9db8-4010-aa04-9df6bd748b07 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:51.155175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742d489-9db8-4010-aa04-9df6bd748b07 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:51.155306 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742d489-9db8-4010-aa04-9df6bd748b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:51.173765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8742d489-9db8-4010-aa04-9df6bd748b07 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:43:51.174950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8742d489-9db8-4010-aa04-9df6bd748b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:43:51.204044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:51.241360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 641/1294] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:43:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:43:51.263670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30740b4b-1759-465a-82e5-1689462863ff None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:51.298311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:51.370901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30740b4b-1759-465a-82e5-1689462863ff None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:51.408159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229216b-70f9-42a8-ab25-f1a5e25f2d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:51.408866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229216b-70f9-42a8-ab25-f1a5e25f2d25 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:51.409233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229216b-70f9-42a8-ab25-f1a5e25f2d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:51.409582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229216b-70f9-42a8-ab25-f1a5e25f2d25 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:51.410412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229216b-70f9-42a8-ab25-f1a5e25f2d25 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:51.412752 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229216b-70f9-42a8-ab25-f1a5e25f2d25 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:51.430744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 654/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Aug 2 08:43:51 2022] POST /identity/v3/services => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:43:53.432931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dc907-f04a-4296-8f64-e124439618bf None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:53.433461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dc907-f04a-4296-8f64-e124439618bf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:53.433554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dc907-f04a-4296-8f64-e124439618bf None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:53.434847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 642/1296] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:43:53.439971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f63f96-5976-4c41-95f8-5541d2c3e951 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:53.440440 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f63f96-5976-4c41-95f8-5541d2c3e951 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:53.440575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f63f96-5976-4c41-95f8-5541d2c3e951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:53.458322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-31f63f96-5976-4c41-95f8-5541d2c3e951 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:43:53.459495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-31f63f96-5976-4c41-95f8-5541d2c3e951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:43:53.531445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 655/1297] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:43:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:43:53.555311 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dc907-f04a-4296-8f64-e124439618bf None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:53.655459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dc907-f04a-4296-8f64-e124439618bf None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:53.688274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899df96-8e84-4134-84ea-4994d83f2a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:53.688843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899df96-8e84-4134-84ea-4994d83f2a94 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:53.689126 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899df96-8e84-4134-84ea-4994d83f2a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:53.689399 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899df96-8e84-4134-84ea-4994d83f2a94 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:53.690011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899df96-8e84-4134-84ea-4994d83f2a94 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:53.691369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899df96-8e84-4134-84ea-4994d83f2a94 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9899df96-8e84-4134-84ea-4994d83f2a94 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:53.700576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:53.701806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:53.703030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 643/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Aug 2 08:43:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:53.718019 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f63f96-5976-4c41-95f8-5541d2c3e951 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:53.737807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:53.816307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f63f96-5976-4c41-95f8-5541d2c3e951 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:53.849271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac10e8-749e-4543-a7bd-71e1bf44137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:53.849880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac10e8-749e-4543-a7bd-71e1bf44137c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:53.850161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac10e8-749e-4543-a7bd-71e1bf44137c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:53.850432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac10e8-749e-4543-a7bd-71e1bf44137c None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:53.851101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac10e8-749e-4543-a7bd-71e1bf44137c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:53.851404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac10e8-749e-4543-a7bd-71e1bf44137c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:53.852794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac10e8-749e-4543-a7bd-71e1bf44137c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:53.857810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 656/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Tue Aug 2 08:43:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:53.863789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899df96-8e84-4134-84ea-4994d83f2a94 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:53.895922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:53.964090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899df96-8e84-4134-84ea-4994d83f2a94 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:53.997300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da0b6a-a226-471f-af32-34385bba0738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:53.997906 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da0b6a-a226-471f-af32-34385bba0738 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:53.998190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da0b6a-a226-471f-af32-34385bba0738 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:53.998469 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da0b6a-a226-471f-af32-34385bba0738 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:53.999220 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da0b6a-a226-471f-af32-34385bba0738 None admin] RBAC: Adding query filter params (interface=public, service_id=e64c53d8a01a464d93a7f73e9c538014, region_id=RegionOne) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:53.999534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da0b6a-a226-471f-af32-34385bba0738 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:54.001002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da0b6a-a226-471f-af32-34385bba0738 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:54.005962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 644/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Aug 2 08:43:53 2022] GET /identity/v3/endpoints?service_id=e64c53d8a01a464d93a7f73e9c538014&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:54.012618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac10e8-749e-4543-a7bd-71e1bf44137c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:54.093426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:54.115790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac10e8-749e-4543-a7bd-71e1bf44137c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:54.150618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b687d3a-5684-4e1f-b3eb-75277f3ad5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:54.151231 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b687d3a-5684-4e1f-b3eb-75277f3ad5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:54.151516 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b687d3a-5684-4e1f-b3eb-75277f3ad5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:54.151794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b687d3a-5684-4e1f-b3eb-75277f3ad5c6 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:54.152472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b687d3a-5684-4e1f-b3eb-75277f3ad5c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:54.153840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b687d3a-5684-4e1f-b3eb-75277f3ad5c6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:54.162281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 657/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Aug 2 08:43:54 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:43:56.174612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64031701-e666-4add-b3ad-bb496325d5a3 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:56.175121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64031701-e666-4add-b3ad-bb496325d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:56.175121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64031701-e666-4add-b3ad-bb496325d5a3 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:56.177312 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 645/1302] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:43:56.182395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6daef2-0498-4380-8ff3-34dca09ef3fc None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:56.182783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6daef2-0498-4380-8ff3-34dca09ef3fc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:56.182958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6daef2-0498-4380-8ff3-34dca09ef3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:56.200464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5c6daef2-0498-4380-8ff3-34dca09ef3fc None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:43:56.201638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5c6daef2-0498-4380-8ff3-34dca09ef3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:43:56.266144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 658/1303] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:43:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:43:56.289246 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64031701-e666-4add-b3ad-bb496325d5a3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:56.417961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:56.425559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64031701-e666-4add-b3ad-bb496325d5a3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:56.459228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a0fa9-6316-4a41-9651-83edfde0c7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:56.459858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a0fa9-6316-4a41-9651-83edfde0c7cb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:56.460161 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a0fa9-6316-4a41-9651-83edfde0c7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:56.460443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a0fa9-6316-4a41-9651-83edfde0c7cb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:56.461065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a0fa9-6316-4a41-9651-83edfde0c7cb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:56.462504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a0fa9-6316-4a41-9651-83edfde0c7cb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b98a0fa9-6316-4a41-9651-83edfde0c7cb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:43:56.471160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:43:56.472363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: ERROR keystone.server.flask.application Aug 02 08:43:56.474084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 646/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Aug 2 08:43:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:43:56.478945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6daef2-0498-4380-8ff3-34dca09ef3fc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:56.555746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:43:56.578562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6daef2-0498-4380-8ff3-34dca09ef3fc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:56.613272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dc666-526a-4222-be48-964a0b7257b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:56.613878 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dc666-526a-4222-be48-964a0b7257b0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:56.614158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dc666-526a-4222-be48-964a0b7257b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:56.614448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dc666-526a-4222-be48-964a0b7257b0 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:56.615147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dc666-526a-4222-be48-964a0b7257b0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:43:56.615454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dc666-526a-4222-be48-964a0b7257b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:56.616857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dc666-526a-4222-be48-964a0b7257b0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:56.621890 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 659/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Tue Aug 2 08:43:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:43:56.627822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a0fa9-6316-4a41-9651-83edfde0c7cb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:43:56.729109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a0fa9-6316-4a41-9651-83edfde0c7cb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:43:56.762222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793e4cb-125f-46e2-9800-b6b732511386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:43:56.762827 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793e4cb-125f-46e2-9800-b6b732511386 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:43:56.763108 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793e4cb-125f-46e2-9800-b6b732511386 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:43:56.763384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793e4cb-125f-46e2-9800-b6b732511386 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:43:56.764078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793e4cb-125f-46e2-9800-b6b732511386 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:43:56.765464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793e4cb-125f-46e2-9800-b6b732511386 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:43:56.784861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 647/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:43:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:44:06.619472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=30 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:44:06.781346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:01.788943 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394403e1-87b3-49bf-84fb-7dd0641b8b90 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:01.789481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394403e1-87b3-49bf-84fb-7dd0641b8b90 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:01.789481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394403e1-87b3-49bf-84fb-7dd0641b8b90 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:01.791554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 660/1307] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:01.797286 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd086a-61ed-4e6f-b38a-faf392cc13ae None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:01.797819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd086a-61ed-4e6f-b38a-faf392cc13ae None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:01.797819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd086a-61ed-4e6f-b38a-faf392cc13ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:01.938478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-20cd086a-61ed-4e6f-b38a-faf392cc13ae None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:01.939882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-20cd086a-61ed-4e6f-b38a-faf392cc13ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:02.084978 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 648/1308] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:02.152052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df04b0d-dbd3-40bf-80d8-0fbcb54dfb63 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:02.152408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df04b0d-dbd3-40bf-80d8-0fbcb54dfb63 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:02.152733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df04b0d-dbd3-40bf-80d8-0fbcb54dfb63 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:02.154311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 661/1309] 10.222.0.17 () {54 vars in 965 bytes} [Tue Aug 2 08:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:02.167689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eaa8f-c2d7-4b97-8c82-5ac1b1bd24e7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:02.167843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eaa8f-c2d7-4b97-8c82-5ac1b1bd24e7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:02.168150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eaa8f-c2d7-4b97-8c82-5ac1b1bd24e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:02.297917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d47eaa8f-c2d7-4b97-8c82-5ac1b1bd24e7 None None] MFA Rules not processed for user `c9162dcfb8d542679c7217fae8f5c185`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:02.299321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d47eaa8f-c2d7-4b97-8c82-5ac1b1bd24e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:02.324723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:02.403945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 649/1310] 10.222.0.17 () {58 vars in 1062 bytes} [Tue Aug 2 08:45:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:45:02.414067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df04b0d-dbd3-40bf-80d8-0fbcb54dfb63 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:02.416529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5df04b0d-dbd3-40bf-80d8-0fbcb54dfb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:02.544488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df04b0d-dbd3-40bf-80d8-0fbcb54dfb63 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:02.621836 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bcb3f-755e-407c-954d-dd121491f4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:02.622377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bcb3f-755e-407c-954d-dd121491f4eb service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:02.622656 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bcb3f-755e-407c-954d-dd121491f4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:02.622927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bcb3f-755e-407c-954d-dd121491f4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:02.624581 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-119bcb3f-755e-407c-954d-dd121491f4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:02.682038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:02.741860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bcb3f-755e-407c-954d-dd121491f4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:02.743313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bcb3f-755e-407c-954d-dd121491f4eb service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:02.763499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 662/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:05.078358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed008e-6ff8-4a17-ba02-6cc44c7d50f2 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:05.078834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed008e-6ff8-4a17-ba02-6cc44c7d50f2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:05.078946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed008e-6ff8-4a17-ba02-6cc44c7d50f2 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:05.080286 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 650/1312] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:05.086135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d216081-0f78-4787-b039-d62e6b9a3681 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:05.086767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d216081-0f78-4787-b039-d62e6b9a3681 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:05.086767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d216081-0f78-4787-b039-d62e6b9a3681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:05.161088 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2d216081-0f78-4787-b039-d62e6b9a3681 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:05.162313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2d216081-0f78-4787-b039-d62e6b9a3681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:05.261776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 663/1313] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:05.300037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed008e-6ff8-4a17-ba02-6cc44c7d50f2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:05.301634 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6fed008e-6ff8-4a17-ba02-6cc44c7d50f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:05.436854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed008e-6ff8-4a17-ba02-6cc44c7d50f2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:05.508811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:05.511549 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e7755-31da-406e-95cf-2e489355a7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:05.512222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e7755-31da-406e-95cf-2e489355a7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:05.512720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e7755-31da-406e-95cf-2e489355a7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:05.513218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e7755-31da-406e-95cf-2e489355a7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:05.515099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-be3e7755-31da-406e-95cf-2e489355a7f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:05.640932 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e7755-31da-406e-95cf-2e489355a7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:05.642372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e7755-31da-406e-95cf-2e489355a7f2 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:05.662487 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 651/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:08.036198 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98161-5362-4e08-9ac6-aa988ade5db6 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:08.036674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98161-5362-4e08-9ac6-aa988ade5db6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:08.036768 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98161-5362-4e08-9ac6-aa988ade5db6 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:08.038109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 664/1315] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:08.043534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af1bf8-720e-40c9-b6b2-4826c9e84646 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:08.043969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af1bf8-720e-40c9-b6b2-4826c9e84646 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:08.044078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af1bf8-720e-40c9-b6b2-4826c9e84646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:08.111450 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f4af1bf8-720e-40c9-b6b2-4826c9e84646 None None] MFA Rules not processed for user `6ac1f63a2d744ed6af882ae350d0cdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:08.113234 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f4af1bf8-720e-40c9-b6b2-4826c9e84646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:08.165359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:08.209740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 652/1316] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:08.251787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a98161-5362-4e08-9ac6-aa988ade5db6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:08.253418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a5a98161-5362-4e08-9ac6-aa988ade5db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:08.263057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:08.358893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a98161-5362-4e08-9ac6-aa988ade5db6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:08.430900 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367d738-640b-4e14-a32e-35380d299713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:08.431511 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367d738-640b-4e14-a32e-35380d299713 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:08.431795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367d738-640b-4e14-a32e-35380d299713 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:08.432071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367d738-640b-4e14-a32e-35380d299713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:08.433808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1367d738-640b-4e14-a32e-35380d299713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:08.494876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:08.542139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367d738-640b-4e14-a32e-35380d299713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:08.543574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367d738-640b-4e14-a32e-35380d299713 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:08.561583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 665/1317] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:11.175992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83a57-ee4d-4e58-ad94-69196ccefe25 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:11.176546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83a57-ee4d-4e58-ad94-69196ccefe25 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:11.176642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83a57-ee4d-4e58-ad94-69196ccefe25 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:11.177948 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 653/1318] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:11.184373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879a5c9-543e-4c86-9dde-92943eef4a34 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:11.184845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879a5c9-543e-4c86-9dde-92943eef4a34 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:11.184942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879a5c9-543e-4c86-9dde-92943eef4a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:11.253703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b879a5c9-543e-4c86-9dde-92943eef4a34 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:11.254918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b879a5c9-543e-4c86-9dde-92943eef4a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:11.350663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 666/1319] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:11.395249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83a57-ee4d-4e58-ad94-69196ccefe25 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:11.397103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8db83a57-ee4d-4e58-ad94-69196ccefe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:11.506371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83a57-ee4d-4e58-ad94-69196ccefe25 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:11.579997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d26ce7-602b-438c-b6f5-e89b432deb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:11.580651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d26ce7-602b-438c-b6f5-e89b432deb7d service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:11.580938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d26ce7-602b-438c-b6f5-e89b432deb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:11.581281 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d26ce7-602b-438c-b6f5-e89b432deb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:11.583198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b7d26ce7-602b-438c-b6f5-e89b432deb7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:11.590894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:11.700473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d26ce7-602b-438c-b6f5-e89b432deb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:11.701853 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d26ce7-602b-438c-b6f5-e89b432deb7d service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:11.721953 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 654/1320] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:14.470195 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab99cea-0b98-423c-9d76-dbbab4973102 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:14.470879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab99cea-0b98-423c-9d76-dbbab4973102 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:14.470979 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab99cea-0b98-423c-9d76-dbbab4973102 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:14.472849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 667/1321] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:14.478490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec39c-ef4d-4cdf-be18-5ac7e884cfa8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:14.479043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec39c-ef4d-4cdf-be18-5ac7e884cfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:14.479149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec39c-ef4d-4cdf-be18-5ac7e884cfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:14.549772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5d8ec39c-ef4d-4cdf-be18-5ac7e884cfa8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:14.551491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5d8ec39c-ef4d-4cdf-be18-5ac7e884cfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:14.619194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:14.666127 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 655/1322] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:14.706060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab99cea-0b98-423c-9d76-dbbab4973102 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:14.707643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-eab99cea-0b98-423c-9d76-dbbab4973102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:14.735738 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:14.830892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab99cea-0b98-423c-9d76-dbbab4973102 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:14.907702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d0acb-83db-464c-a2dd-634dbba835cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:14.908347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d0acb-83db-464c-a2dd-634dbba835cf service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:14.908628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d0acb-83db-464c-a2dd-634dbba835cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:14.908899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d0acb-83db-464c-a2dd-634dbba835cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:14.911036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c90d0acb-83db-464c-a2dd-634dbba835cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:14.991449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:15.030677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d0acb-83db-464c-a2dd-634dbba835cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:15.032038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d0acb-83db-464c-a2dd-634dbba835cf service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:15.051870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 668/1323] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:17.137751 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e50fbc-3301-4c18-917f-fddaff98761e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:17.138277 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e50fbc-3301-4c18-917f-fddaff98761e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:17.138526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e50fbc-3301-4c18-917f-fddaff98761e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:17.140284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 656/1324] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:17.146322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71779b1d-17cb-4472-ab0b-eb5d1c2b381e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:17.146831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71779b1d-17cb-4472-ab0b-eb5d1c2b381e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:17.146927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71779b1d-17cb-4472-ab0b-eb5d1c2b381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:17.218550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-71779b1d-17cb-4472-ab0b-eb5d1c2b381e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:17.220436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-71779b1d-17cb-4472-ab0b-eb5d1c2b381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:17.327993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 669/1325] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:17.365495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e50fbc-3301-4c18-917f-fddaff98761e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:17.367028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-60e50fbc-3301-4c18-917f-fddaff98761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:17.480307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e50fbc-3301-4c18-917f-fddaff98761e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:17.573927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89493833-9634-4933-89e0-6111fa1827d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:17.574755 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89493833-9634-4933-89e0-6111fa1827d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:17.575037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89493833-9634-4933-89e0-6111fa1827d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:17.575314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89493833-9634-4933-89e0-6111fa1827d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:17.577114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-89493833-9634-4933-89e0-6111fa1827d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:17.596996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:17.694606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89493833-9634-4933-89e0-6111fa1827d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:17.696050 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89493833-9634-4933-89e0-6111fa1827d5 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:17.715426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 657/1326] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:19.858419 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902d4e4-7316-424d-bc22-ddd9c633de8a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:19.858982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902d4e4-7316-424d-bc22-ddd9c633de8a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:19.858982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902d4e4-7316-424d-bc22-ddd9c633de8a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:19.860353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 670/1327] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:19.866165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07187-338c-47ba-a6ae-128ccd819402 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:19.866657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07187-338c-47ba-a6ae-128ccd819402 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:19.866846 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07187-338c-47ba-a6ae-128ccd819402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:19.939212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-22a07187-338c-47ba-a6ae-128ccd819402 None None] MFA Rules not processed for user `6ac1f63a2d744ed6af882ae350d0cdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:19.940442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-22a07187-338c-47ba-a6ae-128ccd819402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:20.014785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:20.053407 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 658/1328] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:45:20.095956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902d4e4-7316-424d-bc22-ddd9c633de8a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:20.098302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2902d4e4-7316-424d-bc22-ddd9c633de8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:20.131824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:20.207409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902d4e4-7316-424d-bc22-ddd9c633de8a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:20.286381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc4e76-4146-4d27-9387-b539c4bff5a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:20.287006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc4e76-4146-4d27-9387-b539c4bff5a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:20.287290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc4e76-4146-4d27-9387-b539c4bff5a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:20.287566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc4e76-4146-4d27-9387-b539c4bff5a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:20.289268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-eadc4e76-4146-4d27-9387-b539c4bff5a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:20.373690 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:20.406948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc4e76-4146-4d27-9387-b539c4bff5a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:20.408434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc4e76-4146-4d27-9387-b539c4bff5a9 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:20.426039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 671/1329] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:22.778523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369f994-5dc4-43fb-b7ee-6ee4cf7ff903 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:22.779041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369f994-5dc4-43fb-b7ee-6ee4cf7ff903 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:22.779041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369f994-5dc4-43fb-b7ee-6ee4cf7ff903 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:22.780401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 659/1330] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:22.786126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61710ba-7f3e-4fc2-bcb2-316860f792b4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:22.786551 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61710ba-7f3e-4fc2-bcb2-316860f792b4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:22.786699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61710ba-7f3e-4fc2-bcb2-316860f792b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:22.853673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c61710ba-7f3e-4fc2-bcb2-316860f792b4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:22.854903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c61710ba-7f3e-4fc2-bcb2-316860f792b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:22.962876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 672/1331] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:45:23.014278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb2dea-5424-4406-ae52-114ca95fc9df None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:23.014573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb2dea-5424-4406-ae52-114ca95fc9df None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:23.014860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb2dea-5424-4406-ae52-114ca95fc9df None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:23.016284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 660/1332] 10.222.0.17 () {54 vars in 965 bytes} [Tue Aug 2 08:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:23.024089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb638b11-e897-47e9-a05f-8d7920cc01f7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:23.024402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb638b11-e897-47e9-a05f-8d7920cc01f7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:23.024681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb638b11-e897-47e9-a05f-8d7920cc01f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:23.070539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:23.107004 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-eb638b11-e897-47e9-a05f-8d7920cc01f7 None None] MFA Rules not processed for user `c9162dcfb8d542679c7217fae8f5c185`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:23.108270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-eb638b11-e897-47e9-a05f-8d7920cc01f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:23.185071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 673/1333] 10.222.0.17 () {58 vars in 1062 bytes} [Tue Aug 2 08:45:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:23.194750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb2dea-5424-4406-ae52-114ca95fc9df None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:23.196339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-13cb2dea-5424-4406-ae52-114ca95fc9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:23.306915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb2dea-5424-4406-ae52-114ca95fc9df None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:23.381269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6287b8-09c1-42b9-964b-e208d1247dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:23.381813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6287b8-09c1-42b9-964b-e208d1247dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:23.382094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6287b8-09c1-42b9-964b-e208d1247dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:23.382369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6287b8-09c1-42b9-964b-e208d1247dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:23.383988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2c6287b8-09c1-42b9-964b-e208d1247dc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:23.411766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:23.494893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6287b8-09c1-42b9-964b-e208d1247dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:23.496368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6287b8-09c1-42b9-964b-e208d1247dc2 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:23.515998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 661/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:25.809653 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4833e8-83a4-4de1-bdda-9e5fc147efdd None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:25.810088 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4833e8-83a4-4de1-bdda-9e5fc147efdd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:25.810194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4833e8-83a4-4de1-bdda-9e5fc147efdd None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:25.811575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 674/1335] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:25.817441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd2f42-9c38-48c1-851b-d8d4f061c0b9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:25.817854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd2f42-9c38-48c1-851b-d8d4f061c0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:25.817993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd2f42-9c38-48c1-851b-d8d4f061c0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:25.887294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b1cd2f42-9c38-48c1-851b-d8d4f061c0b9 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:25.889081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b1cd2f42-9c38-48c1-851b-d8d4f061c0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:25.970502 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:25.993112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 662/1336] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:26.033413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4833e8-83a4-4de1-bdda-9e5fc147efdd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:26.034959 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ba4833e8-83a4-4de1-bdda-9e5fc147efdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:26.143173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4833e8-83a4-4de1-bdda-9e5fc147efdd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:26.172449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:26.220281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7540d4-701a-454b-b0bd-323738ada23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:26.220906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7540d4-701a-454b-b0bd-323738ada23a service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:26.221188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7540d4-701a-454b-b0bd-323738ada23a service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:26.221460 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7540d4-701a-454b-b0bd-323738ada23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:26.223159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-aa7540d4-701a-454b-b0bd-323738ada23a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:26.337146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7540d4-701a-454b-b0bd-323738ada23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:26.338603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7540d4-701a-454b-b0bd-323738ada23a service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:26.356855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 675/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:29.125610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3f7dd-c9d4-40cf-a079-7cb6021ba166 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:29.126155 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3f7dd-c9d4-40cf-a079-7cb6021ba166 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:29.126290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3f7dd-c9d4-40cf-a079-7cb6021ba166 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:29.128222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 663/1338] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:29.133787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1febe-bc38-439a-9462-0ec7773d63f9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:29.134234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1febe-bc38-439a-9462-0ec7773d63f9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:29.134373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1febe-bc38-439a-9462-0ec7773d63f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:29.202407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-88b1febe-bc38-439a-9462-0ec7773d63f9 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:29.203619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-88b1febe-bc38-439a-9462-0ec7773d63f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:29.213263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:29.302240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 676/1339] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:29.340681 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3f7dd-c9d4-40cf-a079-7cb6021ba166 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:29.342217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3af3f7dd-c9d4-40cf-a079-7cb6021ba166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:29.450839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3f7dd-c9d4-40cf-a079-7cb6021ba166 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:29.529573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f05811-d023-435e-a1ec-d0a8f112c83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:29.530215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f05811-d023-435e-a1ec-d0a8f112c83d service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:29.530464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f05811-d023-435e-a1ec-d0a8f112c83d service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:29.530735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f05811-d023-435e-a1ec-d0a8f112c83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:29.532385 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-96f05811-d023-435e-a1ec-d0a8f112c83d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:29.569282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:29.648089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f05811-d023-435e-a1ec-d0a8f112c83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:29.649464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f05811-d023-435e-a1ec-d0a8f112c83d service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:29.670628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 664/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:33.694672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6ae4b-812e-43af-bfd7-0c30d645a7c1 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:33.695223 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6ae4b-812e-43af-bfd7-0c30d645a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:33.695223 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6ae4b-812e-43af-bfd7-0c30d645a7c1 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:33.696796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 677/1341] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:33.702630 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dea49-13d9-44e5-b1a8-058e78a77001 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:33.703136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dea49-13d9-44e5-b1a8-058e78a77001 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:33.703251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dea49-13d9-44e5-b1a8-058e78a77001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:33.779514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b41dea49-13d9-44e5-b1a8-058e78a77001 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:33.780775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b41dea49-13d9-44e5-b1a8-058e78a77001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:33.888833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:33.901443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 665/1342] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:33.941334 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6ae4b-812e-43af-bfd7-0c30d645a7c1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:33.942905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dbc6ae4b-812e-43af-bfd7-0c30d645a7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:34.052338 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6ae4b-812e-43af-bfd7-0c30d645a7c1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:34.093552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:34.133797 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102d61a-5ab4-4868-b924-10d9c927026e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:34.134038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102d61a-5ab4-4868-b924-10d9c927026e service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:34.134285 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102d61a-5ab4-4868-b924-10d9c927026e service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:34.134559 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102d61a-5ab4-4868-b924-10d9c927026e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:34.136281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2102d61a-5ab4-4868-b924-10d9c927026e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:34.264189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102d61a-5ab4-4868-b924-10d9c927026e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:34.265597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102d61a-5ab4-4868-b924-10d9c927026e service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:34.295490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 678/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:37.210219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e573df-af6b-4e9e-bf90-103beef941b6 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:37.210756 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e573df-af6b-4e9e-bf90-103beef941b6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:37.210872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e573df-af6b-4e9e-bf90-103beef941b6 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:37.212497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 666/1344] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:45:37.220011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde0c1e-98d6-4432-92d0-679ec11b8f40 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:37.220598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde0c1e-98d6-4432-92d0-679ec11b8f40 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:37.220768 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde0c1e-98d6-4432-92d0-679ec11b8f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:37.304385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8fde0c1e-98d6-4432-92d0-679ec11b8f40 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:37.305632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8fde0c1e-98d6-4432-92d0-679ec11b8f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:37.325500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:37.418262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 679/1345] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:37.457213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e573df-af6b-4e9e-bf90-103beef941b6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:37.459090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c0e573df-af6b-4e9e-bf90-103beef941b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:37.571778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e573df-af6b-4e9e-bf90-103beef941b6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:37.654522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d635642-123e-4274-8246-2ce0c18206f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:37.655156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635642-123e-4274-8246-2ce0c18206f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:37.655441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635642-123e-4274-8246-2ce0c18206f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:37.655718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635642-123e-4274-8246-2ce0c18206f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:37.657426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2d635642-123e-4274-8246-2ce0c18206f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:37.704637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:37.782766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d635642-123e-4274-8246-2ce0c18206f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:37.785015 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d635642-123e-4274-8246-2ce0c18206f9 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:37.807902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 667/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:42.221841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e407f6-5557-426c-b26f-42744aa88f20 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:42.222359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e407f6-5557-426c-b26f-42744aa88f20 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:42.222469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e407f6-5557-426c-b26f-42744aa88f20 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:42.225026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 680/1347] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:42.230933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cbaa5-568d-440b-b06c-259285d71d95 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:42.231463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cbaa5-568d-440b-b06c-259285d71d95 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:42.231463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cbaa5-568d-440b-b06c-259285d71d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:42.306492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-901cbaa5-568d-440b-b06c-259285d71d95 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:42.307753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-901cbaa5-568d-440b-b06c-259285d71d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:42.414501 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:42.420162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 668/1348] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:45:42.462035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e407f6-5557-426c-b26f-42744aa88f20 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:42.463582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-12e407f6-5557-426c-b26f-42744aa88f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:42.578628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e407f6-5557-426c-b26f-42744aa88f20 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:42.642435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:42.676903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e055260-65c2-4c46-b6a9-407b469f236d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:42.677667 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e055260-65c2-4c46-b6a9-407b469f236d service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:42.678050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e055260-65c2-4c46-b6a9-407b469f236d service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:42.678433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e055260-65c2-4c46-b6a9-407b469f236d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:42.680293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8e055260-65c2-4c46-b6a9-407b469f236d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:42.801652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e055260-65c2-4c46-b6a9-407b469f236d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:42.803116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e055260-65c2-4c46-b6a9-407b469f236d service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:42.822811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 681/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:45:47.856315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad82a4-b215-4196-89a5-19f3efb6f1f4 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:47.856814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad82a4-b215-4196-89a5-19f3efb6f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:47.857047 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad82a4-b215-4196-89a5-19f3efb6f1f4 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:47.858769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 669/1350] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 08:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:47.864692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca6726-de10-4554-8d84-857559ea7aef None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:47.865110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca6726-de10-4554-8d84-857559ea7aef None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:47.865458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca6726-de10-4554-8d84-857559ea7aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:47.962382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4eca6726-de10-4554-8d84-857559ea7aef None None] MFA Rules not processed for user `cd9f2dc3c1c442b4b1b09964ff7c000b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:47.963853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4eca6726-de10-4554-8d84-857559ea7aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:47.988516 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:48.122149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 682/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 08:45:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:52.893499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f436-959b-4b99-842e-2b6c710e9390 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:52.894070 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f436-959b-4b99-842e-2b6c710e9390 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:52.894070 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f436-959b-4b99-842e-2b6c710e9390 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:52.895743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 670/1352] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 08:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:52.902048 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780afe1-6a1b-4614-af6c-7274823a0634 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:52.903006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780afe1-6a1b-4614-af6c-7274823a0634 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:52.903483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780afe1-6a1b-4614-af6c-7274823a0634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:52.991324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0780afe1-6a1b-4614-af6c-7274823a0634 None None] MFA Rules not processed for user `cd9f2dc3c1c442b4b1b09964ff7c000b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:52.992862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0780afe1-6a1b-4614-af6c-7274823a0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:53.074193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:53.129548 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 683/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 08:45:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:54.470830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61eb4c-e494-46df-b31c-e99729e21f54 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:54.471366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61eb4c-e494-46df-b31c-e99729e21f54 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:54.471485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61eb4c-e494-46df-b31c-e99729e21f54 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:54.472809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 671/1354] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 08:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:54.478157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40806d32-3797-499a-839f-e5a25b5e8ae1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:54.478611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40806d32-3797-499a-839f-e5a25b5e8ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:54.478706 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40806d32-3797-499a-839f-e5a25b5e8ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:54.566058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-40806d32-3797-499a-839f-e5a25b5e8ae1 None None] MFA Rules not processed for user `cd9f2dc3c1c442b4b1b09964ff7c000b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:54.567300 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-40806d32-3797-499a-839f-e5a25b5e8ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:54.689929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 684/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 08:45:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:58.006883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa86fc-04ab-4552-8b4d-fdb8a7dfdce8 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:58.007427 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa86fc-04ab-4552-8b4d-fdb8a7dfdce8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:58.007427 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa86fc-04ab-4552-8b4d-fdb8a7dfdce8 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:58.009146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 672/1356] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:58.017763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c212-d1d7-4398-9d8a-2da715f89751 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:58.018636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c212-d1d7-4398-9d8a-2da715f89751 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:58.019082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c212-d1d7-4398-9d8a-2da715f89751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:58.065381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:58.113265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1bb1c212-d1d7-4398-9d8a-2da715f89751 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:58.114856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1bb1c212-d1d7-4398-9d8a-2da715f89751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:58.228829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 685/1357] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:45:58.289104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625d7c1-81ce-4d34-ad0c-4e8151eb8f48 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:58.289713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625d7c1-81ce-4d34-ad0c-4e8151eb8f48 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:58.290173 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625d7c1-81ce-4d34-ad0c-4e8151eb8f48 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:58.293595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 673/1358] 10.222.0.17 () {54 vars in 962 bytes} [Tue Aug 2 08:45:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:45:58.306466 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e7fe3-ee44-4fef-94ca-02a382a46797 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:58.306772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e7fe3-ee44-4fef-94ca-02a382a46797 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:58.307046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e7fe3-ee44-4fef-94ca-02a382a46797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:58.406347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8a2e7fe3-ee44-4fef-94ca-02a382a46797 None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:45:58.407336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8a2e7fe3-ee44-4fef-94ca-02a382a46797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:58.467688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:58.546050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 686/1359] 10.222.0.17 () {58 vars in 1059 bytes} [Tue Aug 2 08:45:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:45:58.555539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625d7c1-81ce-4d34-ad0c-4e8151eb8f48 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:45:58.557092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d625d7c1-81ce-4d34-ad0c-4e8151eb8f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:58.719382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625d7c1-81ce-4d34-ad0c-4e8151eb8f48 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:45:58.806906 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:58.856525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbebe85-8db6-4745-8eed-2d6455ef3a81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:45:58.857350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbebe85-8db6-4745-8eed-2d6455ef3a81 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:45:58.857701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbebe85-8db6-4745-8eed-2d6455ef3a81 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:45:58.858194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbebe85-8db6-4745-8eed-2d6455ef3a81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:45:58.859918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3dbebe85-8db6-4745-8eed-2d6455ef3a81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:45:58.970582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbebe85-8db6-4745-8eed-2d6455ef3a81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:45:58.972702 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbebe85-8db6-4745-8eed-2d6455ef3a81 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:45:58.992698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 674/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:01.304354 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f4984-f3ca-436d-95cc-b7622b12844a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:01.304932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f4984-f3ca-436d-95cc-b7622b12844a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:01.304932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f4984-f3ca-436d-95cc-b7622b12844a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:01.306442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 687/1361] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:01.312054 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf91a8a-50c7-4f0a-b1b6-c04006b64ad6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:01.312602 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf91a8a-50c7-4f0a-b1b6-c04006b64ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:01.312701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf91a8a-50c7-4f0a-b1b6-c04006b64ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:01.389835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3cf91a8a-50c7-4f0a-b1b6-c04006b64ad6 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:01.390965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3cf91a8a-50c7-4f0a-b1b6-c04006b64ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:01.437585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:01.540279 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 675/1362] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:01.586307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f4984-f3ca-436d-95cc-b7622b12844a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:01.587820 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5e4f4984-f3ca-436d-95cc-b7622b12844a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:01.807268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f4984-f3ca-436d-95cc-b7622b12844a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:01.821214 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:01.957038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ed1c9-ad9e-419e-977d-17ad52a18b86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:01.957823 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ed1c9-ad9e-419e-977d-17ad52a18b86 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:01.958111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ed1c9-ad9e-419e-977d-17ad52a18b86 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:01.958396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ed1c9-ad9e-419e-977d-17ad52a18b86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:01.960355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8f4ed1c9-ad9e-419e-977d-17ad52a18b86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:02.075873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ed1c9-ad9e-419e-977d-17ad52a18b86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:02.077529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ed1c9-ad9e-419e-977d-17ad52a18b86 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:02.107035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 688/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:04.530897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c58f3-09c9-40ae-9d83-5765722287a6 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:04.531467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c58f3-09c9-40ae-9d83-5765722287a6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:04.531467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c58f3-09c9-40ae-9d83-5765722287a6 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:04.535595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 676/1364] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:46:04.538850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806f48d-1427-482e-9321-4c8dba83106c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:04.539327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806f48d-1427-482e-9321-4c8dba83106c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:04.539408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806f48d-1427-482e-9321-4c8dba83106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:04.557455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:04.626408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a806f48d-1427-482e-9321-4c8dba83106c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:04.628446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a806f48d-1427-482e-9321-4c8dba83106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:04.744165 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 689/1365] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:46:04.800878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320bdb1-afd9-4da6-823a-6aab118d52a1 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:04.801696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320bdb1-afd9-4da6-823a-6aab118d52a1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:04.802332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320bdb1-afd9-4da6-823a-6aab118d52a1 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:04.805103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 677/1366] 10.222.0.17 () {54 vars in 962 bytes} [Tue Aug 2 08:46:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:04.817590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad023b0a-8a4d-4174-80b6-fb9086615812 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:04.818019 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad023b0a-8a4d-4174-80b6-fb9086615812 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:04.818405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad023b0a-8a4d-4174-80b6-fb9086615812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:04.921131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ad023b0a-8a4d-4174-80b6-fb9086615812 None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:04.922369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ad023b0a-8a4d-4174-80b6-fb9086615812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:04.973008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:05.088172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 690/1367] 10.222.0.17 () {58 vars in 1059 bytes} [Tue Aug 2 08:46:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:05.095987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320bdb1-afd9-4da6-823a-6aab118d52a1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:05.097639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a320bdb1-afd9-4da6-823a-6aab118d52a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:05.271528 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320bdb1-afd9-4da6-823a-6aab118d52a1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:05.294947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:05.405800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26b4d8-b1c5-4d39-9fe5-04369e07bbbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:05.406349 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26b4d8-b1c5-4d39-9fe5-04369e07bbbb service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:05.406637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26b4d8-b1c5-4d39-9fe5-04369e07bbbb service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:05.406918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26b4d8-b1c5-4d39-9fe5-04369e07bbbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:05.409157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5d26b4d8-b1c5-4d39-9fe5-04369e07bbbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:05.518147 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26b4d8-b1c5-4d39-9fe5-04369e07bbbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:05.519875 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26b4d8-b1c5-4d39-9fe5-04369e07bbbb service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:05.544655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 678/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:46:06.425664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1648cb6-b304-4aa3-8033-995dcb310f5c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:06.426199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1648cb6-b304-4aa3-8033-995dcb310f5c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:06.426199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1648cb6-b304-4aa3-8033-995dcb310f5c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:06.427778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 691/1369] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:06.432799 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82f0ff-689a-4e76-8d06-ad34d4194d49 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:06.433089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82f0ff-689a-4e76-8d06-ad34d4194d49 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:06.433370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82f0ff-689a-4e76-8d06-ad34d4194d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:06.467493 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:06.507593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9e82f0ff-689a-4e76-8d06-ad34d4194d49 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:06.508839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9e82f0ff-689a-4e76-8d06-ad34d4194d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:06.616411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 679/1370] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:06.975408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f0a08-8900-4e80-b4bc-845668a4a54c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:06.975408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f0a08-8900-4e80-b4bc-845668a4a54c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:06.975408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f0a08-8900-4e80-b4bc-845668a4a54c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:06.975408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 692/1371] 10.222.0.17 () {54 vars in 964 bytes} [Tue Aug 2 08:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:06.978881 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fbe14-7418-4f1e-bf43-f24f1b510d0a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:06.978881 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fbe14-7418-4f1e-bf43-f24f1b510d0a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:06.978881 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fbe14-7418-4f1e-bf43-f24f1b510d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:07.062275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-157fbe14-7418-4f1e-bf43-f24f1b510d0a None None] MFA Rules not processed for user `b2c5059aacc149deb6cdb86d3341e78b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:07.063419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-157fbe14-7418-4f1e-bf43-f24f1b510d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:07.113649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:07.149811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 680/1372] 10.222.0.17 () {58 vars in 1061 bytes} [Tue Aug 2 08:46:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:07.157246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f0a08-8900-4e80-b4bc-845668a4a54c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:07.159371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1c8f0a08-8900-4e80-b4bc-845668a4a54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:07.289629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f0a08-8900-4e80-b4bc-845668a4a54c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:07.347687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:07.392448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de708c-dd29-4feb-b19d-6af0481b2497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:07.394038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de708c-dd29-4feb-b19d-6af0481b2497 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:07.394471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de708c-dd29-4feb-b19d-6af0481b2497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:07.394755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de708c-dd29-4feb-b19d-6af0481b2497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:07.396536 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b2de708c-dd29-4feb-b19d-6af0481b2497 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:07.529143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de708c-dd29-4feb-b19d-6af0481b2497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:07.531055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de708c-dd29-4feb-b19d-6af0481b2497 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:07.560570 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 693/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:07.708763 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055c50f-f2f6-48fb-a265-0f82272e2fe5 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:07.709947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055c50f-f2f6-48fb-a265-0f82272e2fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:07.710580 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055c50f-f2f6-48fb-a265-0f82272e2fe5 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:07.713069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 681/1374] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:07.719104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d841a94-231d-4aa2-a4d6-c0adcf6fc1fd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:07.719669 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d841a94-231d-4aa2-a4d6-c0adcf6fc1fd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:07.720158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d841a94-231d-4aa2-a4d6-c0adcf6fc1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:07.818870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5d841a94-231d-4aa2-a4d6-c0adcf6fc1fd None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:07.820105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5d841a94-231d-4aa2-a4d6-c0adcf6fc1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:07.848005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:07.928155 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 694/1375] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:07.975756 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055c50f-f2f6-48fb-a265-0f82272e2fe5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:07.977359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5055c50f-f2f6-48fb-a265-0f82272e2fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:08.126563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055c50f-f2f6-48fb-a265-0f82272e2fe5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:08.179423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:08.244552 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d02840-1bbf-44cf-b7d4-b0d8ba3af3d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:08.245180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d02840-1bbf-44cf-b7d4-b0d8ba3af3d4 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:08.245467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d02840-1bbf-44cf-b7d4-b0d8ba3af3d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:08.245747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d02840-1bbf-44cf-b7d4-b0d8ba3af3d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:08.247370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a4d02840-1bbf-44cf-b7d4-b0d8ba3af3d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:08.339796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d02840-1bbf-44cf-b7d4-b0d8ba3af3d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:08.341496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d02840-1bbf-44cf-b7d4-b0d8ba3af3d4 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:08.359990 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 682/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:10.417376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350c11-bafc-4420-9bc0-22466b5fb838 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:10.417910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350c11-bafc-4420-9bc0-22466b5fb838 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:10.417910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350c11-bafc-4420-9bc0-22466b5fb838 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:10.419196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 695/1377] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:10.425028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a1e22-f15f-446b-9ce5-1d475e273bde None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:10.425438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a1e22-f15f-446b-9ce5-1d475e273bde None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:10.425589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a1e22-f15f-446b-9ce5-1d475e273bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:10.510512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f17a1e22-f15f-446b-9ce5-1d475e273bde None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:10.511743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f17a1e22-f15f-446b-9ce5-1d475e273bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:10.518618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:10.624471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 683/1378] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:10.677750 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36350c11-bafc-4420-9bc0-22466b5fb838 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:10.679030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-36350c11-bafc-4420-9bc0-22466b5fb838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:10.852463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36350c11-bafc-4420-9bc0-22466b5fb838 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:10.858646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:10.979875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7cda4-92a7-4a16-8ec1-fd04316e6a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:10.980169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7cda4-92a7-4a16-8ec1-fd04316e6a84 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:10.980460 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7cda4-92a7-4a16-8ec1-fd04316e6a84 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:10.980832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7cda4-92a7-4a16-8ec1-fd04316e6a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:10.982433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5dc7cda4-92a7-4a16-8ec1-fd04316e6a84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:11.122696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7cda4-92a7-4a16-8ec1-fd04316e6a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:11.126834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7cda4-92a7-4a16-8ec1-fd04316e6a84 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:11.155982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 696/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:13.325811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835f6a-15ac-4e60-8dcf-3d554625114f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:13.326428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835f6a-15ac-4e60-8dcf-3d554625114f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:13.326428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835f6a-15ac-4e60-8dcf-3d554625114f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:13.327811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 684/1380] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:13.334073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61797c-2c8a-495c-815f-6e408d862e77 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:13.334604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61797c-2c8a-495c-815f-6e408d862e77 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:13.334604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61797c-2c8a-495c-815f-6e408d862e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:13.347235 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:13.417721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cd61797c-2c8a-495c-815f-6e408d862e77 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:13.419098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cd61797c-2c8a-495c-815f-6e408d862e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:13.544177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 697/1381] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:13.597481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835f6a-15ac-4e60-8dcf-3d554625114f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:13.599096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-83835f6a-15ac-4e60-8dcf-3d554625114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:13.780430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:13.794998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835f6a-15ac-4e60-8dcf-3d554625114f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:13.966524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63069c6c-d21c-4a2d-8379-ae9f0cde69d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:13.967358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63069c6c-d21c-4a2d-8379-ae9f0cde69d7 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:13.967782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63069c6c-d21c-4a2d-8379-ae9f0cde69d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:13.968233 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63069c6c-d21c-4a2d-8379-ae9f0cde69d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:13.970815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-63069c6c-d21c-4a2d-8379-ae9f0cde69d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:14.092914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63069c6c-d21c-4a2d-8379-ae9f0cde69d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:14.094645 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63069c6c-d21c-4a2d-8379-ae9f0cde69d7 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:14.110118 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:14.132366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 685/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:16.312913 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e7d7-4b3c-4fa7-9e4d-b6b8de93eefd None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:16.313443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e7d7-4b3c-4fa7-9e4d-b6b8de93eefd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:16.313548 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e7d7-4b3c-4fa7-9e4d-b6b8de93eefd None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:16.315526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 698/1383] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:16.321379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e6bd9-eef1-442b-b2d5-bd38f05c82d4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:16.322310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e6bd9-eef1-442b-b2d5-bd38f05c82d4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:16.322310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e6bd9-eef1-442b-b2d5-bd38f05c82d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:16.396204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7c3e6bd9-eef1-442b-b2d5-bd38f05c82d4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:16.397430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7c3e6bd9-eef1-442b-b2d5-bd38f05c82d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:16.518655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 686/1384] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:16.562421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e7d7-4b3c-4fa7-9e4d-b6b8de93eefd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:16.564060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1611e7d7-4b3c-4fa7-9e4d-b6b8de93eefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:16.662462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:16.731830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e7d7-4b3c-4fa7-9e4d-b6b8de93eefd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:16.895042 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003f812-59cb-4043-8493-c2f54b8de57c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:16.895581 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f812-59cb-4043-8493-c2f54b8de57c service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:16.895872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f812-59cb-4043-8493-c2f54b8de57c service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:16.896254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f812-59cb-4043-8493-c2f54b8de57c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:16.897820 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e003f812-59cb-4043-8493-c2f54b8de57c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:16.972822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:17.041442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003f812-59cb-4043-8493-c2f54b8de57c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:17.045311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003f812-59cb-4043-8493-c2f54b8de57c service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:17.079803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 699/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:19.125036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb99baa-f5f9-4aa2-98df-b9992930bd04 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:19.125477 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb99baa-f5f9-4aa2-98df-b9992930bd04 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:19.125714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb99baa-f5f9-4aa2-98df-b9992930bd04 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:19.127457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 687/1386] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:19.134591 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ba472-b166-41bd-9f39-84d60d05b029 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:19.135112 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ba472-b166-41bd-9f39-84d60d05b029 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:19.135217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ba472-b166-41bd-9f39-84d60d05b029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:19.212263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c24ba472-b166-41bd-9f39-84d60d05b029 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:19.213497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c24ba472-b166-41bd-9f39-84d60d05b029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:19.328290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 700/1387] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:19.374398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb99baa-f5f9-4aa2-98df-b9992930bd04 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:19.376475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0eb99baa-f5f9-4aa2-98df-b9992930bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:19.508373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:19.589110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb99baa-f5f9-4aa2-98df-b9992930bd04 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:19.755779 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ac066-e2ee-4ec0-b0c1-abfc47f7ce67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:19.756856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ac066-e2ee-4ec0-b0c1-abfc47f7ce67 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:19.757379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ac066-e2ee-4ec0-b0c1-abfc47f7ce67 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:19.757865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ac066-e2ee-4ec0-b0c1-abfc47f7ce67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:19.770766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0d1ac066-e2ee-4ec0-b0c1-abfc47f7ce67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:19.831662 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:19.900367 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ac066-e2ee-4ec0-b0c1-abfc47f7ce67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:19.901968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ac066-e2ee-4ec0-b0c1-abfc47f7ce67 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:19.927775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 688/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:22.417023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcde19a-1cf2-41b4-a68c-13e1aa7fd0a6 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:22.417574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcde19a-1cf2-41b4-a68c-13e1aa7fd0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:22.417990 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcde19a-1cf2-41b4-a68c-13e1aa7fd0a6 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:22.420467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 701/1389] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:22.429715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b0934-35f5-4d7e-8d32-6b5bbcfe2e04 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:22.430254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b0934-35f5-4d7e-8d32-6b5bbcfe2e04 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:22.430692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b0934-35f5-4d7e-8d32-6b5bbcfe2e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:22.549838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-956b0934-35f5-4d7e-8d32-6b5bbcfe2e04 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:22.551133 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-956b0934-35f5-4d7e-8d32-6b5bbcfe2e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:22.659961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 689/1390] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:22.705633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcde19a-1cf2-41b4-a68c-13e1aa7fd0a6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:22.707201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8bcde19a-1cf2-41b4-a68c-13e1aa7fd0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:22.741920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:22.904807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcde19a-1cf2-41b4-a68c-13e1aa7fd0a6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:23.015584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:23.029126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716f6e9-dc02-43b3-af39-df7facba3195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:23.029743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716f6e9-dc02-43b3-af39-df7facba3195 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:23.030027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716f6e9-dc02-43b3-af39-df7facba3195 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:23.030298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716f6e9-dc02-43b3-af39-df7facba3195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:23.031910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6716f6e9-dc02-43b3-af39-df7facba3195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:23.125953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716f6e9-dc02-43b3-af39-df7facba3195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:23.128207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716f6e9-dc02-43b3-af39-df7facba3195 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:23.147256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 702/1391] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:23.807317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb705f5e-2225-49a7-9748-91db74e5a399 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:23.807317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb705f5e-2225-49a7-9748-91db74e5a399 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:23.807317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb705f5e-2225-49a7-9748-91db74e5a399 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:23.807317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 690/1392] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:23.813708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901a375-7859-48a4-a50c-30576b2d8fdf None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:23.819092 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901a375-7859-48a4-a50c-30576b2d8fdf None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:23.819092 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901a375-7859-48a4-a50c-30576b2d8fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:23.887880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7901a375-7859-48a4-a50c-30576b2d8fdf None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:23.889209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7901a375-7859-48a4-a50c-30576b2d8fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:23.961716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:24.005493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 703/1393] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:46:24.063644 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b886187-a453-4ae5-910c-36caf7c6e986 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:24.063929 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b886187-a453-4ae5-910c-36caf7c6e986 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:24.064714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b886187-a453-4ae5-910c-36caf7c6e986 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:24.066063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 691/1394] 10.222.0.17 () {54 vars in 966 bytes} [Tue Aug 2 08:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:24.071226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6454248-aab7-494e-9a50-6a265ec6dc77 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:24.071507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6454248-aab7-494e-9a50-6a265ec6dc77 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:24.071795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6454248-aab7-494e-9a50-6a265ec6dc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:24.154593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f6454248-aab7-494e-9a50-6a265ec6dc77 None None] MFA Rules not processed for user `27e0b08a946b43f08028c5da415d4e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:24.155740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f6454248-aab7-494e-9a50-6a265ec6dc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:24.231874 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 704/1395] 10.222.0.17 () {58 vars in 1063 bytes} [Tue Aug 2 08:46:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:24.240096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b886187-a453-4ae5-910c-36caf7c6e986 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:24.241661 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5b886187-a453-4ae5-910c-36caf7c6e986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:24.255805 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:24.352142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b886187-a453-4ae5-910c-36caf7c6e986 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:24.428464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f305eb9-95c0-4503-a1bf-426862c65e95 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b08a946b43f08028c5da415d4e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:24.428999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f305eb9-95c0-4503-a1bf-426862c65e95 service glance] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:24.429280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f305eb9-95c0-4503-a1bf-426862c65e95 service glance] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:24.429554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f305eb9-95c0-4503-a1bf-426862c65e95 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:24.431169 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4f305eb9-95c0-4503-a1bf-426862c65e95 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:24.498878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:24.540664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f305eb9-95c0-4503-a1bf-426862c65e95 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:24.542111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f305eb9-95c0-4503-a1bf-426862c65e95 service glance] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:24.560522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 692/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:25.233123 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5c2ea-72c6-47e9-9b4e-be479b14ac97 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:25.233711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5c2ea-72c6-47e9-9b4e-be479b14ac97 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:25.233711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5c2ea-72c6-47e9-9b4e-be479b14ac97 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:25.235257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 705/1397] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:25.240657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab141d7d-2ee5-486f-aa85-81291df028ab None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:25.241189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab141d7d-2ee5-486f-aa85-81291df028ab None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:25.241282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab141d7d-2ee5-486f-aa85-81291df028ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:25.310768 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa4e00-8a00-47ee-824f-96cb30bd65dd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:25.311055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa4e00-8a00-47ee-824f-96cb30bd65dd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:25.311362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa4e00-8a00-47ee-824f-96cb30bd65dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:25.323421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ab141d7d-2ee5-486f-aa85-81291df028ab None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:25.324717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ab141d7d-2ee5-486f-aa85-81291df028ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:25.387048 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6faa4e00-8a00-47ee-824f-96cb30bd65dd None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:25.388321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6faa4e00-8a00-47ee-824f-96cb30bd65dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:25.397701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:25.435928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 693/1398] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:25.482546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab141d7d-2ee5-486f-aa85-81291df028ab None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:25.483895 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ab141d7d-2ee5-486f-aa85-81291df028ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:25.491968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 706/1399] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 08:46:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:46:25.513364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:25.541469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd009cb-426c-4af9-8c4a-84b1313f1862 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:25.541778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd009cb-426c-4af9-8c4a-84b1313f1862 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:25.542027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd009cb-426c-4af9-8c4a-84b1313f1862 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:25.543665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 707/1400] 10.222.0.17 () {54 vars in 943 bytes} [Tue Aug 2 08:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:46:25.551715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71156bcc-3095-40ff-8f54-14a20a1f63a8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:25.552269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71156bcc-3095-40ff-8f54-14a20a1f63a8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:25.553204 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71156bcc-3095-40ff-8f54-14a20a1f63a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:25.613120 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab141d7d-2ee5-486f-aa85-81291df028ab None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:25.635226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-71156bcc-3095-40ff-8f54-14a20a1f63a8 None None] MFA Rules not processed for user `d182c7050f0040559f69a231bee6dccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:25.636490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-71156bcc-3095-40ff-8f54-14a20a1f63a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:25.727183 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:25.733026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c4e90-7dc4-4f27-8ffb-e5256e3a2363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:25.733763 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c4e90-7dc4-4f27-8ffb-e5256e3a2363 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:25.734045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c4e90-7dc4-4f27-8ffb-e5256e3a2363 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:25.734316 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c4e90-7dc4-4f27-8ffb-e5256e3a2363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:25.735936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4f9c4e90-7dc4-4f27-8ffb-e5256e3a2363 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:25.751530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 708/1401] 10.222.0.17 () {58 vars in 1040 bytes} [Tue Aug 2 08:46:25 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:25.756179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:25.764777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71156bcc-3095-40ff-8f54-14a20a1f63a8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:25.778863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71156bcc-3095-40ff-8f54-14a20a1f63a8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:25.838416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c4e90-7dc4-4f27-8ffb-e5256e3a2363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:25.840193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c4e90-7dc4-4f27-8ffb-e5256e3a2363 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:25.859117 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 694/1402] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:46:25.899051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c99f-3ad1-4e45-b6d0-675748e6c5be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:25.899677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c99f-3ad1-4e45-b6d0-675748e6c5be service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:25.899958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c99f-3ad1-4e45-b6d0-675748e6c5be service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:25.900268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c99f-3ad1-4e45-b6d0-675748e6c5be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:25.901964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1cd1c99f-3ad1-4e45-b6d0-675748e6c5be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:26.001082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1c99f-3ad1-4e45-b6d0-675748e6c5be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:26.003357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1c99f-3ad1-4e45-b6d0-675748e6c5be service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:26.014019 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 709/1403] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 08:46:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 08:46:28.077104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ba81b-cb01-4a43-ba81-4364870a9773 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:28.077668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ba81b-cb01-4a43-ba81-4364870a9773 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:28.077668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ba81b-cb01-4a43-ba81-4364870a9773 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:28.079058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 695/1404] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:28.085058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18809e16-d521-4d3b-8723-9f5a2f54efad None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:28.085494 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18809e16-d521-4d3b-8723-9f5a2f54efad None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:28.085599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18809e16-d521-4d3b-8723-9f5a2f54efad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:28.098149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:28.158754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-18809e16-d521-4d3b-8723-9f5a2f54efad None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:28.159965 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-18809e16-d521-4d3b-8723-9f5a2f54efad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:28.300227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 710/1405] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:28.347306 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ba81b-cb01-4a43-ba81-4364870a9773 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:28.348865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-363ba81b-cb01-4a43-ba81-4364870a9773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:28.586959 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:28.589703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ba81b-cb01-4a43-ba81-4364870a9773 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:28.793972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a1f65-ea85-4528-a20e-bf27b69f1df5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:28.794967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a1f65-ea85-4528-a20e-bf27b69f1df5 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:28.795253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a1f65-ea85-4528-a20e-bf27b69f1df5 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:28.795537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a1f65-ea85-4528-a20e-bf27b69f1df5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:28.797372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b46a1f65-ea85-4528-a20e-bf27b69f1df5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:28.919331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a1f65-ea85-4528-a20e-bf27b69f1df5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:28.920904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a1f65-ea85-4528-a20e-bf27b69f1df5 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:28.946056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 696/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:31.180986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f672239-1302-4d3b-9875-9972b9209988 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:31.181515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f672239-1302-4d3b-9875-9972b9209988 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:31.181635 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f672239-1302-4d3b-9875-9972b9209988 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:31.183071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 711/1407] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:31.188711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073157-bf5f-462b-a007-0956f5d55b75 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:31.189885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073157-bf5f-462b-a007-0956f5d55b75 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:31.190074 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073157-bf5f-462b-a007-0956f5d55b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:31.194588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:31.263919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cb073157-bf5f-462b-a007-0956f5d55b75 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:31.265202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cb073157-bf5f-462b-a007-0956f5d55b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:31.384676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 697/1408] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:31.431051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f672239-1302-4d3b-9875-9972b9209988 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:31.433633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4f672239-1302-4d3b-9875-9972b9209988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:31.551397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:31.636718 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f672239-1302-4d3b-9875-9972b9209988 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:31.808722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09566e-d31d-4bfd-b605-0fdfe936bcf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:31.809376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09566e-d31d-4bfd-b605-0fdfe936bcf6 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:31.809658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09566e-d31d-4bfd-b605-0fdfe936bcf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:31.809928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09566e-d31d-4bfd-b605-0fdfe936bcf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:31.811720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1a09566e-d31d-4bfd-b605-0fdfe936bcf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:31.881527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:31.941565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09566e-d31d-4bfd-b605-0fdfe936bcf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:31.943611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09566e-d31d-4bfd-b605-0fdfe936bcf6 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:31.964226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 712/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:41.381343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=64 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:41.961767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=23 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:49.443556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8a706-9244-4c94-872b-0e96275061aa None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:49.444113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8a706-9244-4c94-872b-0e96275061aa None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:49.444113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8a706-9244-4c94-872b-0e96275061aa None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:49.445608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 698/1410] 10.222.0.17 () {54 vars in 918 bytes} [Tue Aug 2 08:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:49.450966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931625-0d4b-4073-9e93-fe8295b4b3c7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:49.451431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931625-0d4b-4073-9e93-fe8295b4b3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:49.451537 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931625-0d4b-4073-9e93-fe8295b4b3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:49.532760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ab931625-0d4b-4073-9e93-fe8295b4b3c7 None None] MFA Rules not processed for user `cd9f2dc3c1c442b4b1b09964ff7c000b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:49.534006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ab931625-0d4b-4073-9e93-fe8295b4b3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:49.649727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 713/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Aug 2 08:46:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:49.663809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e2967-1985-444a-9f06-b463508be163 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:49.664106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e2967-1985-444a-9f06-b463508be163 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:49.664585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e2967-1985-444a-9f06-b463508be163 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:49.665906 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 699/1412] 10.222.0.17 () {54 vars in 918 bytes} [Tue Aug 2 08:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:49.670421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cedc2f-4ab1-449c-991d-6e7be7fd50d9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:49.670712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cedc2f-4ab1-449c-991d-6e7be7fd50d9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:49.670992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cedc2f-4ab1-449c-991d-6e7be7fd50d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:49.746327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:49.750502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e1cedc2f-4ab1-449c-991d-6e7be7fd50d9 None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:49.752920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e1cedc2f-4ab1-449c-991d-6e7be7fd50d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:49.869744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 714/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Aug 2 08:46:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:52.365378 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994123d-3d7d-4122-a2b0-4565a8864280 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:52.366019 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994123d-3d7d-4122-a2b0-4565a8864280 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:52.366019 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994123d-3d7d-4122-a2b0-4565a8864280 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:52.367338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:52.373200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9e882-a69b-4307-94d7-6dedf1437d81 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:52.373641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9e882-a69b-4307-94d7-6dedf1437d81 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:52.373763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9e882-a69b-4307-94d7-6dedf1437d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:52.440024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-83e9e882-a69b-4307-94d7-6dedf1437d81 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:52.441243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-83e9e882-a69b-4307-94d7-6dedf1437d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:52.495734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:52.538090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:52.582209 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994123d-3d7d-4122-a2b0-4565a8864280 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:52.584008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0994123d-3d7d-4122-a2b0-4565a8864280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:52.728881 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994123d-3d7d-4122-a2b0-4565a8864280 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:52.809736 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:52.850538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da966-ce54-4db7-8c76-a89287da08d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:52.851156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da966-ce54-4db7-8c76-a89287da08d7 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:52.851439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da966-ce54-4db7-8c76-a89287da08d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:52.851715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da966-ce54-4db7-8c76-a89287da08d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:52.853355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cf1da966-ce54-4db7-8c76-a89287da08d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:52.945506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1da966-ce54-4db7-8c76-a89287da08d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:52.947112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1da966-ce54-4db7-8c76-a89287da08d7 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:52.965274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 701/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:53.883727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4475c-5bbe-4bdc-96ce-9507a419f418 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:53.884294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4475c-5bbe-4bdc-96ce-9507a419f418 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:53.884294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4475c-5bbe-4bdc-96ce-9507a419f418 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:53.885681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:53.890835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc57fa-fe04-4567-ac16-b7a0a8cbd9cf None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:53.891307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc57fa-fe04-4567-ac16-b7a0a8cbd9cf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:53.891417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc57fa-fe04-4567-ac16-b7a0a8cbd9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:54.088480 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-17cc57fa-fe04-4567-ac16-b7a0a8cbd9cf None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:54.089631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-17cc57fa-fe04-4567-ac16-b7a0a8cbd9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:54.121079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:54.194003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:54.346222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4475c-5bbe-4bdc-96ce-9507a419f418 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:54.347701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-65b4475c-5bbe-4bdc-96ce-9507a419f418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:54.497206 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4475c-5bbe-4bdc-96ce-9507a419f418 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:54.541076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:54.616974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7943fc-3cd4-4fb8-adc4-09a2fd5ab9a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:54.617520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7943fc-3cd4-4fb8-adc4-09a2fd5ab9a5 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:54.617825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7943fc-3cd4-4fb8-adc4-09a2fd5ab9a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:54.618094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7943fc-3cd4-4fb8-adc4-09a2fd5ab9a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:54.619732 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9f7943fc-3cd4-4fb8-adc4-09a2fd5ab9a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:54.710358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7943fc-3cd4-4fb8-adc4-09a2fd5ab9a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:54.711991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7943fc-3cd4-4fb8-adc4-09a2fd5ab9a5 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:54.730363 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 717/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:55.637206 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cf6ee-6979-48c4-8b75-758330e0af56 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:55.637779 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cf6ee-6979-48c4-8b75-758330e0af56 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:55.637779 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cf6ee-6979-48c4-8b75-758330e0af56 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:55.639149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:55.644138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bcee3-f67b-4c74-9c2f-28d107bb99c3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:55.644568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bcee3-f67b-4c74-9c2f-28d107bb99c3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:55.644711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bcee3-f67b-4c74-9c2f-28d107bb99c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:55.699320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:55.721892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3b0bcee3-f67b-4c74-9c2f-28d107bb99c3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:55.723136 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3b0bcee3-f67b-4c74-9c2f-28d107bb99c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:55.821013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:55.976110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cf6ee-6979-48c4-8b75-758330e0af56 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:55.977844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-105cf6ee-6979-48c4-8b75-758330e0af56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:56.123884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cf6ee-6979-48c4-8b75-758330e0af56 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:56.138670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:56.241972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11534792-f36e-4486-af31-fa897e5e3aa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:56.242510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11534792-f36e-4486-af31-fa897e5e3aa8 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:56.242792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11534792-f36e-4486-af31-fa897e5e3aa8 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:56.243069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11534792-f36e-4486-af31-fa897e5e3aa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:56.244740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-11534792-f36e-4486-af31-fa897e5e3aa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:56.342933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11534792-f36e-4486-af31-fa897e5e3aa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:56.344576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11534792-f36e-4486-af31-fa897e5e3aa8 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:56.362073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 704/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:57.246428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405827-7d81-4b5b-ac80-4c3c74738281 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:57.247029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405827-7d81-4b5b-ac80-4c3c74738281 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:57.247029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405827-7d81-4b5b-ac80-4c3c74738281 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:57.248427 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:57.253721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea397d0-c075-44ed-a0dc-978a612304e1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:57.254223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea397d0-c075-44ed-a0dc-978a612304e1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:57.254336 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea397d0-c075-44ed-a0dc-978a612304e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:57.274659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:57.333525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7ea397d0-c075-44ed-a0dc-978a612304e1 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:57.334752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7ea397d0-c075-44ed-a0dc-978a612304e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:57.439842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:57.591896 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e405827-7d81-4b5b-ac80-4c3c74738281 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:57.593493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0e405827-7d81-4b5b-ac80-4c3c74738281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:57.703194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:57.739574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e405827-7d81-4b5b-ac80-4c3c74738281 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:57.854779 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00bd22-80a3-4128-b87e-59818ad76b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:57.855392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00bd22-80a3-4128-b87e-59818ad76b08 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:57.855673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00bd22-80a3-4128-b87e-59818ad76b08 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:57.855984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00bd22-80a3-4128-b87e-59818ad76b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:57.857633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ea00bd22-80a3-4128-b87e-59818ad76b08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:57.933543 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:57.947336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00bd22-80a3-4128-b87e-59818ad76b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:57.948969 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00bd22-80a3-4128-b87e-59818ad76b08 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:57.967464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 720/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:58.834938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65871e14-2db0-47b1-b750-4ae20090606f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:58.835496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65871e14-2db0-47b1-b750-4ae20090606f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:58.835496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65871e14-2db0-47b1-b750-4ae20090606f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:58.836909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:46:58.841778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2fa72-0591-4de4-a2c3-ee99066231dd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:58.842197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2fa72-0591-4de4-a2c3-ee99066231dd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:58.842339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2fa72-0591-4de4-a2c3-ee99066231dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:58.918044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-35a2fa72-0591-4de4-a2c3-ee99066231dd None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:46:58.919272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-35a2fa72-0591-4de4-a2c3-ee99066231dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:59.019740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:46:59.172843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65871e14-2db0-47b1-b750-4ae20090606f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:46:59.174393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-65871e14-2db0-47b1-b750-4ae20090606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:59.257711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:59.319412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65871e14-2db0-47b1-b750-4ae20090606f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:46:59.433034 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671e37-d1e9-48bc-97ce-5ec1dced3f74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:46:59.433574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671e37-d1e9-48bc-97ce-5ec1dced3f74 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:46:59.433857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671e37-d1e9-48bc-97ce-5ec1dced3f74 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:46:59.434134 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671e37-d1e9-48bc-97ce-5ec1dced3f74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:46:59.435770 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-63671e37-d1e9-48bc-97ce-5ec1dced3f74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:46:59.485453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:59.527077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671e37-d1e9-48bc-97ce-5ec1dced3f74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:46:59.528715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671e37-d1e9-48bc-97ce-5ec1dced3f74 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:46:59.546622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 707/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:00.377779 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476895c-f729-45e9-b6fc-55d6922c999c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:00.378593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476895c-f729-45e9-b6fc-55d6922c999c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:00.378593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476895c-f729-45e9-b6fc-55d6922c999c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:00.380138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:00.385150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c0cd2-0981-4e74-9c6e-c1a8382f4760 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:00.385576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c0cd2-0981-4e74-9c6e-c1a8382f4760 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:00.385689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c0cd2-0981-4e74-9c6e-c1a8382f4760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:00.462232 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e85c0cd2-0981-4e74-9c6e-c1a8382f4760 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:00.463448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e85c0cd2-0981-4e74-9c6e-c1a8382f4760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:00.558837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:00.708205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476895c-f729-45e9-b6fc-55d6922c999c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:00.709654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d476895c-f729-45e9-b6fc-55d6922c999c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:00.757605 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:00.859260 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476895c-f729-45e9-b6fc-55d6922c999c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:00.972443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908364e-0288-481e-88d4-02a1b5fe588e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:00.972975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908364e-0288-481e-88d4-02a1b5fe588e service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:00.973255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908364e-0288-481e-88d4-02a1b5fe588e service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:00.973526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908364e-0288-481e-88d4-02a1b5fe588e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:00.975141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a908364e-0288-481e-88d4-02a1b5fe588e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:00.982114 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:01.075151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908364e-0288-481e-88d4-02a1b5fe588e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:01.076835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908364e-0288-481e-88d4-02a1b5fe588e service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:01.096748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 723/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:01.962508 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79b327-788b-42e5-a690-ffa9a7228b82 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:01.963083 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79b327-788b-42e5-a690-ffa9a7228b82 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:01.963083 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79b327-788b-42e5-a690-ffa9a7228b82 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:01.964438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:01.969405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5af1c-91ae-411d-8215-d440e05bffdb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:01.969821 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5af1c-91ae-411d-8215-d440e05bffdb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:01.969987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5af1c-91ae-411d-8215-d440e05bffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:02.045975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b3e5af1c-91ae-411d-8215-d440e05bffdb None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:02.047197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b3e5af1c-91ae-411d-8215-d440e05bffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:02.114184 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:02.143701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:02.301075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79b327-788b-42e5-a690-ffa9a7228b82 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:02.302573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0c79b327-788b-42e5-a690-ffa9a7228b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:02.320495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:02.450157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79b327-788b-42e5-a690-ffa9a7228b82 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:02.537996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:02.563719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b4ed4-02ad-4f9b-9c2e-8fe7b4380a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:02.564370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4ed4-02ad-4f9b-9c2e-8fe7b4380a44 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:02.564651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4ed4-02ad-4f9b-9c2e-8fe7b4380a44 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:02.564926 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4ed4-02ad-4f9b-9c2e-8fe7b4380a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:02.566541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-379b4ed4-02ad-4f9b-9c2e-8fe7b4380a44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:02.658943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b4ed4-02ad-4f9b-9c2e-8fe7b4380a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:02.660593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b4ed4-02ad-4f9b-9c2e-8fe7b4380a44 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:02.679324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 710/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:03.487138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662a7f-338a-4e28-9208-906fc5bfc612 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:03.487690 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662a7f-338a-4e28-9208-906fc5bfc612 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:03.487690 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662a7f-338a-4e28-9208-906fc5bfc612 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:03.489146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:03.494305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e04e9-738a-4f17-ac4d-ead816567b56 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:03.494779 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e04e9-738a-4f17-ac4d-ead816567b56 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:03.494894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e04e9-738a-4f17-ac4d-ead816567b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:03.573828 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-899e04e9-738a-4f17-ac4d-ead816567b56 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:03.575062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-899e04e9-738a-4f17-ac4d-ead816567b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:03.617021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:03.675888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:03.827290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12662a7f-338a-4e28-9208-906fc5bfc612 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:03.828885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-12662a7f-338a-4e28-9208-906fc5bfc612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:03.977377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12662a7f-338a-4e28-9208-906fc5bfc612 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:04.033044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:04.093946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b2509-a1bd-4ce0-a995-3e7a1de3bf63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:04.094485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b2509-a1bd-4ce0-a995-3e7a1de3bf63 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:04.094772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b2509-a1bd-4ce0-a995-3e7a1de3bf63 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:04.095616 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b2509-a1bd-4ce0-a995-3e7a1de3bf63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:04.097306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a21b2509-a1bd-4ce0-a995-3e7a1de3bf63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:04.191733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b2509-a1bd-4ce0-a995-3e7a1de3bf63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:04.194954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b2509-a1bd-4ce0-a995-3e7a1de3bf63 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:04.219531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 726/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:05.027601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3d2ce-cd9c-4c33-b0fb-a7f197474daf None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:05.028192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3d2ce-cd9c-4c33-b0fb-a7f197474daf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:05.028192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3d2ce-cd9c-4c33-b0fb-a7f197474daf None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:05.029545 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:05.034495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd45988-69e8-4da8-83a9-afcde3232d36 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:05.034910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd45988-69e8-4da8-83a9-afcde3232d36 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:05.035062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd45988-69e8-4da8-83a9-afcde3232d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:05.114032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4cd45988-69e8-4da8-83a9-afcde3232d36 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:05.115176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4cd45988-69e8-4da8-83a9-afcde3232d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:05.117246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:05.214125 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:05.368919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3d2ce-cd9c-4c33-b0fb-a7f197474daf None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:05.370402 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1ce3d2ce-cd9c-4c33-b0fb-a7f197474daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:05.521129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3d2ce-cd9c-4c33-b0fb-a7f197474daf None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:05.549259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:05.637444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b85b7d-e341-486f-9c90-358f09bde70a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:05.637981 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85b7d-e341-486f-9c90-358f09bde70a service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:05.638266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85b7d-e341-486f-9c90-358f09bde70a service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:05.638544 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85b7d-e341-486f-9c90-358f09bde70a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:05.640202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-53b85b7d-e341-486f-9c90-358f09bde70a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:05.729368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b85b7d-e341-486f-9c90-358f09bde70a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:05.730941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b85b7d-e341-486f-9c90-358f09bde70a service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:05.749159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 713/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:07.645957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf54003-1cf1-4eec-a59d-bb88fda74fe2 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:07.646539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf54003-1cf1-4eec-a59d-bb88fda74fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:07.646539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf54003-1cf1-4eec-a59d-bb88fda74fe2 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:07.647877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:07.653122 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cbfc7-cc58-4979-bc4b-37c1875e3aed None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:07.653552 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cbfc7-cc58-4979-bc4b-37c1875e3aed None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:07.653752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cbfc7-cc58-4979-bc4b-37c1875e3aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:07.694493 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:07.721876 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7f2cbfc7-cc58-4979-bc4b-37c1875e3aed None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:07.723105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7f2cbfc7-cc58-4979-bc4b-37c1875e3aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:07.819282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:47:07.857085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf54003-1cf1-4eec-a59d-bb88fda74fe2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:07.858656 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ccf54003-1cf1-4eec-a59d-bb88fda74fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:07.966518 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf54003-1cf1-4eec-a59d-bb88fda74fe2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:07.998889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:08.040230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819398e-2ec3-4667-a28e-893c4320e2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:08.040899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819398e-2ec3-4667-a28e-893c4320e2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:08.041180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819398e-2ec3-4667-a28e-893c4320e2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:08.041450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819398e-2ec3-4667-a28e-893c4320e2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:08.043076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f819398e-2ec3-4667-a28e-893c4320e2c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:08.276560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819398e-2ec3-4667-a28e-893c4320e2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:08.277920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819398e-2ec3-4667-a28e-893c4320e2c7 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:08.296660 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 729/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:10.462970 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b03064-d15c-45a9-9992-59f99002945b None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:10.463550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b03064-d15c-45a9-9992-59f99002945b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:10.463550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b03064-d15c-45a9-9992-59f99002945b None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:10.464899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:10.470742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6149a66-812a-4509-98bb-70c8e74c0a11 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:10.471217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6149a66-812a-4509-98bb-70c8e74c0a11 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:10.471217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6149a66-812a-4509-98bb-70c8e74c0a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:10.536055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c6149a66-812a-4509-98bb-70c8e74c0a11 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:10.537772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c6149a66-812a-4509-98bb-70c8e74c0a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:10.552720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:10.654012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:10.692373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b03064-d15c-45a9-9992-59f99002945b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:10.693916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-35b03064-d15c-45a9-9992-59f99002945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:10.798646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b03064-d15c-45a9-9992-59f99002945b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:10.815962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:10.878921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d8f9c-2da4-402e-919d-6116b57fcc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:10.879539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d8f9c-2da4-402e-919d-6116b57fcc9b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:10.879822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d8f9c-2da4-402e-919d-6116b57fcc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:10.880096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d8f9c-2da4-402e-919d-6116b57fcc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:10.881767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a86d8f9c-2da4-402e-919d-6116b57fcc9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:11.000894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d8f9c-2da4-402e-919d-6116b57fcc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:11.002586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d8f9c-2da4-402e-919d-6116b57fcc9b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:11.020734 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 716/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:13.425761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34065464-6535-4fd2-9a3d-438f232fce2b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:13.426310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34065464-6535-4fd2-9a3d-438f232fce2b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:13.426310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34065464-6535-4fd2-9a3d-438f232fce2b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:13.427636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:13.432902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c40b-b1cd-40bb-b24b-476740ad80f5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:13.433339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c40b-b1cd-40bb-b24b-476740ad80f5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:13.433449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c40b-b1cd-40bb-b24b-476740ad80f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:13.482001 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:13.522345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1cd2c40b-b1cd-40bb-b24b-476740ad80f5 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:13.523659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1cd2c40b-b1cd-40bb-b24b-476740ad80f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:13.622138 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:13.661045 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34065464-6535-4fd2-9a3d-438f232fce2b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:13.662686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-34065464-6535-4fd2-9a3d-438f232fce2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:13.769192 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34065464-6535-4fd2-9a3d-438f232fce2b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:13.808803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:13.843940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de64e7-0ad5-4b34-99e0-0f4bbd82ffef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:13.844612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de64e7-0ad5-4b34-99e0-0f4bbd82ffef service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:13.845511 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de64e7-0ad5-4b34-99e0-0f4bbd82ffef service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:13.845790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de64e7-0ad5-4b34-99e0-0f4bbd82ffef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:13.847412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-94de64e7-0ad5-4b34-99e0-0f4bbd82ffef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:13.955023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de64e7-0ad5-4b34-99e0-0f4bbd82ffef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:13.956499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de64e7-0ad5-4b34-99e0-0f4bbd82ffef service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:13.977202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 732/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:16.123083 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c312c4c-0f99-4299-bb52-711db65c52d1 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:16.123618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c312c4c-0f99-4299-bb52-711db65c52d1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:16.123618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c312c4c-0f99-4299-bb52-711db65c52d1 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:16.124967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:16.130842 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9d84-d83b-45da-b501-70126f18a4a3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:16.130842 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9d84-d83b-45da-b501-70126f18a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:16.131387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9d84-d83b-45da-b501-70126f18a4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:16.196737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e5ba9d84-d83b-45da-b501-70126f18a4a3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:16.197950 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e5ba9d84-d83b-45da-b501-70126f18a4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:16.218965 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:16.294909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:16.334624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c312c4c-0f99-4299-bb52-711db65c52d1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:16.336283 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1c312c4c-0f99-4299-bb52-711db65c52d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:16.444162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c312c4c-0f99-4299-bb52-711db65c52d1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:16.464346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:16.517650 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e5636-253a-44f5-9c1b-e49f82b856bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:16.518265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e5636-253a-44f5-9c1b-e49f82b856bc service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:16.518549 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e5636-253a-44f5-9c1b-e49f82b856bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:16.518822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e5636-253a-44f5-9c1b-e49f82b856bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:16.520474 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-250e5636-253a-44f5-9c1b-e49f82b856bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:16.628237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e5636-253a-44f5-9c1b-e49f82b856bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:16.629673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e5636-253a-44f5-9c1b-e49f82b856bc service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:16.648212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 719/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:18.800661 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba773-d0d9-425f-a68a-86236b2696b3 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:18.801241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba773-d0d9-425f-a68a-86236b2696b3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:18.801241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba773-d0d9-425f-a68a-86236b2696b3 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:18.802596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:18.808341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3ce60-f6f6-4f61-90a7-8c06644ae178 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:18.808831 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3ce60-f6f6-4f61-90a7-8c06644ae178 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:18.808995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3ce60-f6f6-4f61-90a7-8c06644ae178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:18.874756 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:18.880065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d2b3ce60-f6f6-4f61-90a7-8c06644ae178 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:18.881887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d2b3ce60-f6f6-4f61-90a7-8c06644ae178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:18.981448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:19.019991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beba773-d0d9-425f-a68a-86236b2696b3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:19.021576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4beba773-d0d9-425f-a68a-86236b2696b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:19.126369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beba773-d0d9-425f-a68a-86236b2696b3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:19.176392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:19.202871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26e7ce-3417-46f0-ae25-46ed73d5418f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:19.203489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26e7ce-3417-46f0-ae25-46ed73d5418f service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:19.203774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26e7ce-3417-46f0-ae25-46ed73d5418f service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:19.204586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26e7ce-3417-46f0-ae25-46ed73d5418f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:19.206230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cb26e7ce-3417-46f0-ae25-46ed73d5418f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:19.315205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26e7ce-3417-46f0-ae25-46ed73d5418f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:19.316689 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26e7ce-3417-46f0-ae25-46ed73d5418f service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:19.335331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 735/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:21.421027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16325615-58da-4510-b458-2da8a3de0a16 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:21.421540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16325615-58da-4510-b458-2da8a3de0a16 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:21.421540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16325615-58da-4510-b458-2da8a3de0a16 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:21.422844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:21.428549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2f55-006f-4ce0-a7d3-9c46ff1b3a44 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:21.429052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2f55-006f-4ce0-a7d3-9c46ff1b3a44 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:21.429165 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2f55-006f-4ce0-a7d3-9c46ff1b3a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:21.498317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-075c2f55-006f-4ce0-a7d3-9c46ff1b3a44 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:21.499550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-075c2f55-006f-4ce0-a7d3-9c46ff1b3a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:21.529572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:21.600202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:47:21.639011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16325615-58da-4510-b458-2da8a3de0a16 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:21.640590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-16325615-58da-4510-b458-2da8a3de0a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:21.746255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16325615-58da-4510-b458-2da8a3de0a16 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:21.776304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:21.825200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983ebf9-c9f1-414f-a2f4-2c445acefd1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:21.825824 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983ebf9-c9f1-414f-a2f4-2c445acefd1b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:21.826102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983ebf9-c9f1-414f-a2f4-2c445acefd1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:21.826374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983ebf9-c9f1-414f-a2f4-2c445acefd1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:21.828007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f983ebf9-c9f1-414f-a2f4-2c445acefd1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:21.941700 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983ebf9-c9f1-414f-a2f4-2c445acefd1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:21.943132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983ebf9-c9f1-414f-a2f4-2c445acefd1b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:21.963532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 722/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:24.155364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cd056-2450-4bf9-9b5f-9e32af893c15 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:24.155922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cd056-2450-4bf9-9b5f-9e32af893c15 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:24.156166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cd056-2450-4bf9-9b5f-9e32af893c15 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:24.157845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:24.163260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d3403-036a-4c15-a4ab-2baa3574775d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:24.163702 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d3403-036a-4c15-a4ab-2baa3574775d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:24.163807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d3403-036a-4c15-a4ab-2baa3574775d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:24.237053 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-520d3403-036a-4c15-a4ab-2baa3574775d None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:24.238299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-520d3403-036a-4c15-a4ab-2baa3574775d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:24.247326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:24.353078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:24.394851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cd056-2450-4bf9-9b5f-9e32af893c15 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:24.396503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7a6cd056-2450-4bf9-9b5f-9e32af893c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:24.514853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cd056-2450-4bf9-9b5f-9e32af893c15 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:24.572770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:24.592744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380180f-4fad-4960-ab21-196ac64cf736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:24.593366 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380180f-4fad-4960-ab21-196ac64cf736 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:24.593652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380180f-4fad-4960-ab21-196ac64cf736 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:24.593936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380180f-4fad-4960-ab21-196ac64cf736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:24.596223 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1380180f-4fad-4960-ab21-196ac64cf736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:24.723892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380180f-4fad-4960-ab21-196ac64cf736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:24.725287 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380180f-4fad-4960-ab21-196ac64cf736 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:24.748180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 738/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:26.862003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330c54d-dcd7-4eb7-9278-edd611534b43 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:26.862564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330c54d-dcd7-4eb7-9278-edd611534b43 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:26.862564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330c54d-dcd7-4eb7-9278-edd611534b43 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:26.863912 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:26.869776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c938bd-352c-4584-a896-3f33e6ed01ca None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:26.870283 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c938bd-352c-4584-a896-3f33e6ed01ca None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:26.870409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c938bd-352c-4584-a896-3f33e6ed01ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:26.940746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-18c938bd-352c-4584-a896-3f33e6ed01ca None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:26.941955 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-18c938bd-352c-4584-a896-3f33e6ed01ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:26.980868 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:27.046139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:27.086259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330c54d-dcd7-4eb7-9278-edd611534b43 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:27.087888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1330c54d-dcd7-4eb7-9278-edd611534b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:27.198043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330c54d-dcd7-4eb7-9278-edd611534b43 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:27.239020 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:27.276364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ffa29-2a2e-4883-a62c-88b4d2424d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:27.276994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ffa29-2a2e-4883-a62c-88b4d2424d64 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:27.277276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ffa29-2a2e-4883-a62c-88b4d2424d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:27.277550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ffa29-2a2e-4883-a62c-88b4d2424d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:27.279207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0a1ffa29-2a2e-4883-a62c-88b4d2424d64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:27.393961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ffa29-2a2e-4883-a62c-88b4d2424d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:27.395331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ffa29-2a2e-4883-a62c-88b4d2424d64 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:27.413901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 725/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:29.490937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cbb8c-3baf-4d96-aad6-7f66034390fa None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:29.491526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cbb8c-3baf-4d96-aad6-7f66034390fa None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:29.491526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cbb8c-3baf-4d96-aad6-7f66034390fa None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:29.492872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:29.498579 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a4da-ca4b-40ab-9b5d-fd205cdede77 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:29.499090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a4da-ca4b-40ab-9b5d-fd205cdede77 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:29.499213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a4da-ca4b-40ab-9b5d-fd205cdede77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:29.570534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3934a4da-ca4b-40ab-9b5d-fd205cdede77 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:29.571757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3934a4da-ca4b-40ab-9b5d-fd205cdede77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:29.592728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:29.675828 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:29.714044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cbb8c-3baf-4d96-aad6-7f66034390fa None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:29.716469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-195cbb8c-3baf-4d96-aad6-7f66034390fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:29.827398 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cbb8c-3baf-4d96-aad6-7f66034390fa None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:29.902586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:29.910591 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638843d-38f6-4863-8995-0ac0881f953f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:29.911214 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638843d-38f6-4863-8995-0ac0881f953f service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:29.911502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638843d-38f6-4863-8995-0ac0881f953f service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:29.911783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638843d-38f6-4863-8995-0ac0881f953f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:29.913482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f638843d-38f6-4863-8995-0ac0881f953f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:30.025527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638843d-38f6-4863-8995-0ac0881f953f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:30.026970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638843d-38f6-4863-8995-0ac0881f953f service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:30.045368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 741/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:32.100867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80184c03-6f36-4944-96de-20022221a82e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:32.101478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80184c03-6f36-4944-96de-20022221a82e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:32.101478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80184c03-6f36-4944-96de-20022221a82e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:32.102766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:32.109134 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524546ff-01c9-401e-a3ba-0637c85681cb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:32.109851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524546ff-01c9-401e-a3ba-0637c85681cb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:32.109851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524546ff-01c9-401e-a3ba-0637c85681cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:32.179609 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-524546ff-01c9-401e-a3ba-0637c85681cb None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:32.180870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-524546ff-01c9-401e-a3ba-0637c85681cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:32.233234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:32.285956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:32.323111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80184c03-6f36-4944-96de-20022221a82e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:32.324667 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-80184c03-6f36-4944-96de-20022221a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:32.431385 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80184c03-6f36-4944-96de-20022221a82e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:32.484890 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:32.513158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc0209-8e96-4925-9eb0-6b5b8c8de07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:32.513773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc0209-8e96-4925-9eb0-6b5b8c8de07b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:32.514048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc0209-8e96-4925-9eb0-6b5b8c8de07b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:32.514321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc0209-8e96-4925-9eb0-6b5b8c8de07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:32.515943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cdcc0209-8e96-4925-9eb0-6b5b8c8de07b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:32.639195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc0209-8e96-4925-9eb0-6b5b8c8de07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:32.641183 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc0209-8e96-4925-9eb0-6b5b8c8de07b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:32.659910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 728/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:42.284167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=22 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:42.657477 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=66 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:52.464684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b4ec1-3958-42ef-9e65-e97aafed60c8 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:52.465269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b4ec1-3958-42ef-9e65-e97aafed60c8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:52.465269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b4ec1-3958-42ef-9e65-e97aafed60c8 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:52.466630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 743/1471] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:52.472922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f32ee-928b-4087-9cae-dde6060b8573 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:52.473441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f32ee-928b-4087-9cae-dde6060b8573 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:52.473545 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f32ee-928b-4087-9cae-dde6060b8573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:52.551838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b68f32ee-928b-4087-9cae-dde6060b8573 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:52.553915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b68f32ee-928b-4087-9cae-dde6060b8573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:52.661258 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 729/1472] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:52.759951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288945e-877d-4278-8c45-ab5a19aa1a3e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:52.760277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288945e-877d-4278-8c45-ab5a19aa1a3e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:52.760561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288945e-877d-4278-8c45-ab5a19aa1a3e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:52.761910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 744/1473] 10.222.0.17 () {54 vars in 966 bytes} [Tue Aug 2 08:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:52.767788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e525d-7610-474f-88d2-0f3b2c393ab8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:52.768084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e525d-7610-474f-88d2-0f3b2c393ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:52.768398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e525d-7610-474f-88d2-0f3b2c393ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:52.849784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4f1e525d-7610-474f-88d2-0f3b2c393ab8 None None] MFA Rules not processed for user `27e0b08a946b43f08028c5da415d4e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:52.851018 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4f1e525d-7610-474f-88d2-0f3b2c393ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:52.878165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:52.941436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 730/1474] 10.222.0.17 () {58 vars in 1063 bytes} [Tue Aug 2 08:47:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:52.950286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288945e-877d-4278-8c45-ab5a19aa1a3e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:52.951831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4288945e-877d-4278-8c45-ab5a19aa1a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:53.086508 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288945e-877d-4278-8c45-ab5a19aa1a3e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:53.166325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a836d8-3b46-4ed7-9291-f88a9c44b8c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b08a946b43f08028c5da415d4e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:53.166952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a836d8-3b46-4ed7-9291-f88a9c44b8c8 service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:53.167231 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a836d8-3b46-4ed7-9291-f88a9c44b8c8 service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:53.167512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a836d8-3b46-4ed7-9291-f88a9c44b8c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:53.169222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a3a836d8-3b46-4ed7-9291-f88a9c44b8c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:53.242929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:53.310222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a836d8-3b46-4ed7-9291-f88a9c44b8c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:53.312720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a836d8-3b46-4ed7-9291-f88a9c44b8c8 service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:53.338469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 745/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:47:55.580163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bb8ad-784a-4818-9520-a92080f24477 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:55.581060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bb8ad-784a-4818-9520-a92080f24477 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:55.581060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bb8ad-784a-4818-9520-a92080f24477 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:55.582078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 731/1476] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:55.587869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2de94-cb94-4220-b2cd-297e8d158a6d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:55.588383 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2de94-cb94-4220-b2cd-297e8d158a6d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:55.588509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2de94-cb94-4220-b2cd-297e8d158a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:55.664269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2af2de94-cb94-4220-b2cd-297e8d158a6d None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:55.665515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2af2de94-cb94-4220-b2cd-297e8d158a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:55.766790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 746/1477] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:55.789995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bb8ad-784a-4818-9520-a92080f24477 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:55.791643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a94bb8ad-784a-4818-9520-a92080f24477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:55.951231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bb8ad-784a-4818-9520-a92080f24477 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:56.009546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:56.058672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1798781-680a-4198-bb14-4e9474586ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:56.059300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1798781-680a-4198-bb14-4e9474586ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:56.059582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1798781-680a-4198-bb14-4e9474586ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:56.059856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1798781-680a-4198-bb14-4e9474586ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:56.060592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1798781-680a-4198-bb14-4e9474586ea1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:56.062376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-b1798781-680a-4198-bb14-4e9474586ea1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:47:56.062376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Aug 02 08:47:56.062376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: Aug 02 08:47:56.063689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1798781-680a-4198-bb14-4e9474586ea1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:56.083873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 732/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Aug 2 08:47:55 2022] GET /identity/v3/projects => generated 2553 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:47:58.191992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a55b4-6a9e-40ed-8960-916d82e1541e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:58.192555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a55b4-6a9e-40ed-8960-916d82e1541e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:58.192555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a55b4-6a9e-40ed-8960-916d82e1541e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:58.193981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 747/1479] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:58.199466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a22416-b70f-41db-b841-a105db165f0f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:58.199948 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a22416-b70f-41db-b841-a105db165f0f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:58.200045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a22416-b70f-41db-b841-a105db165f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:58.269480 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-95a22416-b70f-41db-b841-a105db165f0f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:58.270825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-95a22416-b70f-41db-b841-a105db165f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:58.380818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 733/1480] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:47:58.425203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a55b4-6a9e-40ed-8960-916d82e1541e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:58.426765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-599a55b4-6a9e-40ed-8960-916d82e1541e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:58.436875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:58.586547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a55b4-6a9e-40ed-8960-916d82e1541e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:58.679547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:58.714384 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40fefd-fbac-4913-a6ea-e48dfd94ae7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:58.714999 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40fefd-fbac-4913-a6ea-e48dfd94ae7f service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:58.715277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40fefd-fbac-4913-a6ea-e48dfd94ae7f service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:58.715547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40fefd-fbac-4913-a6ea-e48dfd94ae7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:58.717199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-da40fefd-fbac-4913-a6ea-e48dfd94ae7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:58.817169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40fefd-fbac-4913-a6ea-e48dfd94ae7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:58.818816 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40fefd-fbac-4913-a6ea-e48dfd94ae7f service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:58.838226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 748/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:48:01.077001 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca074013-5b17-443a-926a-333b8c32ddfc None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:01.077602 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca074013-5b17-443a-926a-333b8c32ddfc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:01.077602 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca074013-5b17-443a-926a-333b8c32ddfc None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:01.079339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 734/1482] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:01.084969 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762ffb6-3b03-43fd-9db3-bc8651526baa None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:01.085490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762ffb6-3b03-43fd-9db3-bc8651526baa None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:01.085600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762ffb6-3b03-43fd-9db3-bc8651526baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:01.155338 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4762ffb6-3b03-43fd-9db3-bc8651526baa None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:01.157227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4762ffb6-3b03-43fd-9db3-bc8651526baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:01.211858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:01.270376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 749/1483] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:48:01.308479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca074013-5b17-443a-926a-333b8c32ddfc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:01.310077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ca074013-5b17-443a-926a-333b8c32ddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:01.337355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:01.424132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca074013-5b17-443a-926a-333b8c32ddfc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:01.507634 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b5029-e533-4f2f-ad17-ad840bc8152b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:01.508308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b5029-e533-4f2f-ad17-ad840bc8152b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:01.508580 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b5029-e533-4f2f-ad17-ad840bc8152b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:01.508852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b5029-e533-4f2f-ad17-ad840bc8152b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:01.510508 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fc5b5029-e533-4f2f-ad17-ad840bc8152b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:01.601837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:01.638775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b5029-e533-4f2f-ad17-ad840bc8152b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:01.640263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b5029-e533-4f2f-ad17-ad840bc8152b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:01.660091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 735/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:48:03.768325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e63f2c-e7f0-4572-b948-a18992b28028 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:03.768912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e63f2c-e7f0-4572-b948-a18992b28028 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:03.768912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e63f2c-e7f0-4572-b948-a18992b28028 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:03.770255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 750/1485] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:03.776404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef6af-9011-43a4-a7b8-0f57d87e4543 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:03.776871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef6af-9011-43a4-a7b8-0f57d87e4543 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:03.776989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef6af-9011-43a4-a7b8-0f57d87e4543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:03.848902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-42fef6af-9011-43a4-a7b8-0f57d87e4543 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:03.850143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-42fef6af-9011-43a4-a7b8-0f57d87e4543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:03.960844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 736/1486] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:48:04.008638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e63f2c-e7f0-4572-b948-a18992b28028 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:04.010190 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d0e63f2c-e7f0-4572-b948-a18992b28028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:04.119008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e63f2c-e7f0-4572-b948-a18992b28028 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:04.193431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:04.195387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c22da3-56fd-4a28-b55e-1a4212432859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:04.196310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c22da3-56fd-4a28-b55e-1a4212432859 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:04.196646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c22da3-56fd-4a28-b55e-1a4212432859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:04.197224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c22da3-56fd-4a28-b55e-1a4212432859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:04.199505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e6c22da3-56fd-4a28-b55e-1a4212432859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:04.330707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c22da3-56fd-4a28-b55e-1a4212432859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:04.332191 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c22da3-56fd-4a28-b55e-1a4212432859 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:04.350487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 751/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:48:06.539993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb99b2d-a2db-470d-97ef-5e329b56fd2f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:06.540597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb99b2d-a2db-470d-97ef-5e329b56fd2f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:06.540597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb99b2d-a2db-470d-97ef-5e329b56fd2f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:06.541952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 737/1488] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:06.547380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331e24c-2f34-4e7c-90a3-34f86d586b3c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:06.547857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331e24c-2f34-4e7c-90a3-34f86d586b3c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:06.547968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331e24c-2f34-4e7c-90a3-34f86d586b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:06.617034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e331e24c-2f34-4e7c-90a3-34f86d586b3c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:06.618262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e331e24c-2f34-4e7c-90a3-34f86d586b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:06.682324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:06.733750 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 752/1489] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:48:06.774937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb99b2d-a2db-470d-97ef-5e329b56fd2f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:06.776580 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4eb99b2d-a2db-470d-97ef-5e329b56fd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:06.814511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:06.893796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb99b2d-a2db-470d-97ef-5e329b56fd2f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:06.988397 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc006c-209d-4df8-9042-efd80e01febc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:06.989020 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc006c-209d-4df8-9042-efd80e01febc service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:06.989297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc006c-209d-4df8-9042-efd80e01febc service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:06.989567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc006c-209d-4df8-9042-efd80e01febc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:06.991205 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c4dc006c-209d-4df8-9042-efd80e01febc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:07.081837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:07.112712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc006c-209d-4df8-9042-efd80e01febc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:07.114167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc006c-209d-4df8-9042-efd80e01febc service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:07.133413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 738/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:48:09.376432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef8be6-b0e1-4482-b25a-8fceb25f91b3 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:09.376991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef8be6-b0e1-4482-b25a-8fceb25f91b3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:09.376991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef8be6-b0e1-4482-b25a-8fceb25f91b3 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:09.378412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 753/1491] 10.222.0.17 () {54 vars in 926 bytes} [Tue Aug 2 08:48:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:09.384013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf413d1-6fd8-4951-b273-28bdf9fffd3e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:09.384525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf413d1-6fd8-4951-b273-28bdf9fffd3e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:09.384635 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf413d1-6fd8-4951-b273-28bdf9fffd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:09.455652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7bf413d1-6fd8-4951-b273-28bdf9fffd3e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:09.456829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7bf413d1-6fd8-4951-b273-28bdf9fffd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:09.558925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 739/1492] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:48:09.599762 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef8be6-b0e1-4482-b25a-8fceb25f91b3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:09.601403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8fef8be6-b0e1-4482-b25a-8fceb25f91b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:09.709600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef8be6-b0e1-4482-b25a-8fceb25f91b3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:09.788477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200a116-a7ff-42ab-841c-4b3589575709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:09.789108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200a116-a7ff-42ab-841c-4b3589575709 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:09.789392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200a116-a7ff-42ab-841c-4b3589575709 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:09.789685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200a116-a7ff-42ab-841c-4b3589575709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:09.791344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f200a116-a7ff-42ab-841c-4b3589575709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:09.801013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:09.908648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200a116-a7ff-42ab-841c-4b3589575709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:09.910094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200a116-a7ff-42ab-841c-4b3589575709 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:09.928736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 754/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:48:19.556921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=82 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:19.926248 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=50 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:39.124300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf8eab-86f1-48e9-9685-219be40e800f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:39.124935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf8eab-86f1-48e9-9685-219be40e800f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:39.124935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf8eab-86f1-48e9-9685-219be40e800f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:39.200339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5ebf8eab-86f1-48e9-9685-219be40e800f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:39.201562 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5ebf8eab-86f1-48e9-9685-219be40e800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:39.303776 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 740/1494] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:49:39.311796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc52df-769c-4e1e-a41e-4c2535fb493b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:39.312339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc52df-769c-4e1e-a41e-4c2535fb493b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:39.312464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc52df-769c-4e1e-a41e-4c2535fb493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:39.396229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-dacc52df-769c-4e1e-a41e-4c2535fb493b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:39.397439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dacc52df-769c-4e1e-a41e-4c2535fb493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:39.500311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 755/1495] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:49:39.501090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf8eab-86f1-48e9-9685-219be40e800f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:39.502307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5ebf8eab-86f1-48e9-9685-219be40e800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:39.516090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf8eab-86f1-48e9-9685-219be40e800f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:39.577146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:39.613940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7564c9-dba6-4a10-8cc7-706392487afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:39.614560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7564c9-dba6-4a10-8cc7-706392487afc admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:39.614845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7564c9-dba6-4a10-8cc7-706392487afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:39.615127 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7564c9-dba6-4a10-8cc7-706392487afc admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:39.615846 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7564c9-dba6-4a10-8cc7-706392487afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:39.616179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7564c9-dba6-4a10-8cc7-706392487afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:39.617191 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-cf7564c9-dba6-4a10-8cc7-706392487afc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:49:39.617191 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Aug 02 08:49:39.617191 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: Aug 02 08:49:39.618071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7564c9-dba6-4a10-8cc7-706392487afc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:39.629905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 741/1496] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:39.638258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc52df-769c-4e1e-a41e-4c2535fb493b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:39.648145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc52df-769c-4e1e-a41e-4c2535fb493b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:39.710362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:39.745022 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2f895-2bbc-4278-9616-5e4a58d5bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:39.745645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f895-2bbc-4278-9616-5e4a58d5bb11 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:39.745926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f895-2bbc-4278-9616-5e4a58d5bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:39.746209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f895-2bbc-4278-9616-5e4a58d5bb11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:39.746895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2f895-2bbc-4278-9616-5e4a58d5bb11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:39.748679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-cce2f895-2bbc-4278-9616-5e4a58d5bb11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:49:39.748679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Aug 02 08:49:39.748679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: Aug 02 08:49:39.749916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2f895-2bbc-4278-9616-5e4a58d5bb11 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:39.805294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 756/1497] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:49:39 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:49:39.809566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7564c9-dba6-4a10-8cc7-706392487afc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:39.811076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cf7564c9-dba6-4a10-8cc7-706392487afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:39.846119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7564c9-dba6-4a10-8cc7-706392487afc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:39.940713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884698a-49d9-4247-90d9-adf7cfe6b7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:39.941254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884698a-49d9-4247-90d9-adf7cfe6b7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:39.941542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884698a-49d9-4247-90d9-adf7cfe6b7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:39.941811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884698a-49d9-4247-90d9-adf7cfe6b7a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:39.942476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884698a-49d9-4247-90d9-adf7cfe6b7a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:39.943485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-d884698a-49d9-4247-90d9-adf7cfe6b7a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:49:39.943485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Aug 02 08:49:39.943485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: Aug 02 08:49:39.944727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884698a-49d9-4247-90d9-adf7cfe6b7a4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:39.986798 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 742/1498] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:49:39 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:49:39.991002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2f895-2bbc-4278-9616-5e4a58d5bb11 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:39.992617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cce2f895-2bbc-4278-9616-5e4a58d5bb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:40.055266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2f895-2bbc-4278-9616-5e4a58d5bb11 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:40.143621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:40.155291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255fb28-7740-42cc-a151-bd9d87343b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:40.155907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255fb28-7740-42cc-a151-bd9d87343b31 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.156748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255fb28-7740-42cc-a151-bd9d87343b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.157029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255fb28-7740-42cc-a151-bd9d87343b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.157713 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255fb28-7740-42cc-a151-bd9d87343b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:40.158744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-5255fb28-7740-42cc-a151-bd9d87343b31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:49:40.158744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Aug 02 08:49:40.158744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: Aug 02 08:49:40.159614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255fb28-7740-42cc-a151-bd9d87343b31 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:40.171880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 757/1499] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:49:40.175911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884698a-49d9-4247-90d9-adf7cfe6b7a4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:40.177493 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d884698a-49d9-4247-90d9-adf7cfe6b7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:40.188864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884698a-49d9-4247-90d9-adf7cfe6b7a4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:40.214553 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:40.285660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaa323-2dab-493d-b407-894b75aabaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:40.286275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa323-2dab-493d-b407-894b75aabaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.286557 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa323-2dab-493d-b407-894b75aabaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.286834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa323-2dab-493d-b407-894b75aabaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.287527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eaa323-2dab-493d-b407-894b75aabaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:40.288570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-46eaa323-2dab-493d-b407-894b75aabaa3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:49:40.288570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Aug 02 08:49:40.288570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: Aug 02 08:49:40.289488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eaa323-2dab-493d-b407-894b75aabaa3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:40.302024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 743/1500] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:49:40.306554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255fb28-7740-42cc-a151-bd9d87343b31 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:40.308073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5255fb28-7740-42cc-a151-bd9d87343b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:40.341393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255fb28-7740-42cc-a151-bd9d87343b31 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:40.438271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1ee9b-f6d3-44f0-a6dd-463101d6dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:40.438945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ee9b-f6d3-44f0-a6dd-463101d6dba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.439228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ee9b-f6d3-44f0-a6dd-463101d6dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.439508 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ee9b-f6d3-44f0-a6dd-463101d6dba4 admin admin] PATH_INFO: `/v3/projects/825b118621f543b2ae81dd63638c7321/users/26bc5deeca354972ada60e72fc789380/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.462131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1ee9b-f6d3-44f0-a6dd-463101d6dba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=825b118621f543b2ae81dd63638c7321, user_id=26bc5deeca354972ada60e72fc789380, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:40.463175 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-39b1ee9b-f6d3-44f0-a6dd-463101d6dba4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:49:40.463175 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Aug 02 08:49:40.463175 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: Aug 02 08:49:40.465204 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1ee9b-f6d3-44f0-a6dd-463101d6dba4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:40.490642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 758/1501] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:49:40 2022] PUT /identity/v3/projects/825b118621f543b2ae81dd63638c7321/users/26bc5deeca354972ada60e72fc789380/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:49:40.503262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dca39-8e60-4b93-af99-aca075b6903e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.503565 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dca39-8e60-4b93-af99-aca075b6903e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.503850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dca39-8e60-4b93-af99-aca075b6903e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.561275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fe7dca39-8e60-4b93-af99-aca075b6903e None None] MFA Rules not processed for user `26bc5deeca354972ada60e72fc789380`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:40.563008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fe7dca39-8e60-4b93-af99-aca075b6903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:40.640240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 744/1502] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:49:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:49:40.653888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec310b-e502-40a6-b1fa-b9ae71276c5d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.654183 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec310b-e502-40a6-b1fa-b9ae71276c5d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.654464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec310b-e502-40a6-b1fa-b9ae71276c5d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.655860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 759/1503] 10.222.0.17 () {54 vars in 964 bytes} [Tue Aug 2 08:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:40.660902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e162851-4481-4b1e-9b86-7ac60b0cc156 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.661195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e162851-4481-4b1e-9b86-7ac60b0cc156 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.661475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e162851-4481-4b1e-9b86-7ac60b0cc156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.693567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:40.742516 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1e162851-4481-4b1e-9b86-7ac60b0cc156 None None] MFA Rules not processed for user `b2c5059aacc149deb6cdb86d3341e78b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:40.743638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1e162851-4481-4b1e-9b86-7ac60b0cc156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:40.820008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 745/1504] 10.222.0.17 () {58 vars in 1061 bytes} [Tue Aug 2 08:49:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:49:40.828217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec310b-e502-40a6-b1fa-b9ae71276c5d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:40.829738 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e7ec310b-e502-40a6-b1fa-b9ae71276c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:40.880727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:40.934329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec310b-e502-40a6-b1fa-b9ae71276c5d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:41.007575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e806f-5541-41ab-bca9-657922588c4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:41.008137 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e806f-5541-41ab-bca9-657922588c4f service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:41.008431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e806f-5541-41ab-bca9-657922588c4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:41.008707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e806f-5541-41ab-bca9-657922588c4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:41.010336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2f9e806f-5541-41ab-bca9-657922588c4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:41.108670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e806f-5541-41ab-bca9-657922588c4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:41.110730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e806f-5541-41ab-bca9-657922588c4f service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:41.114259 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:41.129549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 760/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:49:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:49:41.174609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4241b3-36e5-484d-bbaa-31b7afcc3911 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:41.174905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4241b3-36e5-484d-bbaa-31b7afcc3911 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:41.175189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4241b3-36e5-484d-bbaa-31b7afcc3911 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:41.176531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 746/1506] 10.222.0.17 () {52 vars in 830 bytes} [Tue Aug 2 08:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:41.180197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e806f-5541-41ab-bca9-657922588c4f service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:41.181428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2f9e806f-5541-41ab-bca9-657922588c4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:41.280288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e806f-5541-41ab-bca9-657922588c4f service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:41.376033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:41.376794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:41.376989 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:41.377272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] PATH_INFO: `/v3/users/26bc5deeca354972ada60e72fc789380` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:41.390808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bc5deeca354972ada60e72fc789380)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:41.391941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:49:41.391941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Aug 02 08:49:41.391941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: Aug 02 08:49:41.393219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:41.407464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:41.470234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bc5deeca354972ada60e72fc789380'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:49:41.470812 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bc5deeca354972ada60e72fc789380'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:49:41.481095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bc5deeca354972ada60e72fc789380'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:49:41.507114 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bc5deeca354972ada60e72fc789380'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:49:41.523203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bc5deeca354972ada60e72fc789380'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:49:41.529331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 761/1507] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:49:41 2022] DELETE /identity/v3/users/26bc5deeca354972ada60e72fc789380 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:49:41.534617 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419f808-72c9-4eb6-8927-afaf1837ee38 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:41.534904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419f808-72c9-4eb6-8927-afaf1837ee38 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:41.535228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419f808-72c9-4eb6-8927-afaf1837ee38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:41.596431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2419f808-72c9-4eb6-8927-afaf1837ee38 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:41.597692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2419f808-72c9-4eb6-8927-afaf1837ee38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:41.679618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:41.694095 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 747/1508] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:49:41.705252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:41.706643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:41.818573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e1a4c-d410-4240-93b4-2d87906793c7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:41.882309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:41.908499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb4dd1-83bd-40b4-81f4-5163ba017903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:41.909125 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb4dd1-83bd-40b4-81f4-5163ba017903 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:41.909405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb4dd1-83bd-40b4-81f4-5163ba017903 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:41.909678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb4dd1-83bd-40b4-81f4-5163ba017903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:41.911501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7ccb4dd1-83bd-40b4-81f4-5163ba017903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:42.027051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb4dd1-83bd-40b4-81f4-5163ba017903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:42.028563 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb4dd1-83bd-40b4-81f4-5163ba017903 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:42.048607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 762/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:49:42.382568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419f808-72c9-4eb6-8927-afaf1837ee38 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:42.384078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2419f808-72c9-4eb6-8927-afaf1837ee38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:42.396937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419f808-72c9-4eb6-8927-afaf1837ee38 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:42.498579 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:42.499230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:42.499514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:42.499794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] PATH_INFO: `/v3/projects/825b118621f543b2ae81dd63638c7321` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:42.509734 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=825b118621f543b2ae81dd63638c7321)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:42.510757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:49:42.510757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Aug 02 08:49:42.510757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: Aug 02 08:49:42.511957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:42.570169 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '825b118621f543b2ae81dd63638c7321', 'request_id': 'req-d370ec02-d840-4bde-9847-1b3c30776a9b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:49:42.576193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '825b118621f543b2ae81dd63638c7321', 'request_id': 'req-d370ec02-d840-4bde-9847-1b3c30776a9b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:49:42.589891 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '825b118621f543b2ae81dd63638c7321', 'request_id': 'req-d370ec02-d840-4bde-9847-1b3c30776a9b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:49:42.618314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] The token cache is being invalidate because project 825b118621f543b2ae81dd63638c7321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:49:42.618603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:49:42.619126 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d370ec02-d840-4bde-9847-1b3c30776a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:49:42.620486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 748/1510] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:49:42 2022] DELETE /identity/v3/projects/825b118621f543b2ae81dd63638c7321 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:49:52.045689 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=62 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:52.616249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:28.456011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5fd55-691c-46be-868d-1413eb61ccfa None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:28.456624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5fd55-691c-46be-868d-1413eb61ccfa None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:28.456624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5fd55-691c-46be-868d-1413eb61ccfa None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:28.458221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:28.463171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b5c3-511e-43b3-b1ef-dd694ffc51ec None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:28.463625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b5c3-511e-43b3-b1ef-dd694ffc51ec None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:28.463835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b5c3-511e-43b3-b1ef-dd694ffc51ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:28.544436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0e00b5c3-511e-43b3-b1ef-dd694ffc51ec None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:28.545644 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0e00b5c3-511e-43b3-b1ef-dd694ffc51ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:28.654315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:51:28.809159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5fd55-691c-46be-868d-1413eb61ccfa None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:28.811377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c0d5fd55-691c-46be-868d-1413eb61ccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:28.934946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5fd55-691c-46be-868d-1413eb61ccfa None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:28.941143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2628a-3652-4e7a-bddc-fbdc8f7aaf8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:28.941759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2628a-3652-4e7a-bddc-fbdc8f7aaf8c service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:28.942056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2628a-3652-4e7a-bddc-fbdc8f7aaf8c service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:28.942343 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2628a-3652-4e7a-bddc-fbdc8f7aaf8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:28.950392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2628a-3652-4e7a-bddc-fbdc8f7aaf8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:28.951974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2628a-3652-4e7a-bddc-fbdc8f7aaf8c service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:28.961616 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 764/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:51:29.797880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4393bc7-b51e-4e31-936b-db2e92b02280 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:29.798410 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4393bc7-b51e-4e31-936b-db2e92b02280 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:29.798621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4393bc7-b51e-4e31-936b-db2e92b02280 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:29.800066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:29.805319 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22064c9c-0a83-403b-ade9-418684914a02 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:29.805709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22064c9c-0a83-403b-ade9-418684914a02 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:29.805878 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22064c9c-0a83-403b-ade9-418684914a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:29.825723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-22064c9c-0a83-403b-ade9-418684914a02 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:29.826913 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-22064c9c-0a83-403b-ade9-418684914a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:29.835028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:51:29.986099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4393bc7-b51e-4e31-936b-db2e92b02280 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:30.000428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4393bc7-b51e-4e31-936b-db2e92b02280 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:30.005937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda91ebe-56fa-45e2-8a82-1d0d53dbb7f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:30.006551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda91ebe-56fa-45e2-8a82-1d0d53dbb7f2 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:30.006837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda91ebe-56fa-45e2-8a82-1d0d53dbb7f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:30.007119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda91ebe-56fa-45e2-8a82-1d0d53dbb7f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:30.015499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda91ebe-56fa-45e2-8a82-1d0d53dbb7f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:30.017122 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda91ebe-56fa-45e2-8a82-1d0d53dbb7f2 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:30.026691 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 751/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:51:30.318648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab9f48-a7f3-4467-a694-7af1088e06cb None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:30.318876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab9f48-a7f3-4467-a694-7af1088e06cb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:30.319130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab9f48-a7f3-4467-a694-7af1088e06cb None None] PATH_INFO: `/v3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:30.320492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 766/1517] 10.222.0.61 () {54 vars in 925 bytes} [Tue Aug 2 08:51:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:30.327937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35bd40-d803-4408-a85d-ccf8eda8cdb2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:30.328318 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35bd40-d803-4408-a85d-ccf8eda8cdb2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:30.328679 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35bd40-d803-4408-a85d-ccf8eda8cdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:30.388562 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-de35bd40-d803-4408-a85d-ccf8eda8cdb2 None None] MFA Rules not processed for user `cd9f2dc3c1c442b4b1b09964ff7c000b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:30.389873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-de35bd40-d803-4408-a85d-ccf8eda8cdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:30.407076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:30.462545 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 752/1518] 10.222.0.61 () {58 vars in 1015 bytes} [Tue Aug 2 08:51:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:51:39.579769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074422b-80dc-4be2-8eee-20d4514f9d50 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:39.580355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074422b-80dc-4be2-8eee-20d4514f9d50 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:39.580355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074422b-80dc-4be2-8eee-20d4514f9d50 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:39.581627 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 767/1519] 10.222.0.17 () {54 vars in 961 bytes} [Tue Aug 2 08:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:39.587156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1a7a9-e02e-415a-aa58-bcd843cbd9c1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:39.587638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1a7a9-e02e-415a-aa58-bcd843cbd9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:39.587739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1a7a9-e02e-415a-aa58-bcd843cbd9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:39.619096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4bc1a7a9-e02e-415a-aa58-bcd843cbd9c1 None None] MFA Rules not processed for user `cd9f2dc3c1c442b4b1b09964ff7c000b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:39.621222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4bc1a7a9-e02e-415a-aa58-bcd843cbd9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:39.632830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 753/1520] 10.222.0.17 () {58 vars in 1058 bytes} [Tue Aug 2 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:51:39.640455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074422b-80dc-4be2-8eee-20d4514f9d50 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:39.654537 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074422b-80dc-4be2-8eee-20d4514f9d50 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:39.659553 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a190a0-8f96-4c88-a106-eeeb315e415b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:39.660212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a190a0-8f96-4c88-a106-eeeb315e415b service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:39.660491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a190a0-8f96-4c88-a106-eeeb315e415b service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:39.660744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a190a0-8f96-4c88-a106-eeeb315e415b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:39.669506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a190a0-8f96-4c88-a106-eeeb315e415b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:39.671093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a190a0-8f96-4c88-a106-eeeb315e415b service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:39.680973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 768/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:51:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:51:41.232979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e24951-b9e2-4fbf-b0ed-e01f3b169e48 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:41.233503 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e24951-b9e2-4fbf-b0ed-e01f3b169e48 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:41.233503 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e24951-b9e2-4fbf-b0ed-e01f3b169e48 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:41.234862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:41.239760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03596230-2d3e-4cd7-a548-0202df3a834f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:41.240177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03596230-2d3e-4cd7-a548-0202df3a834f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:41.240345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03596230-2d3e-4cd7-a548-0202df3a834f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:41.259722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-03596230-2d3e-4cd7-a548-0202df3a834f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:41.260942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-03596230-2d3e-4cd7-a548-0202df3a834f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:41.269347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:51:41.422895 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e24951-b9e2-4fbf-b0ed-e01f3b169e48 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:41.436987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e24951-b9e2-4fbf-b0ed-e01f3b169e48 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:41.442966 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4587e-979b-4851-8e80-4b6e64c4dc4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:41.443567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4587e-979b-4851-8e80-4b6e64c4dc4d service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:41.443846 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4587e-979b-4851-8e80-4b6e64c4dc4d service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:41.444133 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4587e-979b-4851-8e80-4b6e64c4dc4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:41.452041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4587e-979b-4851-8e80-4b6e64c4dc4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:41.453629 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4587e-979b-4851-8e80-4b6e64c4dc4d service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:41.463152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 755/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:51:42.293497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c77cf-378e-4e93-ba4b-35236b98ebcb None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:42.294023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c77cf-378e-4e93-ba4b-35236b98ebcb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:42.294141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c77cf-378e-4e93-ba4b-35236b98ebcb None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:42.295459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:42.300447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52bbb5-4013-4160-94f3-73a2c0174d62 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:42.300887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52bbb5-4013-4160-94f3-73a2c0174d62 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:42.301006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52bbb5-4013-4160-94f3-73a2c0174d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:42.320021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fa52bbb5-4013-4160-94f3-73a2c0174d62 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:42.321319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fa52bbb5-4013-4160-94f3-73a2c0174d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:42.329690 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:51:42.483544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c77cf-378e-4e93-ba4b-35236b98ebcb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:42.498239 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c77cf-378e-4e93-ba4b-35236b98ebcb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:42.503991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2126b4-f5b1-406e-8ef2-f915df176fa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:42.504744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2126b4-f5b1-406e-8ef2-f915df176fa9 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:42.505036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2126b4-f5b1-406e-8ef2-f915df176fa9 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:42.505317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2126b4-f5b1-406e-8ef2-f915df176fa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:42.514173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2126b4-f5b1-406e-8ef2-f915df176fa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:42.516332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2126b4-f5b1-406e-8ef2-f915df176fa9 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:42.527639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 771/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:51:46.594441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb8749-498b-41f2-a7bc-3f67e4a631be None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:46.595260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb8749-498b-41f2-a7bc-3f67e4a631be None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:46.595260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb8749-498b-41f2-a7bc-3f67e4a631be None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:46.596406 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:51:46.602648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebad0a-898d-4c25-9f9f-586afe464c7e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:46.603181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebad0a-898d-4c25-9f9f-586afe464c7e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:46.603181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebad0a-898d-4c25-9f9f-586afe464c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:46.622714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f4ebad0a-898d-4c25-9f9f-586afe464c7e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:46.623936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f4ebad0a-898d-4c25-9f9f-586afe464c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:46.632698 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:51:46.709449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb8749-498b-41f2-a7bc-3f67e4a631be None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:46.711197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-24fb8749-498b-41f2-a7bc-3f67e4a631be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:46.799087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb8749-498b-41f2-a7bc-3f67e4a631be None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:46.802846 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244516b-7c78-433d-8d72-f82bf5932836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:46.803786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244516b-7c78-433d-8d72-f82bf5932836 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:46.803786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244516b-7c78-433d-8d72-f82bf5932836 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:46.803999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244516b-7c78-433d-8d72-f82bf5932836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:46.815320 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244516b-7c78-433d-8d72-f82bf5932836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:46.816889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244516b-7c78-433d-8d72-f82bf5932836 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:46.827302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 758/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:51:48.847704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80cbf2-6f0f-4901-8dbb-9e9d2b24830d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:48.848366 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80cbf2-6f0f-4901-8dbb-9e9d2b24830d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:48.848366 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80cbf2-6f0f-4901-8dbb-9e9d2b24830d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:48.849646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:48.854933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73244d-0627-4774-94cb-d2b8c3708778 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:48.855357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73244d-0627-4774-94cb-d2b8c3708778 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:48.855490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73244d-0627-4774-94cb-d2b8c3708778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:48.875691 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9e73244d-0627-4774-94cb-d2b8c3708778 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:48.876927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9e73244d-0627-4774-94cb-d2b8c3708778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:48.884925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:51:48.921114 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80cbf2-6f0f-4901-8dbb-9e9d2b24830d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:48.932488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80cbf2-6f0f-4901-8dbb-9e9d2b24830d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:48.936003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0051860-9e60-478e-96b4-d7b3e8030063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:48.936641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0051860-9e60-478e-96b4-d7b3e8030063 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:48.936927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0051860-9e60-478e-96b4-d7b3e8030063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:48.937736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0051860-9e60-478e-96b4-d7b3e8030063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:48.946912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0051860-9e60-478e-96b4-d7b3e8030063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:48.948385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0051860-9e60-478e-96b4-d7b3e8030063 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:48.958264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 774/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:51:52.486830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157786d-26f6-46df-9583-d95e6f92d67a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:52.487438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157786d-26f6-46df-9583-d95e6f92d67a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:52.487663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157786d-26f6-46df-9583-d95e6f92d67a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:52.489062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:52.494501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abcd88-3afc-43a0-ac97-1d3ce414c623 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:52.494981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abcd88-3afc-43a0-ac97-1d3ce414c623 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:52.495096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abcd88-3afc-43a0-ac97-1d3ce414c623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:52.503489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=81 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:52.517257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-52abcd88-3afc-43a0-ac97-1d3ce414c623 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:52.518472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-52abcd88-3afc-43a0-ac97-1d3ce414c623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:52.526351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:51:52.837467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157786d-26f6-46df-9583-d95e6f92d67a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:52.839147 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5157786d-26f6-46df-9583-d95e6f92d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:52.904338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:52.918053 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157786d-26f6-46df-9583-d95e6f92d67a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:52.922067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f23fbc-799d-45f9-a835-d650e64ffb9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:52.922679 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f23fbc-799d-45f9-a835-d650e64ffb9c service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:52.922956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f23fbc-799d-45f9-a835-d650e64ffb9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:52.923225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f23fbc-799d-45f9-a835-d650e64ffb9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:52.933560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f23fbc-799d-45f9-a835-d650e64ffb9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:52.934981 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f23fbc-799d-45f9-a835-d650e64ffb9c service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:52.944785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 761/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:51:55.004472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42e450-8fdc-49b9-813d-759d81c0e8df None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:55.005030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42e450-8fdc-49b9-813d-759d81c0e8df None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:55.005030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42e450-8fdc-49b9-813d-759d81c0e8df None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:55.006407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:55.011975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7571c9-9edd-4157-abcd-95630229f5bb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:55.012470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7571c9-9edd-4157-abcd-95630229f5bb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:55.012585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7571c9-9edd-4157-abcd-95630229f5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:55.032719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ad7571c9-9edd-4157-abcd-95630229f5bb None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:55.033974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ad7571c9-9edd-4157-abcd-95630229f5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:55.041971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:51:55.364034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42e450-8fdc-49b9-813d-759d81c0e8df None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:55.365781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ad42e450-8fdc-49b9-813d-759d81c0e8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:55.379032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42e450-8fdc-49b9-813d-759d81c0e8df None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:55.383928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d28f40-dd5e-44d2-a7ed-be26b94dc2c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:55.384604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d28f40-dd5e-44d2-a7ed-be26b94dc2c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:55.384886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d28f40-dd5e-44d2-a7ed-be26b94dc2c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:55.385160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d28f40-dd5e-44d2-a7ed-be26b94dc2c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:55.394789 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d28f40-dd5e-44d2-a7ed-be26b94dc2c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:55.396290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d28f40-dd5e-44d2-a7ed-be26b94dc2c3 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:55.406328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 777/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:52:05.027829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=11 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:05.401663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=8 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:29.106698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02fd04-c179-4d7a-8227-8cba1a97da2d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.107354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02fd04-c179-4d7a-8227-8cba1a97da2d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.107354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02fd04-c179-4d7a-8227-8cba1a97da2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.133904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-df02fd04-c179-4d7a-8227-8cba1a97da2d None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:29.135149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-df02fd04-c179-4d7a-8227-8cba1a97da2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:29.151590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 763/1540] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:29.160857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab0e78-ad56-45e3-84c3-4cf4f58a1de0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.161800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab0e78-ad56-45e3-84c3-4cf4f58a1de0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.162245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab0e78-ad56-45e3-84c3-4cf4f58a1de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.190297 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b9ab0e78-ad56-45e3-84c3-4cf4f58a1de0 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:29.191805 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b9ab0e78-ad56-45e3-84c3-4cf4f58a1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:29.203071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 778/1541] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:29.208848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02fd04-c179-4d7a-8227-8cba1a97da2d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:29.225972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02fd04-c179-4d7a-8227-8cba1a97da2d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:29.237029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c26873-bf9e-43c3-845d-d7ef377ad280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:29.237856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c26873-bf9e-43c3-845d-d7ef377ad280 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.238151 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c26873-bf9e-43c3-845d-d7ef377ad280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.238427 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c26873-bf9e-43c3-845d-d7ef377ad280 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.239175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c26873-bf9e-43c3-845d-d7ef377ad280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:29.239910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c26873-bf9e-43c3-845d-d7ef377ad280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:29.242021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c26873-bf9e-43c3-845d-d7ef377ad280 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:29.261908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 764/1542] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:29.270788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab0e78-ad56-45e3-84c3-4cf4f58a1de0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:29.285046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab0e78-ad56-45e3-84c3-4cf4f58a1de0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:29.296781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acc179-d3c3-4a12-a9ea-d82093f2fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:29.297908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acc179-d3c3-4a12-a9ea-d82093f2fcc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.298421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acc179-d3c3-4a12-a9ea-d82093f2fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.298925 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acc179-d3c3-4a12-a9ea-d82093f2fcc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.299826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acc179-d3c3-4a12-a9ea-d82093f2fcc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:29.302066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acc179-d3c3-4a12-a9ea-d82093f2fcc9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:29.355253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 779/1543] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:29 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:29.365076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c26873-bf9e-43c3-845d-d7ef377ad280 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:29.382356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c26873-bf9e-43c3-845d-d7ef377ad280 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:29.489339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34a682-4624-4dec-9276-51f573605a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:29.489993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34a682-4624-4dec-9276-51f573605a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.490284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34a682-4624-4dec-9276-51f573605a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.490567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34a682-4624-4dec-9276-51f573605a0c admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.491254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34a682-4624-4dec-9276-51f573605a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:29.493309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34a682-4624-4dec-9276-51f573605a0c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:29.525564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 765/1544] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:29 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:53:29.529866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acc179-d3c3-4a12-a9ea-d82093f2fcc9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:29.546202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acc179-d3c3-4a12-a9ea-d82093f2fcc9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:29.570329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695c203-00c4-4dc6-9199-ef0599d4cca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:29.571437 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695c203-00c4-4dc6-9199-ef0599d4cca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.571724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695c203-00c4-4dc6-9199-ef0599d4cca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.572008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695c203-00c4-4dc6-9199-ef0599d4cca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.572775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695c203-00c4-4dc6-9199-ef0599d4cca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:29.576327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695c203-00c4-4dc6-9199-ef0599d4cca0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:29.595773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 780/1545] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:29.599909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34a682-4624-4dec-9276-51f573605a0c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:29.620425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34a682-4624-4dec-9276-51f573605a0c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:29.630519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e8f02-746a-4779-9a6e-75e85cfb57a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:29.631167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e8f02-746a-4779-9a6e-75e85cfb57a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.631454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e8f02-746a-4779-9a6e-75e85cfb57a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.631731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e8f02-746a-4779-9a6e-75e85cfb57a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.633060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e8f02-746a-4779-9a6e-75e85cfb57a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:29.634710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e8f02-746a-4779-9a6e-75e85cfb57a8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:29.663863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 766/1546] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:29.667945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695c203-00c4-4dc6-9199-ef0599d4cca0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:29.686675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695c203-00c4-4dc6-9199-ef0599d4cca0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:29.688681 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715153c0-6833-4d97-bf90-e610be719c38 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.688977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715153c0-6833-4d97-bf90-e610be719c38 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.689250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715153c0-6833-4d97-bf90-e610be719c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.702020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9688650-f3ad-4eb3-909a-bdd32e2a2449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:29.702721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9688650-f3ad-4eb3-909a-bdd32e2a2449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.703002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9688650-f3ad-4eb3-909a-bdd32e2a2449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.703280 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9688650-f3ad-4eb3-909a-bdd32e2a2449 admin admin] PATH_INFO: `/v3/projects/1cb1f802c78a4317a0af32afb533eb8a/users/e846d960fa87451db8ae291e22b3cb7b/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.731614 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-715153c0-6833-4d97-bf90-e610be719c38 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:29.733341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-715153c0-6833-4d97-bf90-e610be719c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:29.733546 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9688650-f3ad-4eb3-909a-bdd32e2a2449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb1f802c78a4317a0af32afb533eb8a, user_id=e846d960fa87451db8ae291e22b3cb7b, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:29.736849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9688650-f3ad-4eb3-909a-bdd32e2a2449 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:29.750143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 767/1547] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:53:29.754044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fcc22-4ad1-4def-b084-98181277d7ba None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.754753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fcc22-4ad1-4def-b084-98181277d7ba None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.755249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fcc22-4ad1-4def-b084-98181277d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.764746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 781/1548] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:29 2022] PUT /identity/v3/projects/1cb1f802c78a4317a0af32afb533eb8a/users/e846d960fa87451db8ae291e22b3cb7b/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:29.766662 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d181a-f2d4-4f00-b1f3-14a2e3812369 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.770648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d181a-f2d4-4f00-b1f3-14a2e3812369 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.770951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d181a-f2d4-4f00-b1f3-14a2e3812369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.801737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-885d181a-f2d4-4f00-b1f3-14a2e3812369 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:29.802342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-670fcc22-4ad1-4def-b084-98181277d7ba None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:29.802975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-885d181a-f2d4-4f00-b1f3-14a2e3812369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:29.804176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-670fcc22-4ad1-4def-b084-98181277d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:29.918247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 768/1549] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:29.920734 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533989e-4aa2-4c4a-92c1-0f1dc4fecbc9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.921030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533989e-4aa2-4c4a-92c1-0f1dc4fecbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.922075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533989e-4aa2-4c4a-92c1-0f1dc4fecbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.951888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 782/1550] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:29.954002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6708c35-82b9-42a5-8d0d-49c636023e61 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.954494 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6708c35-82b9-42a5-8d0d-49c636023e61 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.955049 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6708c35-82b9-42a5-8d0d-49c636023e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.963685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a533989e-4aa2-4c4a-92c1-0f1dc4fecbc9 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:29.964977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a533989e-4aa2-4c4a-92c1-0f1dc4fecbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:29.980686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 769/1551] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:29.982290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae398c-b191-450e-b94a-69436d08af6c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:29.982580 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae398c-b191-450e-b94a-69436d08af6c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:29.982859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae398c-b191-450e-b94a-69436d08af6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:29.995372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d6708c35-82b9-42a5-8d0d-49c636023e61 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:29.996636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d6708c35-82b9-42a5-8d0d-49c636023e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:30.013916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-26ae398c-b191-450e-b94a-69436d08af6c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:30.015368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-26ae398c-b191-450e-b94a-69436d08af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:30.022059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 783/1552] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:30.023371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c512123-d580-479c-8d7c-d28bf9cc858c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.023663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c512123-d580-479c-8d7c-d28bf9cc858c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.023945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c512123-d580-479c-8d7c-d28bf9cc858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.036331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 770/1553] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:30.037174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae398c-b191-450e-b94a-69436d08af6c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.058148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae398c-b191-450e-b94a-69436d08af6c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.064173 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2596079-30d6-4730-8f89-0421e6b1abfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.065962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596079-30d6-4730-8f89-0421e6b1abfa admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.066231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596079-30d6-4730-8f89-0421e6b1abfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.066512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596079-30d6-4730-8f89-0421e6b1abfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.067216 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2596079-30d6-4730-8f89-0421e6b1abfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:30.067523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2596079-30d6-4730-8f89-0421e6b1abfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.069151 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2596079-30d6-4730-8f89-0421e6b1abfa admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.072114 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9c512123-d580-479c-8d7c-d28bf9cc858c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:30.074135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9c512123-d580-479c-8d7c-d28bf9cc858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:30.084164 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 771/1554] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:30.085588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be8f0-b592-4b9d-8b72-1cc1b5af239c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.086155 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be8f0-b592-4b9d-8b72-1cc1b5af239c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.086605 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be8f0-b592-4b9d-8b72-1cc1b5af239c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.092685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 784/1555] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:30.097494 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c512123-d580-479c-8d7c-d28bf9cc858c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.116814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7e3be8f0-b592-4b9d-8b72-1cc1b5af239c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:30.118987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7e3be8f0-b592-4b9d-8b72-1cc1b5af239c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:30.128772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 772/1556] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:30.133873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096404-b923-4f77-ac5a-883790587fd4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.135403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096404-b923-4f77-ac5a-883790587fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.135860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096404-b923-4f77-ac5a-883790587fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.166795 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d2096404-b923-4f77-ac5a-883790587fd4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:30.168003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d2096404-b923-4f77-ac5a-883790587fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:30.173650 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c512123-d580-479c-8d7c-d28bf9cc858c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.177177 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 773/1557] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:30.177430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f70d47-e054-4a3f-a96a-6f7f7a2a567b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.177994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f70d47-e054-4a3f-a96a-6f7f7a2a567b service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.178279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f70d47-e054-4a3f-a96a-6f7f7a2a567b service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.178552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f70d47-e054-4a3f-a96a-6f7f7a2a567b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.181803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742618-7f7a-45a1-9578-df0e12b02071 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.182089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742618-7f7a-45a1-9578-df0e12b02071 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.182369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742618-7f7a-45a1-9578-df0e12b02071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.189562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f70d47-e054-4a3f-a96a-6f7f7a2a567b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.191180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f70d47-e054-4a3f-a96a-6f7f7a2a567b service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.201898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 785/1558] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:30.202593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f70d47-e054-4a3f-a96a-6f7f7a2a567b service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.217567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-41742618-7f7a-45a1-9578-df0e12b02071 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:30.218736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f70d47-e054-4a3f-a96a-6f7f7a2a567b service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.219357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-41742618-7f7a-45a1-9578-df0e12b02071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:30.224688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d82f6-b36d-416f-9241-652515d65c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.225314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d82f6-b36d-416f-9241-652515d65c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.225600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d82f6-b36d-416f-9241-652515d65c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.225873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d82f6-b36d-416f-9241-652515d65c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.226573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d82f6-b36d-416f-9241-652515d65c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:30.226876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d82f6-b36d-416f-9241-652515d65c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.227909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-b56d82f6-b36d-416f-9241-652515d65c89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:53:30.227909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Aug 02 08:53:30.227909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: Aug 02 08:53:30.228866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d82f6-b36d-416f-9241-652515d65c89 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.238130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 774/1559] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:30.238130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742618-7f7a-45a1-9578-df0e12b02071 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.246439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742618-7f7a-45a1-9578-df0e12b02071 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.253226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 786/1560] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:30.253226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d82f6-b36d-416f-9241-652515d65c89 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.257783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aeeb9e-c492-4068-ad13-5ccc009eacf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.257783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeeb9e-c492-4068-ad13-5ccc009eacf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.257783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeeb9e-c492-4068-ad13-5ccc009eacf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.257783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeeb9e-c492-4068-ad13-5ccc009eacf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.258475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aeeb9e-c492-4068-ad13-5ccc009eacf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.258475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-b8aeeb9e-c492-4068-ad13-5ccc009eacf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:53:30.258475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Aug 02 08:53:30.258475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: Aug 02 08:53:30.259487 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aeeb9e-c492-4068-ad13-5ccc009eacf3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.261442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:30.266702 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:30.268798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d82f6-b36d-416f-9241-652515d65c89 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.274174 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3583e5-590e-4a66-ae0c-b82adb2e4c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.274893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3583e5-590e-4a66-ae0c-b82adb2e4c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.275256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3583e5-590e-4a66-ae0c-b82adb2e4c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.275599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3583e5-590e-4a66-ae0c-b82adb2e4c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.276432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3583e5-590e-4a66-ae0c-b82adb2e4c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:30.277072 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3583e5-590e-4a66-ae0c-b82adb2e4c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.278538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3583e5-590e-4a66-ae0c-b82adb2e4c44 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.292970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 787/1561] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:30.294724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9474798-8d7f-4594-86c9-7bc56a6f832a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.295177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9474798-8d7f-4594-86c9-7bc56a6f832a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.296031 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9474798-8d7f-4594-86c9-7bc56a6f832a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.297110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 775/1562] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:30.298004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aeeb9e-c492-4068-ad13-5ccc009eacf3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.319498 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c9474798-8d7f-4594-86c9-7bc56a6f832a None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:30.320890 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c9474798-8d7f-4594-86c9-7bc56a6f832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:30.379411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aeeb9e-c492-4068-ad13-5ccc009eacf3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.384523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a6d63-5b08-4443-bb03-a7a98b740ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.385257 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a6d63-5b08-4443-bb03-a7a98b740ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.385614 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a6d63-5b08-4443-bb03-a7a98b740ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.385998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a6d63-5b08-4443-bb03-a7a98b740ce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.386788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a6d63-5b08-4443-bb03-a7a98b740ce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:30.387646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a6d63-5b08-4443-bb03-a7a98b740ce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.388904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a6d63-5b08-4443-bb03-a7a98b740ce9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.393033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 788/1563] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:30.394042 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8e195-b037-4517-9e95-33afcb1d0bad None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.394410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8e195-b037-4517-9e95-33afcb1d0bad None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.394780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8e195-b037-4517-9e95-33afcb1d0bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.404639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 776/1564] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:30.405714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b2a8d-6c95-442b-b755-444c2959b13d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.406114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b2a8d-6c95-442b-b755-444c2959b13d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.406513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b2a8d-6c95-442b-b755-444c2959b13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.423631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-42c8e195-b037-4517-9e95-33afcb1d0bad None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:30.424919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-42c8e195-b037-4517-9e95-33afcb1d0bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:30.441993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 789/1565] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:30.441993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8e195-b037-4517-9e95-33afcb1d0bad None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.448909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8e195-b037-4517-9e95-33afcb1d0bad None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.449108 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-922b2a8d-6c95-442b-b755-444c2959b13d None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:30.451246 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-922b2a8d-6c95-442b-b755-444c2959b13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:30.454557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c93e45-5512-48e2-834b-c83e1dad2e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.455201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c93e45-5512-48e2-834b-c83e1dad2e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.455487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c93e45-5512-48e2-834b-c83e1dad2e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.455767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c93e45-5512-48e2-834b-c83e1dad2e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.456502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c93e45-5512-48e2-834b-c83e1dad2e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.458809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c93e45-5512-48e2-834b-c83e1dad2e00 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.468520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 777/1566] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:30.468520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b2a8d-6c95-442b-b755-444c2959b13d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.478825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b2a8d-6c95-442b-b755-444c2959b13d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.485094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdba9af-6182-44bd-bd93-fa69c3d86c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.486142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdba9af-6182-44bd-bd93-fa69c3d86c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.486646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdba9af-6182-44bd-bd93-fa69c3d86c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.487116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdba9af-6182-44bd-bd93-fa69c3d86c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.488380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdba9af-6182-44bd-bd93-fa69c3d86c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.493014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdba9af-6182-44bd-bd93-fa69c3d86c2c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.505350 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 790/1567] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:30.506425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c93e45-5512-48e2-834b-c83e1dad2e00 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.531250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 778/1568] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/projects => generated 389 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:30.536558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c80ef9-a829-450e-80a4-cf658b1fa067 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.536558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c80ef9-a829-450e-80a4-cf658b1fa067 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.536834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c80ef9-a829-450e-80a4-cf658b1fa067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.559319 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-23c80ef9-a829-450e-80a4-cf658b1fa067 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:30.560626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-23c80ef9-a829-450e-80a4-cf658b1fa067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:30.590728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c93e45-5512-48e2-834b-c83e1dad2e00 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.651136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 779/1569] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:30.652415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c80ef9-a829-450e-80a4-cf658b1fa067 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.666681 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c80ef9-a829-450e-80a4-cf658b1fa067 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.674080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddb8f2-4701-4507-94bd-eccb1dc58b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.675100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddb8f2-4701-4507-94bd-eccb1dc58b8f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.675558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddb8f2-4701-4507-94bd-eccb1dc58b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.676064 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddb8f2-4701-4507-94bd-eccb1dc58b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.677051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddb8f2-4701-4507-94bd-eccb1dc58b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.679261 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddb8f2-4701-4507-94bd-eccb1dc58b8f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.679431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a28ed3-0687-420a-9c9c-ebe187b4063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.680006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a28ed3-0687-420a-9c9c-ebe187b4063c admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.680411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a28ed3-0687-420a-9c9c-ebe187b4063c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.680691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a28ed3-0687-420a-9c9c-ebe187b4063c admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.681376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a28ed3-0687-420a-9c9c-ebe187b4063c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.682663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-12a28ed3-0687-420a-9c9c-ebe187b4063c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:53:30.682663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Aug 02 08:53:30.682663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: Aug 02 08:53:30.684644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a28ed3-0687-420a-9c9c-ebe187b4063c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.706141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:30.722033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 791/1570] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/users => generated 284 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:30.722268 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 780/1571] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:30.722397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a28ed3-0687-420a-9c9c-ebe187b4063c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.722484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bf7ec-daef-411c-bebf-4aa358ebf460 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.722484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bf7ec-daef-411c-bebf-4aa358ebf460 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.722484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bf7ec-daef-411c-bebf-4aa358ebf460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.731044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a28ed3-0687-420a-9c9c-ebe187b4063c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.742196 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9d7bf7ec-daef-411c-bebf-4aa358ebf460 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:30.743539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9d7bf7ec-daef-411c-bebf-4aa358ebf460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:30.780878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:30.815866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86867b8b-dbb8-4c63-a9af-5e78afe8157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.817108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86867b8b-dbb8-4c63-a9af-5e78afe8157e admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.817744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86867b8b-dbb8-4c63-a9af-5e78afe8157e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.818041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86867b8b-dbb8-4c63-a9af-5e78afe8157e admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.819381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86867b8b-dbb8-4c63-a9af-5e78afe8157e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:30.819765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86867b8b-dbb8-4c63-a9af-5e78afe8157e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.822234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86867b8b-dbb8-4c63-a9af-5e78afe8157e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.839344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 781/1572] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:30.844162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 792/1573] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:30.845518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bf7ec-daef-411c-bebf-4aa358ebf460 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.846273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86867b8b-dbb8-4c63-a9af-5e78afe8157e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.860350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bf7ec-daef-411c-bebf-4aa358ebf460 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.861264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86867b8b-dbb8-4c63-a9af-5e78afe8157e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.865139 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836767-b4c5-44f0-8067-9cf4d21553ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.865998 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a5e1-b219-45d1-9ab4-8c219f735ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.866205 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836767-b4c5-44f0-8067-9cf4d21553ee admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.866592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836767-b4c5-44f0-8067-9cf4d21553ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.866771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a5e1-b219-45d1-9ab4-8c219f735ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.867091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836767-b4c5-44f0-8067-9cf4d21553ee admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.867269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a5e1-b219-45d1-9ab4-8c219f735ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.867269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a5e1-b219-45d1-9ab4-8c219f735ed3 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.867547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836767-b4c5-44f0-8067-9cf4d21553ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.867945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777a5e1-b219-45d1-9ab4-8c219f735ed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.869679 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836767-b4c5-44f0-8067-9cf4d21553ee admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.869884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777a5e1-b219-45d1-9ab4-8c219f735ed3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.902417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 793/1574] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/users => generated 295 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:30.902417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a5e1-b219-45d1-9ab4-8c219f735ed3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.906927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 782/1575] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/users => generated 291 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:30.908768 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836767-b4c5-44f0-8067-9cf4d21553ee admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.916313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a5e1-b219-45d1-9ab4-8c219f735ed3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.920025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836767-b4c5-44f0-8067-9cf4d21553ee admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.921263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fef011-ad08-4c19-98af-2f9b728ea902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.921908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fef011-ad08-4c19-98af-2f9b728ea902 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.922326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fef011-ad08-4c19-98af-2f9b728ea902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.922707 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fef011-ad08-4c19-98af-2f9b728ea902 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.925397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fef011-ad08-4c19-98af-2f9b728ea902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:30.925397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fef011-ad08-4c19-98af-2f9b728ea902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.926820 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fef011-ad08-4c19-98af-2f9b728ea902 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.932911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2721a-86e3-423a-be8c-34cd2baa63db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.933756 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2721a-86e3-423a-be8c-34cd2baa63db admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.934068 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2721a-86e3-423a-be8c-34cd2baa63db admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.935224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2721a-86e3-423a-be8c-34cd2baa63db admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.936152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2721a-86e3-423a-be8c-34cd2baa63db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.939189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2721a-86e3-423a-be8c-34cd2baa63db admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.941437 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 794/1576] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:30.942279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fef011-ad08-4c19-98af-2f9b728ea902 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.953015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fef011-ad08-4c19-98af-2f9b728ea902 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:30.959892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3a13a-e6da-400b-99f2-00d9c609a42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:30.960630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3a13a-e6da-400b-99f2-00d9c609a42c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:30.960957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3a13a-e6da-400b-99f2-00d9c609a42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:30.961230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3a13a-e6da-400b-99f2-00d9c609a42c admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:30.962042 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3a13a-e6da-400b-99f2-00d9c609a42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:30.963717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3a13a-e6da-400b-99f2-00d9c609a42c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:30.970911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 783/1577] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/users => generated 283 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:30.971747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2721a-86e3-423a-be8c-34cd2baa63db admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.981879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 795/1578] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:30.982841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3a13a-e6da-400b-99f2-00d9c609a42c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:30.994247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3a13a-e6da-400b-99f2-00d9c609a42c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.000911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2721a-86e3-423a-be8c-34cd2baa63db admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.001324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9270288-05a3-4db6-afa2-ada1a6062e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.002136 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9270288-05a3-4db6-afa2-ada1a6062e63 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.002345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9270288-05a3-4db6-afa2-ada1a6062e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.002752 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9270288-05a3-4db6-afa2-ada1a6062e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.003433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9270288-05a3-4db6-afa2-ada1a6062e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.005562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9270288-05a3-4db6-afa2-ada1a6062e63 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.006812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039826f-9678-4c9b-b8e6-d1b43ed44704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.007510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039826f-9678-4c9b-b8e6-d1b43ed44704 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.007858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039826f-9678-4c9b-b8e6-d1b43ed44704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.008231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039826f-9678-4c9b-b8e6-d1b43ed44704 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.009138 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039826f-9678-4c9b-b8e6-d1b43ed44704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:31.009581 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039826f-9678-4c9b-b8e6-d1b43ed44704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.011262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039826f-9678-4c9b-b8e6-d1b43ed44704 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.027310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 784/1579] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:31.028043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039826f-9678-4c9b-b8e6-d1b43ed44704 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.038641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039826f-9678-4c9b-b8e6-d1b43ed44704 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.044941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c80f13-2988-49ed-a894-c1d1d64cddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.045656 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c80f13-2988-49ed-a894-c1d1d64cddc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.046806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c80f13-2988-49ed-a894-c1d1d64cddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.047216 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c80f13-2988-49ed-a894-c1d1d64cddc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.048619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c80f13-2988-49ed-a894-c1d1d64cddc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.050057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 796/1580] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:30 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:31.053687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c80f13-2988-49ed-a894-c1d1d64cddc2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.053894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9270288-05a3-4db6-afa2-ada1a6062e63 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.066865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 785/1581] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:31.068534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c80f13-2988-49ed-a894-c1d1d64cddc2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.086707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c80f13-2988-49ed-a894-c1d1d64cddc2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.128599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9270288-05a3-4db6-afa2-ada1a6062e63 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.134592 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b02df-c70a-4338-ae72-15ca29082bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.135267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b02df-c70a-4338-ae72-15ca29082bda admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.135553 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b02df-c70a-4338-ae72-15ca29082bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.135822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b02df-c70a-4338-ae72-15ca29082bda admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.136570 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b02df-c70a-4338-ae72-15ca29082bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.138286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b02df-c70a-4338-ae72-15ca29082bda admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.151148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 797/1582] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:31.155691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b02df-c70a-4338-ae72-15ca29082bda admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.168491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6ad94-0366-4854-9c1a-71ce19c762c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.169294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6ad94-0366-4854-9c1a-71ce19c762c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.169581 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6ad94-0366-4854-9c1a-71ce19c762c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.169863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6ad94-0366-4854-9c1a-71ce19c762c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.170082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b02df-c70a-4338-ae72-15ca29082bda admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.170595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6ad94-0366-4854-9c1a-71ce19c762c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.173666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6ad94-0366-4854-9c1a-71ce19c762c2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.176000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada1e11-8b2b-4c5e-b613-00914a1f7527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.176759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada1e11-8b2b-4c5e-b613-00914a1f7527 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.177041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada1e11-8b2b-4c5e-b613-00914a1f7527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.177365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada1e11-8b2b-4c5e-b613-00914a1f7527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.178139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada1e11-8b2b-4c5e-b613-00914a1f7527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.180047 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada1e11-8b2b-4c5e-b613-00914a1f7527 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.197031 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 798/1583] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:31.198160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada1e11-8b2b-4c5e-b613-00914a1f7527 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.209986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada1e11-8b2b-4c5e-b613-00914a1f7527 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.214801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a536a-6e7a-44d0-816c-86bec81c15c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.216468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a536a-6e7a-44d0-816c-86bec81c15c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.216782 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a536a-6e7a-44d0-816c-86bec81c15c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.217031 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a536a-6e7a-44d0-816c-86bec81c15c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.218143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a536a-6e7a-44d0-816c-86bec81c15c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.218273 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 786/1584] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:31 2022] POST /identity/v3/projects => generated 357 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:31.219158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6ad94-0366-4854-9c1a-71ce19c762c2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.220606 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a536a-6e7a-44d0-816c-86bec81c15c0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.234994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 799/1585] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:31.235967 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a536a-6e7a-44d0-816c-86bec81c15c0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.246638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:31.265675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a536a-6e7a-44d0-816c-86bec81c15c0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.294921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:31.301963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6ad94-0366-4854-9c1a-71ce19c762c2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.308536 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0996395-bef0-45e2-b5cb-f402aa061b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.309481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996395-bef0-45e2-b5cb-f402aa061b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.310170 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996395-bef0-45e2-b5cb-f402aa061b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.310963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996395-bef0-45e2-b5cb-f402aa061b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.312219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0996395-bef0-45e2-b5cb-f402aa061b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.315117 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0996395-bef0-45e2-b5cb-f402aa061b32 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.351636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 787/1586] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:31 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:31.352665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0996395-bef0-45e2-b5cb-f402aa061b32 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.365408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f51d99-06a8-459e-bf9f-bb755c27422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.366040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51d99-06a8-459e-bf9f-bb755c27422d admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.366321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51d99-06a8-459e-bf9f-bb755c27422d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.366595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51d99-06a8-459e-bf9f-bb755c27422d admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.367264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f51d99-06a8-459e-bf9f-bb755c27422d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.369960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f51d99-06a8-459e-bf9f-bb755c27422d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.404831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 800/1587] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:31 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:31.406176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f51d99-06a8-459e-bf9f-bb755c27422d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.422550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f51d99-06a8-459e-bf9f-bb755c27422d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.439948 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0996395-bef0-45e2-b5cb-f402aa061b32 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.445415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d592c82-7082-4b92-85e3-bfe08a5ad05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.446165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d592c82-7082-4b92-85e3-bfe08a5ad05d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.446516 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d592c82-7082-4b92-85e3-bfe08a5ad05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.447137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d592c82-7082-4b92-85e3-bfe08a5ad05d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.447670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d592c82-7082-4b92-85e3-bfe08a5ad05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.449757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d592c82-7082-4b92-85e3-bfe08a5ad05d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.462499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 788/1588] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:31.464366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d592c82-7082-4b92-85e3-bfe08a5ad05d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.475535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d592c82-7082-4b92-85e3-bfe08a5ad05d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.480816 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22109ac-a410-462f-8e25-cb68dd423bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.481550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22109ac-a410-462f-8e25-cb68dd423bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.481908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22109ac-a410-462f-8e25-cb68dd423bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.482311 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22109ac-a410-462f-8e25-cb68dd423bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.483114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22109ac-a410-462f-8e25-cb68dd423bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.485102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22109ac-a410-462f-8e25-cb68dd423bfe admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.497157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 789/1589] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:31.501940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22109ac-a410-462f-8e25-cb68dd423bfe admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.512826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22109ac-a410-462f-8e25-cb68dd423bfe admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.518560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf5b07-03ae-40cd-a3a7-2a6e786d6138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.519531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09e2a1-5391-408f-8cba-c0e17c757714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.519989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09e2a1-5391-408f-8cba-c0e17c757714 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.520433 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09e2a1-5391-408f-8cba-c0e17c757714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.520875 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09e2a1-5391-408f-8cba-c0e17c757714 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.521016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf5b07-03ae-40cd-a3a7-2a6e786d6138 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.521475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf5b07-03ae-40cd-a3a7-2a6e786d6138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.521730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf5b07-03ae-40cd-a3a7-2a6e786d6138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.521844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09e2a1-5391-408f-8cba-c0e17c757714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.523180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf5b07-03ae-40cd-a3a7-2a6e786d6138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.523672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09e2a1-5391-408f-8cba-c0e17c757714 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.525829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf5b07-03ae-40cd-a3a7-2a6e786d6138 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.547250 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 801/1590] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:31.548350 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf5b07-03ae-40cd-a3a7-2a6e786d6138 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.551306 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 790/1591] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:31 2022] POST /identity/v3/users => generated 279 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:31.555524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09e2a1-5391-408f-8cba-c0e17c757714 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.561361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf5b07-03ae-40cd-a3a7-2a6e786d6138 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.568193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d227df4-65be-42c0-b27a-60c32b36f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.568779 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d227df4-65be-42c0-b27a-60c32b36f22a admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.568957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d227df4-65be-42c0-b27a-60c32b36f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.569224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d227df4-65be-42c0-b27a-60c32b36f22a admin admin] PATH_INFO: `/v3/projects/047108da01094783bb085e7c08f7e48c/users/36ca2a6586764135a7f7f3bfc101ffd3/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.569895 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09e2a1-5391-408f-8cba-c0e17c757714 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.580535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956dc43-aa36-4064-a877-2814cbf0f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.581320 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956dc43-aa36-4064-a877-2814cbf0f7af admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.582129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956dc43-aa36-4064-a877-2814cbf0f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.582508 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956dc43-aa36-4064-a877-2814cbf0f7af admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.583510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956dc43-aa36-4064-a877-2814cbf0f7af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.585658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956dc43-aa36-4064-a877-2814cbf0f7af admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.589283 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d227df4-65be-42c0-b27a-60c32b36f22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=047108da01094783bb085e7c08f7e48c, user_id=36ca2a6586764135a7f7f3bfc101ffd3, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.592562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d227df4-65be-42c0-b27a-60c32b36f22a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.618933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 802/1592] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:31 2022] PUT /identity/v3/projects/047108da01094783bb085e7c08f7e48c/users/36ca2a6586764135a7f7f3bfc101ffd3/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:31.624537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 791/1593] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:31 2022] POST /identity/v3/users => generated 290 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:31.625141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d227df4-65be-42c0-b27a-60c32b36f22a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.626815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956dc43-aa36-4064-a877-2814cbf0f7af admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.648741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956dc43-aa36-4064-a877-2814cbf0f7af admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.725898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ca251-eed4-4e6c-b92d-81c2ccab5bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.726599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ca251-eed4-4e6c-b92d-81c2ccab5bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.726887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ca251-eed4-4e6c-b92d-81c2ccab5bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.727187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ca251-eed4-4e6c-b92d-81c2ccab5bf6 admin admin] PATH_INFO: `/v3/projects/a4c886ec53c84d5d9542ab7dbbdfcf8b/users/7ed1be3a1ae249828caa8b88fd606557/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.748507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ca251-eed4-4e6c-b92d-81c2ccab5bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c886ec53c84d5d9542ab7dbbdfcf8b, user_id=7ed1be3a1ae249828caa8b88fd606557, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.749706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-bc8ca251-eed4-4e6c-b92d-81c2ccab5bf6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:53:31.749706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Aug 02 08:53:31.749706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: Aug 02 08:53:31.752541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ca251-eed4-4e6c-b92d-81c2ccab5bf6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.761927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d227df4-65be-42c0-b27a-60c32b36f22a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.768585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cde3c8-815b-4c5f-a508-12592c3bd509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.769305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cde3c8-815b-4c5f-a508-12592c3bd509 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.769507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cde3c8-815b-4c5f-a508-12592c3bd509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.769969 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cde3c8-815b-4c5f-a508-12592c3bd509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.770687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cde3c8-815b-4c5f-a508-12592c3bd509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.774103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cde3c8-815b-4c5f-a508-12592c3bd509 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.775885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 792/1594] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:31 2022] PUT /identity/v3/projects/a4c886ec53c84d5d9542ab7dbbdfcf8b/users/7ed1be3a1ae249828caa8b88fd606557/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:31.777564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ca251-eed4-4e6c-b92d-81c2ccab5bf6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.788180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 803/1595] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:31.789115 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cde3c8-815b-4c5f-a508-12592c3bd509 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.795355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:31.796784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:31.805476 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cde3c8-815b-4c5f-a508-12592c3bd509 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.896486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ca251-eed4-4e6c-b92d-81c2ccab5bf6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:31.902287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89dd59-5fc5-459b-9841-f492c3d392af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.902994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89dd59-5fc5-459b-9841-f492c3d392af admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.903330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89dd59-5fc5-459b-9841-f492c3d392af admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.903619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89dd59-5fc5-459b-9841-f492c3d392af admin admin] PATH_INFO: `/v3/projects/0fe7802ad0344c918d14093f66168426/users/20d03b2674f94d6f962a3007dce37c46/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.923094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4251a0-def0-45e7-b7f1-63fb86f39062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:31.924177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4251a0-def0-45e7-b7f1-63fb86f39062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:31.924705 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4251a0-def0-45e7-b7f1-63fb86f39062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:31.925304 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4251a0-def0-45e7-b7f1-63fb86f39062 admin admin] PATH_INFO: `/v3/projects/01a4c7b61759414da02f2d103681fb8e/users/aece0983b10f4b1b833248e2ccf0d7be/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:31.936964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89dd59-5fc5-459b-9841-f492c3d392af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe7802ad0344c918d14093f66168426, user_id=20d03b2674f94d6f962a3007dce37c46, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.941430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89dd59-5fc5-459b-9841-f492c3d392af admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.958063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 793/1596] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:31 2022] PUT /identity/v3/projects/0fe7802ad0344c918d14093f66168426/users/20d03b2674f94d6f962a3007dce37c46/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:31.960980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89dd59-5fc5-459b-9841-f492c3d392af admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:31.967047 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4251a0-def0-45e7-b7f1-63fb86f39062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a4c7b61759414da02f2d103681fb8e, user_id=aece0983b10f4b1b833248e2ccf0d7be, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:31.970221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4251a0-def0-45e7-b7f1-63fb86f39062 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:31.990687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 804/1597] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:31 2022] PUT /identity/v3/projects/01a4c7b61759414da02f2d103681fb8e/users/aece0983b10f4b1b833248e2ccf0d7be/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:31.991578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4251a0-def0-45e7-b7f1-63fb86f39062 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:32.067195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89dd59-5fc5-459b-9841-f492c3d392af admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:32.070502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4251a0-def0-45e7-b7f1-63fb86f39062 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:32.076145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219d747-0aad-4f1e-abee-f2bed56fc90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:32.076424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d71ece-e017-49f3-989b-f74cdf4c1d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:32.077040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219d747-0aad-4f1e-abee-f2bed56fc90e admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.077254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d71ece-e017-49f3-989b-f74cdf4c1d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.077516 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219d747-0aad-4f1e-abee-f2bed56fc90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.077669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d71ece-e017-49f3-989b-f74cdf4c1d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.077996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219d747-0aad-4f1e-abee-f2bed56fc90e admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.078134 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d71ece-e017-49f3-989b-f74cdf4c1d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.078989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d71ece-e017-49f3-989b-f74cdf4c1d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:32.079146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219d747-0aad-4f1e-abee-f2bed56fc90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:32.081289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219d747-0aad-4f1e-abee-f2bed56fc90e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:32.081480 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d71ece-e017-49f3-989b-f74cdf4c1d2b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:32.092465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 794/1598] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:32.093950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1705ff-b1c8-4646-b989-d7d89a336255 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.094492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1705ff-b1c8-4646-b989-d7d89a336255 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.094934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1705ff-b1c8-4646-b989-d7d89a336255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.097034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 805/1599] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:32.098473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cf352-e515-4f82-99da-a265aa59ffca None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.098769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cf352-e515-4f82-99da-a265aa59ffca None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.099053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cf352-e515-4f82-99da-a265aa59ffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.119627 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8f8cf352-e515-4f82-99da-a265aa59ffca None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:32.121210 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8f8cf352-e515-4f82-99da-a265aa59ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:32.130666 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 806/1600] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:32.131809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cf352-e515-4f82-99da-a265aa59ffca None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:32.142952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9a1705ff-b1c8-4646-b989-d7d89a336255 None None] MFA Rules not processed for user `36ca2a6586764135a7f7f3bfc101ffd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:32.148982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9a1705ff-b1c8-4646-b989-d7d89a336255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:32.153451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cf352-e515-4f82-99da-a265aa59ffca None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:32.159944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaba154-82bb-479c-bd36-9dc88fb5506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:32.160816 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaba154-82bb-479c-bd36-9dc88fb5506c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.161263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaba154-82bb-479c-bd36-9dc88fb5506c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.161749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaba154-82bb-479c-bd36-9dc88fb5506c admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.252607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaba154-82bb-479c-bd36-9dc88fb5506c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:32.252607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaba154-82bb-479c-bd36-9dc88fb5506c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:32.252607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 807/1601] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:32.252607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d787c0-9dee-408c-baf9-6811d651344d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.252607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d787c0-9dee-408c-baf9-6811d651344d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.252607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d787c0-9dee-408c-baf9-6811d651344d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.256037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-82d787c0-9dee-408c-baf9-6811d651344d None None] MFA Rules not processed for user `20d03b2674f94d6f962a3007dce37c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:32.256037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-82d787c0-9dee-408c-baf9-6811d651344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:32.312186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 795/1602] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:32.318482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667a3d3-57ac-460b-808e-7ba15962ebd5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.318775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667a3d3-57ac-460b-808e-7ba15962ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.319062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667a3d3-57ac-460b-808e-7ba15962ebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.353811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3667a3d3-57ac-460b-808e-7ba15962ebd5 None None] MFA Rules not processed for user `aece0983b10f4b1b833248e2ccf0d7be`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:32.355097 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3667a3d3-57ac-460b-808e-7ba15962ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:32.369178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:32.381197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:32.399253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 808/1603] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:32.399253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d787c0-9dee-408c-baf9-6811d651344d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:32.413769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d787c0-9dee-408c-baf9-6811d651344d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:32.419054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95b293-9b3b-4365-80cb-b1a5bb8c9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:32.419619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95b293-9b3b-4365-80cb-b1a5bb8c9011 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.419898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95b293-9b3b-4365-80cb-b1a5bb8c9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.420209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95b293-9b3b-4365-80cb-b1a5bb8c9011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.420908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95b293-9b3b-4365-80cb-b1a5bb8c9011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:32.423336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95b293-9b3b-4365-80cb-b1a5bb8c9011 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:32.435880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 809/1604] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:32.436565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95b293-9b3b-4365-80cb-b1a5bb8c9011 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:32.437529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 796/1605] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:32.438749 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667a3d3-57ac-460b-808e-7ba15962ebd5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:32.440296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3667a3d3-57ac-460b-808e-7ba15962ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:32.453822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95b293-9b3b-4365-80cb-b1a5bb8c9011 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:32.458987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ac976-4c43-4ae6-b0ab-1be4789c76f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:32.459607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ac976-4c43-4ae6-b0ab-1be4789c76f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.459889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ac976-4c43-4ae6-b0ab-1be4789c76f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.460265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ac976-4c43-4ae6-b0ab-1be4789c76f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.460905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ac976-4c43-4ae6-b0ab-1be4789c76f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:32.462521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ac976-4c43-4ae6-b0ab-1be4789c76f8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:32.478689 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 810/1606] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:32.480151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ac976-4c43-4ae6-b0ab-1be4789c76f8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:32.495005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ac976-4c43-4ae6-b0ab-1be4789c76f8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:32.501807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54571af-cedb-44d8-a4c5-6a8670d901c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:32.502443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54571af-cedb-44d8-a4c5-6a8670d901c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.503693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54571af-cedb-44d8-a4c5-6a8670d901c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.504000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54571af-cedb-44d8-a4c5-6a8670d901c8 admin admin] PATH_INFO: `/v3/projects/7f068d1fec9a4e55b60cd782cf4ecf89/users/2b15c4ba64ca4097a4cdb653fdb94d78/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.517906 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667a3d3-57ac-460b-808e-7ba15962ebd5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:32.521459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54571af-cedb-44d8-a4c5-6a8670d901c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f068d1fec9a4e55b60cd782cf4ecf89, user_id=2b15c4ba64ca4097a4cdb653fdb94d78, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:32.522357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ecc46-93d9-49a6-884f-6ec7b80b73f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:32.523108 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ecc46-93d9-49a6-884f-6ec7b80b73f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.523467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ecc46-93d9-49a6-884f-6ec7b80b73f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.523873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ecc46-93d9-49a6-884f-6ec7b80b73f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.525289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54571af-cedb-44d8-a4c5-6a8670d901c8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:32.534803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ecc46-93d9-49a6-884f-6ec7b80b73f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:32.536505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ecc46-93d9-49a6-884f-6ec7b80b73f6 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:32.541172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 811/1607] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:32 2022] PUT /identity/v3/projects/7f068d1fec9a4e55b60cd782cf4ecf89/users/2b15c4ba64ca4097a4cdb653fdb94d78/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:32.542266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54571af-cedb-44d8-a4c5-6a8670d901c8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:32.552648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 797/1608] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:32.553477 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ecc46-93d9-49a6-884f-6ec7b80b73f6 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:32.563897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ecc46-93d9-49a6-884f-6ec7b80b73f6 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:32.615638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54571af-cedb-44d8-a4c5-6a8670d901c8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:32.621687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea046c1d-29c7-46b0-b21f-0f12ae8b4aa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:32.622484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea046c1d-29c7-46b0-b21f-0f12ae8b4aa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.622703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea046c1d-29c7-46b0-b21f-0f12ae8b4aa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.622919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea046c1d-29c7-46b0-b21f-0f12ae8b4aa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.633690 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc31fea-304b-4d04-9ef5-950d9dbc56ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:32.634640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc31fea-304b-4d04-9ef5-950d9dbc56ff admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.634793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc31fea-304b-4d04-9ef5-950d9dbc56ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.635073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc31fea-304b-4d04-9ef5-950d9dbc56ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.635767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc31fea-304b-4d04-9ef5-950d9dbc56ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:32.638709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc31fea-304b-4d04-9ef5-950d9dbc56ff admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:32.675308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 798/1609] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:32 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:32.676462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc31fea-304b-4d04-9ef5-950d9dbc56ff admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:32.706758 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea046c1d-29c7-46b0-b21f-0f12ae8b4aa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:32.709059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea046c1d-29c7-46b0-b21f-0f12ae8b4aa9 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:32.729124 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 812/1610] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:32.731373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67458f96-c9db-4aeb-b80c-f3b5da17846c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.731741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67458f96-c9db-4aeb-b80c-f3b5da17846c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.732104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67458f96-c9db-4aeb-b80c-f3b5da17846c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.734039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 813/1611] 10.222.0.17 () {54 vars in 962 bytes} [Tue Aug 2 08:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:32.737408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67458f96-c9db-4aeb-b80c-f3b5da17846c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:32.751339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:32.796704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc31fea-304b-4d04-9ef5-950d9dbc56ff admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:32.811802 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eaa6e-238b-4ec3-8d49-21d68aec724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:32.815747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eaa6e-238b-4ec3-8d49-21d68aec724a admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.817461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eaa6e-238b-4ec3-8d49-21d68aec724a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.818538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eaa6e-238b-4ec3-8d49-21d68aec724a admin admin] PATH_INFO: `/v3/projects/6d2a0fb79eb742578ff5ce3895d09979/users/f12c086394c54205903483ed0f22dc4e/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.853100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043eaa6e-238b-4ec3-8d49-21d68aec724a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2a0fb79eb742578ff5ce3895d09979, user_id=f12c086394c54205903483ed0f22dc4e, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:32.856855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043eaa6e-238b-4ec3-8d49-21d68aec724a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:32.882165 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67458f96-c9db-4aeb-b80c-f3b5da17846c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:32.888163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 799/1612] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:32 2022] PUT /identity/v3/projects/6d2a0fb79eb742578ff5ce3895d09979/users/f12c086394c54205903483ed0f22dc4e/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:32.888163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ea543-f2c1-4470-a904-6511eab5dc94 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:32.888163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ea543-f2c1-4470-a904-6511eab5dc94 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:32.888163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ea543-f2c1-4470-a904-6511eab5dc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:32.901154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:32.934345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b42ea543-f2c1-4470-a904-6511eab5dc94 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:32.937259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b42ea543-f2c1-4470-a904-6511eab5dc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:33.016567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31795c8c-8901-4af7-aac4-69b447847b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:33.017532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31795c8c-8901-4af7-aac4-69b447847b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:33.017980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31795c8c-8901-4af7-aac4-69b447847b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:33.019227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31795c8c-8901-4af7-aac4-69b447847b69 admin admin] PATH_INFO: `/v3/projects/e350e1aaf5d446b989d2e6c7ab90e133/users/e83b16baa6944aa299cd112043306f68/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:33.049586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31795c8c-8901-4af7-aac4-69b447847b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e350e1aaf5d446b989d2e6c7ab90e133, user_id=e83b16baa6944aa299cd112043306f68, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:33.053918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31795c8c-8901-4af7-aac4-69b447847b69 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:33.068156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 800/1613] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:33.069063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ea543-f2c1-4470-a904-6511eab5dc94 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:33.089449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 814/1614] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:32 2022] PUT /identity/v3/projects/e350e1aaf5d446b989d2e6c7ab90e133/users/e83b16baa6944aa299cd112043306f68/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:33.091089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26691aa3-5d84-40ea-a5b5-817f3eb2ef08 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:33.091709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26691aa3-5d84-40ea-a5b5-817f3eb2ef08 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:33.094922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ea543-f2c1-4470-a904-6511eab5dc94 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:33.095370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26691aa3-5d84-40ea-a5b5-817f3eb2ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:33.182564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-26691aa3-5d84-40ea-a5b5-817f3eb2ef08 None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:33.183909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-26691aa3-5d84-40ea-a5b5-817f3eb2ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:33.224704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954a2d1-406d-41bd-b412-2505ad396a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:33.225655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954a2d1-406d-41bd-b412-2505ad396a31 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:33.226126 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954a2d1-406d-41bd-b412-2505ad396a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:33.226586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954a2d1-406d-41bd-b412-2505ad396a31 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:33.230939 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954a2d1-406d-41bd-b412-2505ad396a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:33.233390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954a2d1-406d-41bd-b412-2505ad396a31 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:33.284190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 801/1615] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:33 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:33.291330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a31d3-56d7-4441-8d29-1cc5fe7aac5a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:33.291677 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a31d3-56d7-4441-8d29-1cc5fe7aac5a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:33.293105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a31d3-56d7-4441-8d29-1cc5fe7aac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:33.364530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 815/1616] 10.222.0.17 () {58 vars in 1059 bytes} [Tue Aug 2 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:33.365007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f62a31d3-56d7-4441-8d29-1cc5fe7aac5a None None] MFA Rules not processed for user `f12c086394c54205903483ed0f22dc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:33.366590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb5b5e-6b05-467b-bf81-f2c2cc613975 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:33.367036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb5b5e-6b05-467b-bf81-f2c2cc613975 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:33.369099 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb5b5e-6b05-467b-bf81-f2c2cc613975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:33.371812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f62a31d3-56d7-4441-8d29-1cc5fe7aac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:33.428966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-aecb5b5e-6b05-467b-bf81-f2c2cc613975 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:33.430243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-aecb5b5e-6b05-467b-bf81-f2c2cc613975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:33.446930 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 816/1617] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:33.447921 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb5b5e-6b05-467b-bf81-f2c2cc613975 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:33.569021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:33.577374 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb5b5e-6b05-467b-bf81-f2c2cc613975 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:33.586185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1faf9c-0926-46d1-8e2d-29c2738872c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:33.586904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1faf9c-0926-46d1-8e2d-29c2738872c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:33.587187 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1faf9c-0926-46d1-8e2d-29c2738872c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:33.587463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1faf9c-0926-46d1-8e2d-29c2738872c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:33.608674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1faf9c-0926-46d1-8e2d-29c2738872c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:33.610842 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1faf9c-0926-46d1-8e2d-29c2738872c5 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:33.638507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 817/1618] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:33.640062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1faf9c-0926-46d1-8e2d-29c2738872c5 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:33.664300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 802/1619] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:33.664300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a31d3-56d7-4441-8d29-1cc5fe7aac5a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:33.667326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1faf9c-0926-46d1-8e2d-29c2738872c5 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:33.683468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66bbfc-78ec-4aa0-9a2c-9b7d8c1dcc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:33.686813 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66bbfc-78ec-4aa0-9a2c-9b7d8c1dcc24 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:33.690026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66bbfc-78ec-4aa0-9a2c-9b7d8c1dcc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:33.690750 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66bbfc-78ec-4aa0-9a2c-9b7d8c1dcc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:33.694070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66bbfc-78ec-4aa0-9a2c-9b7d8c1dcc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:33.695878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a31d3-56d7-4441-8d29-1cc5fe7aac5a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:33.699928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66bbfc-78ec-4aa0-9a2c-9b7d8c1dcc24 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:33.701661 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:33.720198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a7de7-41d5-4b34-bb57-1d41262920a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:33.722626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7de7-41d5-4b34-bb57-1d41262920a8 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:33.723318 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7de7-41d5-4b34-bb57-1d41262920a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:33.723803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7de7-41d5-4b34-bb57-1d41262920a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:33.737677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 818/1620] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:33.740583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66bbfc-78ec-4aa0-9a2c-9b7d8c1dcc24 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:33.764098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66bbfc-78ec-4aa0-9a2c-9b7d8c1dcc24 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:33.774619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0665073-3fee-4ed3-872e-bd5681624ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:33.775399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0665073-3fee-4ed3-872e-bd5681624ddc service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:33.775603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0665073-3fee-4ed3-872e-bd5681624ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:33.775863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0665073-3fee-4ed3-872e-bd5681624ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:33.808292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0665073-3fee-4ed3-872e-bd5681624ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:33.810686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0665073-3fee-4ed3-872e-bd5681624ddc service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:33.835495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 819/1621] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:33.836385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0665073-3fee-4ed3-872e-bd5681624ddc service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:33.861208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0665073-3fee-4ed3-872e-bd5681624ddc service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:33.876368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad11fc-1914-4c14-a13e-31220cd738e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:33.877434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad11fc-1914-4c14-a13e-31220cd738e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:33.878065 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad11fc-1914-4c14-a13e-31220cd738e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:33.878552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad11fc-1914-4c14-a13e-31220cd738e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:33.880147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad11fc-1914-4c14-a13e-31220cd738e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:33.885413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad11fc-1914-4c14-a13e-31220cd738e3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:34.010951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a7de7-41d5-4b34-bb57-1d41262920a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:34.015376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a7de7-41d5-4b34-bb57-1d41262920a8 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:34.027601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 820/1622] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:33 2022] POST /identity/v3/projects => generated 357 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:34.029370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad11fc-1914-4c14-a13e-31220cd738e3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:34.041400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 803/1623] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:34.042709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a7de7-41d5-4b34-bb57-1d41262920a8 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:34.065584 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a7de7-41d5-4b34-bb57-1d41262920a8 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:34.192081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af11a0-4aff-4fc1-ae10-cb6c0e4ded3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:34.193367 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af11a0-4aff-4fc1-ae10-cb6c0e4ded3d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:34.193875 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af11a0-4aff-4fc1-ae10-cb6c0e4ded3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:34.194368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af11a0-4aff-4fc1-ae10-cb6c0e4ded3d admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:34.195273 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af11a0-4aff-4fc1-ae10-cb6c0e4ded3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:34.199019 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af11a0-4aff-4fc1-ae10-cb6c0e4ded3d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:34.266844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 804/1624] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:34 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:34.271911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af11a0-4aff-4fc1-ae10-cb6c0e4ded3d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:34.333075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af11a0-4aff-4fc1-ae10-cb6c0e4ded3d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:34.358954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f08c6-72cc-4d3f-8b5e-afbc5e620f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:34.360653 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f08c6-72cc-4d3f-8b5e-afbc5e620f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:34.361074 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f08c6-72cc-4d3f-8b5e-afbc5e620f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:34.361587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f08c6-72cc-4d3f-8b5e-afbc5e620f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:34.362838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f08c6-72cc-4d3f-8b5e-afbc5e620f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:34.363408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad11fc-1914-4c14-a13e-31220cd738e3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:34.381824 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f08c6-72cc-4d3f-8b5e-afbc5e620f70 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:34.384373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d6c27-9070-4d60-9f1f-bac7f70e9896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:34.385132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d6c27-9070-4d60-9f1f-bac7f70e9896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:34.385422 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d6c27-9070-4d60-9f1f-bac7f70e9896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:34.385705 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d6c27-9070-4d60-9f1f-bac7f70e9896 admin admin] PATH_INFO: `/v3/projects/f32627e2875940bea91a8c36b60bfb22/users/ece3d1e6680b4c46975749f0bc329f35/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:34.441484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d6c27-9070-4d60-9f1f-bac7f70e9896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32627e2875940bea91a8c36b60bfb22, user_id=ece3d1e6680b4c46975749f0bc329f35, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:34.448622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 805/1625] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:34.448812 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d6c27-9070-4d60-9f1f-bac7f70e9896 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:34.449638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f08c6-72cc-4d3f-8b5e-afbc5e620f70 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:34.478621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f08c6-72cc-4d3f-8b5e-afbc5e620f70 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:34.491317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 821/1626] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:34 2022] PUT /identity/v3/projects/f32627e2875940bea91a8c36b60bfb22/users/ece3d1e6680b4c46975749f0bc329f35/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:34.504484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d6c27-9070-4d60-9f1f-bac7f70e9896 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:34.504600 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7433421-7bed-45be-982d-c8545dfa4522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:34.504600 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7433421-7bed-45be-982d-c8545dfa4522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:34.504600 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7433421-7bed-45be-982d-c8545dfa4522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:34.504600 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7433421-7bed-45be-982d-c8545dfa4522 admin admin] PATH_INFO: `/v3/projects/642ec49a52554192ae10771fef9da620/users/2d07e03c5e6e4ceeb8251f0e369711c9/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:34.546889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7433421-7bed-45be-982d-c8545dfa4522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=642ec49a52554192ae10771fef9da620, user_id=2d07e03c5e6e4ceeb8251f0e369711c9, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:34.549787 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7433421-7bed-45be-982d-c8545dfa4522 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:34.587908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 806/1627] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:34 2022] PUT /identity/v3/projects/642ec49a52554192ae10771fef9da620/users/2d07e03c5e6e4ceeb8251f0e369711c9/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:34.592446 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7433421-7bed-45be-982d-c8545dfa4522 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:34.661657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d6c27-9070-4d60-9f1f-bac7f70e9896 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:34.698737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:34.758620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7433421-7bed-45be-982d-c8545dfa4522 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:34.773584 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498eb89-5287-493a-a84a-88b31c5fdeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:34.774242 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498eb89-5287-493a-a84a-88b31c5fdeba admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:34.774605 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498eb89-5287-493a-a84a-88b31c5fdeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:34.775356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498eb89-5287-493a-a84a-88b31c5fdeba admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:34.775592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498eb89-5287-493a-a84a-88b31c5fdeba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:34.777431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498eb89-5287-493a-a84a-88b31c5fdeba admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:34.804777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 807/1628] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:34.805896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498eb89-5287-493a-a84a-88b31c5fdeba admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:34.825752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498eb89-5287-493a-a84a-88b31c5fdeba admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:34.835960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:34.840993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113f200-c718-48a4-80cc-1323b6d21fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:34.841723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113f200-c718-48a4-80cc-1323b6d21fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:34.842014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113f200-c718-48a4-80cc-1323b6d21fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:34.842298 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113f200-c718-48a4-80cc-1323b6d21fb0 admin admin] PATH_INFO: `/v3/projects/642ec49a52554192ae10771fef9da620/users/2d07e03c5e6e4ceeb8251f0e369711c9/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:34.846121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113f200-c718-48a4-80cc-1323b6d21fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=642ec49a52554192ae10771fef9da620, user_id=2d07e03c5e6e4ceeb8251f0e369711c9, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:34.848075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113f200-c718-48a4-80cc-1323b6d21fb0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:34.881058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 808/1629] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:34 2022] PUT /identity/v3/projects/642ec49a52554192ae10771fef9da620/users/2d07e03c5e6e4ceeb8251f0e369711c9/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:53:34.881058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153656-3e4e-4386-8b66-232d857d2474 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:34.881058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153656-3e4e-4386-8b66-232d857d2474 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:34.881058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153656-3e4e-4386-8b66-232d857d2474 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:34.881058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 809/1630] 10.222.0.17 () {54 vars in 912 bytes} [Tue Aug 2 08:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:34.882921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91186186-68a0-49f3-8d96-1cabd1f81f33 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:34.882921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91186186-68a0-49f3-8d96-1cabd1f81f33 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:34.882921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91186186-68a0-49f3-8d96-1cabd1f81f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:34.884149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fe92f-3a4c-449e-8ac6-34dbe49dcdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:34.885023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fe92f-3a4c-449e-8ac6-34dbe49dcdaa admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:34.885310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fe92f-3a4c-449e-8ac6-34dbe49dcdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:34.885604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fe92f-3a4c-449e-8ac6-34dbe49dcdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:34.886645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fe92f-3a4c-449e-8ac6-34dbe49dcdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:34.888153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fe92f-3a4c-449e-8ac6-34dbe49dcdaa admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:34.905955 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-91186186-68a0-49f3-8d96-1cabd1f81f33 None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:34.908021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-91186186-68a0-49f3-8d96-1cabd1f81f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:34.917389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 822/1631] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:53:34.919431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcc904-b1fe-445f-a036-203b7d29059e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:34.919725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcc904-b1fe-445f-a036-203b7d29059e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:34.919998 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcc904-b1fe-445f-a036-203b7d29059e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:34.956156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9ddcc904-b1fe-445f-a036-203b7d29059e None None] MFA Rules not processed for user `2d07e03c5e6e4ceeb8251f0e369711c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:34.958156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9ddcc904-b1fe-445f-a036-203b7d29059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:35.121308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 810/1632] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:53:35.122235 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91186186-68a0-49f3-8d96-1cabd1f81f33 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:35.134050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 823/1633] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:35.134050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcc904-b1fe-445f-a036-203b7d29059e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:35.219829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcc904-b1fe-445f-a036-203b7d29059e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:35.224721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f306ea-a7e5-4f09-bccd-bf397558c0d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:35.225874 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f306ea-a7e5-4f09-bccd-bf397558c0d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:35.226382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f306ea-a7e5-4f09-bccd-bf397558c0d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:35.226855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f306ea-a7e5-4f09-bccd-bf397558c0d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:35.242160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f306ea-a7e5-4f09-bccd-bf397558c0d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:35.245182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f306ea-a7e5-4f09-bccd-bf397558c0d5 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:35.287274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 824/1634] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:35.290269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f306ea-a7e5-4f09-bccd-bf397558c0d5 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:35.294558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91186186-68a0-49f3-8d96-1cabd1f81f33 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:35.314177 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aacbd-98c4-4295-8805-c6052f9f1bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:35.316004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aacbd-98c4-4295-8805-c6052f9f1bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:35.318813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aacbd-98c4-4295-8805-c6052f9f1bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:35.320474 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aacbd-98c4-4295-8805-c6052f9f1bf1 admin admin] PATH_INFO: `/v3/projects/f32627e2875940bea91a8c36b60bfb22/users/ece3d1e6680b4c46975749f0bc329f35/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:35.324742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f306ea-a7e5-4f09-bccd-bf397558c0d5 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:35.329497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aacbd-98c4-4295-8805-c6052f9f1bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32627e2875940bea91a8c36b60bfb22, user_id=ece3d1e6680b4c46975749f0bc329f35, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:35.337660 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1b796-a713-4391-b5be-af0a2f933f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:35.338350 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1b796-a713-4391-b5be-af0a2f933f05 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:35.339116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1b796-a713-4391-b5be-af0a2f933f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:35.339116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1b796-a713-4391-b5be-af0a2f933f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:35.341956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aacbd-98c4-4295-8805-c6052f9f1bf1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:35.365247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1b796-a713-4391-b5be-af0a2f933f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:35.369289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1b796-a713-4391-b5be-af0a2f933f05 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:35.377389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 811/1635] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:35 2022] PUT /identity/v3/projects/f32627e2875940bea91a8c36b60bfb22/users/ece3d1e6680b4c46975749f0bc329f35/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:35.387817 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5ef99-c297-47e7-853e-79166115c4af None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:35.388455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5ef99-c297-47e7-853e-79166115c4af None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:35.388455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5ef99-c297-47e7-853e-79166115c4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:35.408796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 825/1636] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:35.422317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6bc5ef99-c297-47e7-853e-79166115c4af None None] MFA Rules not processed for user `ece3d1e6680b4c46975749f0bc329f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:35.424285 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6bc5ef99-c297-47e7-853e-79166115c4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:35.469847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:35.530619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 812/1637] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:35.688324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1b796-a713-4391-b5be-af0a2f933f05 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:35.707355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1b796-a713-4391-b5be-af0a2f933f05 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:35.850199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067bf9e-df76-4540-8e3c-ab394ec914bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:35.851585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067bf9e-df76-4540-8e3c-ab394ec914bd service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:35.853522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067bf9e-df76-4540-8e3c-ab394ec914bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:35.853522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067bf9e-df76-4540-8e3c-ab394ec914bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:35.879230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067bf9e-df76-4540-8e3c-ab394ec914bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:35.882803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067bf9e-df76-4540-8e3c-ab394ec914bd service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:35.908671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 826/1638] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:35.947833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5ef99-c297-47e7-853e-79166115c4af None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:35.965526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5ef99-c297-47e7-853e-79166115c4af None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:35.973988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c051d-b34a-4bf0-b65b-dcd90292fb20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:35.982351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c051d-b34a-4bf0-b65b-dcd90292fb20 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:35.983162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c051d-b34a-4bf0-b65b-dcd90292fb20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:35.983800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c051d-b34a-4bf0-b65b-dcd90292fb20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:36.152098 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c051d-b34a-4bf0-b65b-dcd90292fb20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:36.154354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c051d-b34a-4bf0-b65b-dcd90292fb20 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:36.159026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067bf9e-df76-4540-8e3c-ab394ec914bd service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:36.178319 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:36.190256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067bf9e-df76-4540-8e3c-ab394ec914bd service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:36.211957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40163abb-db43-4f87-b4c2-3f6b94c9e053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:36.212699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 813/1639] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:36.213761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40163abb-db43-4f87-b4c2-3f6b94c9e053 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:36.214363 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40163abb-db43-4f87-b4c2-3f6b94c9e053 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:36.214947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40163abb-db43-4f87-b4c2-3f6b94c9e053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:36.367682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40163abb-db43-4f87-b4c2-3f6b94c9e053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:36.373185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40163abb-db43-4f87-b4c2-3f6b94c9e053 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:36.394544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 827/1640] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:36.647648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd2fc0-9f08-4083-b453-44cac4c736dc None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:36.648449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd2fc0-9f08-4083-b453-44cac4c736dc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:36.648449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd2fc0-9f08-4083-b453-44cac4c736dc None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:36.653845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 814/1641] 10.222.0.17 () {54 vars in 962 bytes} [Tue Aug 2 08:53:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:36.677708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad4e62-273b-4ab2-ab55-28a66f727ae1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:36.680859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad4e62-273b-4ab2-ab55-28a66f727ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:36.681617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad4e62-273b-4ab2-ab55-28a66f727ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:36.742812 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-49ad4e62-273b-4ab2-ab55-28a66f727ae1 None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:36.744550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-49ad4e62-273b-4ab2-ab55-28a66f727ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:36.974220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 828/1642] 10.222.0.17 () {58 vars in 1059 bytes} [Tue Aug 2 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:36.982941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6e55f-1d0c-46b2-bf70-0c765cad6512 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:36.983804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6e55f-1d0c-46b2-bf70-0c765cad6512 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:36.984278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6e55f-1d0c-46b2-bf70-0c765cad6512 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:36.986793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 815/1643] 10.222.0.17 () {54 vars in 912 bytes} [Tue Aug 2 08:53:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:36.993372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3537be-0567-4dc2-b999-8c58e62f3f64 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:36.994461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3537be-0567-4dc2-b999-8c58e62f3f64 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:36.995619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3537be-0567-4dc2-b999-8c58e62f3f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:37.040654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cc3537be-0567-4dc2-b999-8c58e62f3f64 None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:37.048960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cc3537be-0567-4dc2-b999-8c58e62f3f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:37.070360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 829/1644] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:37.086152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6e55f-1d0c-46b2-bf70-0c765cad6512 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:37.099804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6e55f-1d0c-46b2-bf70-0c765cad6512 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:37.104643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b409a-8b17-4b13-b818-40dfd015a04f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:37.105423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b409a-8b17-4b13-b818-40dfd015a04f service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:37.105708 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b409a-8b17-4b13-b818-40dfd015a04f service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:37.105989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b409a-8b17-4b13-b818-40dfd015a04f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:37.128065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b409a-8b17-4b13-b818-40dfd015a04f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:37.130653 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b409a-8b17-4b13-b818-40dfd015a04f service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:37.169317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 816/1645] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:39.096871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82819f2-dd80-440a-98af-68ec265cefa7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:39.097972 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82819f2-dd80-440a-98af-68ec265cefa7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:39.100867 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82819f2-dd80-440a-98af-68ec265cefa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:39.166028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b82819f2-dd80-440a-98af-68ec265cefa7 None None] MFA Rules not processed for user `e846d960fa87451db8ae291e22b3cb7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:39.167387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b82819f2-dd80-440a-98af-68ec265cefa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:39.337847 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 830/1646] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:39.353873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b409a-8b17-4b13-b818-40dfd015a04f service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:39.374067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b409a-8b17-4b13-b818-40dfd015a04f service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:39.383927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a951957-7437-4cb8-9f68-f7c13ecac84c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:39.384961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a951957-7437-4cb8-9f68-f7c13ecac84c service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:39.386633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a951957-7437-4cb8-9f68-f7c13ecac84c service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:39.387417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a951957-7437-4cb8-9f68-f7c13ecac84c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:39.407816 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a951957-7437-4cb8-9f68-f7c13ecac84c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:39.414051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a951957-7437-4cb8-9f68-f7c13ecac84c service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:39.435300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 817/1647] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:44.434616 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c7c70-bcd0-4224-bce1-0efb215de1df None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:44.435092 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c7c70-bcd0-4224-bce1-0efb215de1df None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:44.435264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c7c70-bcd0-4224-bce1-0efb215de1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:44.486883 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9d7c7c70-bcd0-4224-bce1-0efb215de1df None None] MFA Rules not processed for user `e846d960fa87451db8ae291e22b3cb7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:44.492367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9d7c7c70-bcd0-4224-bce1-0efb215de1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:44.518096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 831/1648] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:45.357073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5013fe-3b20-48aa-be8e-a4f1e60d715a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:45.360064 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5013fe-3b20-48aa-be8e-a4f1e60d715a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:45.360826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5013fe-3b20-48aa-be8e-a4f1e60d715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:45.492018 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cd5013fe-3b20-48aa-be8e-a4f1e60d715a None None] MFA Rules not processed for user `7ed1be3a1ae249828caa8b88fd606557`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:45.497685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cd5013fe-3b20-48aa-be8e-a4f1e60d715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:45.658598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 818/1649] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:45.669200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d1b24-1bbf-4d96-a646-e5a7fdf76b34 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:45.669771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d1b24-1bbf-4d96-a646-e5a7fdf76b34 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:45.669771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d1b24-1bbf-4d96-a646-e5a7fdf76b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:45.733170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a80d1b24-1bbf-4d96-a646-e5a7fdf76b34 None None] MFA Rules not processed for user `7ed1be3a1ae249828caa8b88fd606557`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:45.734449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a80d1b24-1bbf-4d96-a646-e5a7fdf76b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:45.759323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 832/1650] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:45.774394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5013fe-3b20-48aa-be8e-a4f1e60d715a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:45.795190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5013fe-3b20-48aa-be8e-a4f1e60d715a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:45.821158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341ae18-7e35-4a17-b3ee-72e6fb99ab1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:45.821951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341ae18-7e35-4a17-b3ee-72e6fb99ab1e service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:45.822327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341ae18-7e35-4a17-b3ee-72e6fb99ab1e service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:45.822694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341ae18-7e35-4a17-b3ee-72e6fb99ab1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:45.846893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341ae18-7e35-4a17-b3ee-72e6fb99ab1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:45.848877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341ae18-7e35-4a17-b3ee-72e6fb99ab1e service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:45.866000 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 819/1651] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:45.935942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d1b24-1bbf-4d96-a646-e5a7fdf76b34 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:45.943026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:46.072143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d1b24-1bbf-4d96-a646-e5a7fdf76b34 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:46.077257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1bac5-9540-4a9a-8cfc-ab8fae3d7594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:46.078173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1bac5-9540-4a9a-8cfc-ab8fae3d7594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:46.079189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1bac5-9540-4a9a-8cfc-ab8fae3d7594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:46.079819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1bac5-9540-4a9a-8cfc-ab8fae3d7594 admin admin] PATH_INFO: `/v3/users/20d03b2674f94d6f962a3007dce37c46` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:46.083129 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1bac5-9540-4a9a-8cfc-ab8fae3d7594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d03b2674f94d6f962a3007dce37c46)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:46.085651 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1bac5-9540-4a9a-8cfc-ab8fae3d7594 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:46.215645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7aa1bac5-9540-4a9a-8cfc-ab8fae3d7594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d03b2674f94d6f962a3007dce37c46'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:46.216537 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7aa1bac5-9540-4a9a-8cfc-ab8fae3d7594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d03b2674f94d6f962a3007dce37c46'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:46.245288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7aa1bac5-9540-4a9a-8cfc-ab8fae3d7594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d03b2674f94d6f962a3007dce37c46'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:46.268745 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7aa1bac5-9540-4a9a-8cfc-ab8fae3d7594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d03b2674f94d6f962a3007dce37c46'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:46.291995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7aa1bac5-9540-4a9a-8cfc-ab8fae3d7594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d03b2674f94d6f962a3007dce37c46'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:46.304390 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 833/1652] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:53:45 2022] DELETE /identity/v3/users/20d03b2674f94d6f962a3007dce37c46 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:53:46.310511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d9486-07ea-435c-8416-a17fdb932322 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:46.311166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d9486-07ea-435c-8416-a17fdb932322 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:46.311767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d9486-07ea-435c-8416-a17fdb932322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:46.349998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-723d9486-07ea-435c-8416-a17fdb932322 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:46.352800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-723d9486-07ea-435c-8416-a17fdb932322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:46.381695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:46.477231 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b51b-4f18-42d8-b913-1b43f33c4b25 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:46.477680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b51b-4f18-42d8-b913-1b43f33c4b25 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:46.478070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b51b-4f18-42d8-b913-1b43f33c4b25 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:46.479845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 834/1653] 10.222.0.17 () {54 vars in 912 bytes} [Tue Aug 2 08:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:46.493815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117363f-ae7d-4311-90cf-98f1ebfdd1cc None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:46.494220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117363f-ae7d-4311-90cf-98f1ebfdd1cc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:46.494601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117363f-ae7d-4311-90cf-98f1ebfdd1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:46.523672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 820/1654] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:46.541856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d9486-07ea-435c-8416-a17fdb932322 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:46.543610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-723d9486-07ea-435c-8416-a17fdb932322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:46.591455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5117363f-ae7d-4311-90cf-98f1ebfdd1cc None None] MFA Rules not processed for user `c9162dcfb8d542679c7217fae8f5c185`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:46.593022 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5117363f-ae7d-4311-90cf-98f1ebfdd1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:46.827892 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d9486-07ea-435c-8416-a17fdb932322 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:46.833692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 835/1655] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 08:53:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:53:46.852291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f18b9-2e8f-4e8e-9e5d-ee1a28708b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:46.852960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f18b9-2e8f-4e8e-9e5d-ee1a28708b7d service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:46.853245 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f18b9-2e8f-4e8e-9e5d-ee1a28708b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:46.853526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f18b9-2e8f-4e8e-9e5d-ee1a28708b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:46.880530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f18b9-2e8f-4e8e-9e5d-ee1a28708b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:46.882096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f18b9-2e8f-4e8e-9e5d-ee1a28708b7d service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:46.931874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 821/1656] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:47.073933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b5934-a2e9-4c1d-af59-ffd9866dc413 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:47.074464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b5934-a2e9-4c1d-af59-ffd9866dc413 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:47.075037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b5934-a2e9-4c1d-af59-ffd9866dc413 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:47.076197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f18b9-2e8f-4e8e-9e5d-ee1a28708b7d service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:47.078922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ae4f18b9-2e8f-4e8e-9e5d-ee1a28708b7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:47.083287 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 836/1657] 10.222.0.17 () {54 vars in 912 bytes} [Tue Aug 2 08:53:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:47.102292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f18b9-2e8f-4e8e-9e5d-ee1a28708b7d service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:47.108377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd14032-ab53-4a9c-8f73-752322f7490d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:47.108681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd14032-ab53-4a9c-8f73-752322f7490d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:47.108963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd14032-ab53-4a9c-8f73-752322f7490d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:47.128705 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae7e87-bcbe-4192-b5ed-e4703a110974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:47.129410 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae7e87-bcbe-4192-b5ed-e4703a110974 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:47.129671 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae7e87-bcbe-4192-b5ed-e4703a110974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:47.129860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae7e87-bcbe-4192-b5ed-e4703a110974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:47.158596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8fd14032-ab53-4a9c-8f73-752322f7490d None None] MFA Rules not processed for user `c9162dcfb8d542679c7217fae8f5c185`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:47.159853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8fd14032-ab53-4a9c-8f73-752322f7490d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:47.165578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae7e87-bcbe-4192-b5ed-e4703a110974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:47.167933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae7e87-bcbe-4192-b5ed-e4703a110974 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:47.181589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 822/1658] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:47.228501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 837/1659] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 08:53:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:47.327354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae7e87-bcbe-4192-b5ed-e4703a110974 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:47.351114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae7e87-bcbe-4192-b5ed-e4703a110974 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:47.358001 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f7e13-f5cf-4d57-a62b-f02570eb140c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:47.360413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f7e13-f5cf-4d57-a62b-f02570eb140c service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:47.360707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f7e13-f5cf-4d57-a62b-f02570eb140c service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:47.361103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f7e13-f5cf-4d57-a62b-f02570eb140c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:47.383278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f7e13-f5cf-4d57-a62b-f02570eb140c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:47.386531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f7e13-f5cf-4d57-a62b-f02570eb140c service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:47.413407 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 823/1660] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:47.961111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0aec8-97de-493a-a0c9-6317d85968f0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:47.961610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0aec8-97de-493a-a0c9-6317d85968f0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:47.961678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0aec8-97de-493a-a0c9-6317d85968f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:48.029043 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:48.039576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-eef0aec8-97de-493a-a0c9-6317d85968f0 None None] MFA Rules not processed for user `2b15c4ba64ca4097a4cdb653fdb94d78`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:48.042162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-eef0aec8-97de-493a-a0c9-6317d85968f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:48.229609 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 838/1661] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:48.483525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bd4b9-115b-41c0-a21c-1bf6a5e8aa98 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:48.484969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bd4b9-115b-41c0-a21c-1bf6a5e8aa98 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:48.485438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bd4b9-115b-41c0-a21c-1bf6a5e8aa98 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:48.487449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 824/1662] 10.222.0.17 () {54 vars in 961 bytes} [Tue Aug 2 08:53:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:48.496825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1dcf5-6d73-4e61-9f44-37ccdd48b718 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:48.497715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1dcf5-6d73-4e61-9f44-37ccdd48b718 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:48.498199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1dcf5-6d73-4e61-9f44-37ccdd48b718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:48.544523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-14c1dcf5-6d73-4e61-9f44-37ccdd48b718 None None] MFA Rules not processed for user `cd9f2dc3c1c442b4b1b09964ff7c000b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:48.551638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-14c1dcf5-6d73-4e61-9f44-37ccdd48b718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:48.570410 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bd4b9-115b-41c0-a21c-1bf6a5e8aa98 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:48.574018 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6c4bd4b9-115b-41c0-a21c-1bf6a5e8aa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:48.760154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bd4b9-115b-41c0-a21c-1bf6a5e8aa98 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:48.771709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27129d4-23a8-4c81-9f0e-7b0fc62ed899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:48.773086 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27129d4-23a8-4c81-9f0e-7b0fc62ed899 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:48.774990 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27129d4-23a8-4c81-9f0e-7b0fc62ed899 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:48.775819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27129d4-23a8-4c81-9f0e-7b0fc62ed899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:48.785075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 839/1663] 10.222.0.17 () {58 vars in 1058 bytes} [Tue Aug 2 08:53:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:48.787308 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677caa9-0f2b-4161-9e65-15b2fadd78b4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:48.787607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677caa9-0f2b-4161-9e65-15b2fadd78b4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:48.787889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677caa9-0f2b-4161-9e65-15b2fadd78b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:48.798810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27129d4-23a8-4c81-9f0e-7b0fc62ed899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:48.800414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27129d4-23a8-4c81-9f0e-7b0fc62ed899 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:48.819864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 825/1664] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:53:48.821875 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27129d4-23a8-4c81-9f0e-7b0fc62ed899 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:48.843255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27129d4-23a8-4c81-9f0e-7b0fc62ed899 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:48.846895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d677caa9-0f2b-4161-9e65-15b2fadd78b4 None None] MFA Rules not processed for user `e83b16baa6944aa299cd112043306f68`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:48.848233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d677caa9-0f2b-4161-9e65-15b2fadd78b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:48.858766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c7a65-410c-4054-97da-c04682b092c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:48.861771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c7a65-410c-4054-97da-c04682b092c0 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:48.861897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c7a65-410c-4054-97da-c04682b092c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:48.862146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c7a65-410c-4054-97da-c04682b092c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:48.867176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7e7c7a65-410c-4054-97da-c04682b092c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:48.898344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c7a65-410c-4054-97da-c04682b092c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:48.900282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c7a65-410c-4054-97da-c04682b092c0 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:48.951938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 826/1665] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:48.990361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 840/1666] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:48.996269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c7a65-410c-4054-97da-c04682b092c0 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:48.997959 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7e7c7a65-410c-4054-97da-c04682b092c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:49.009397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166ff82-a097-483d-9cf4-f6cdcc41daf3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:49.010865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166ff82-a097-483d-9cf4-f6cdcc41daf3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:49.011754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166ff82-a097-483d-9cf4-f6cdcc41daf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:49.025251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c7a65-410c-4054-97da-c04682b092c0 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:49.045332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:49.047627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:49.049051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:49.049228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] PATH_INFO: `/v3/projects/0fe7802ad0344c918d14093f66168426` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:49.052071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe7802ad0344c918d14093f66168426)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:49.059746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:49.066740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:49.071672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4166ff82-a097-483d-9cf4-f6cdcc41daf3 None None] MFA Rules not processed for user `e83b16baa6944aa299cd112043306f68`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:49.074822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4166ff82-a097-483d-9cf4-f6cdcc41daf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:49.096038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 841/1667] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:49.163310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe7802ad0344c918d14093f66168426', 'request_id': 'req-260e94ac-2aef-43e8-81dd-4d1d3383bd46'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:49.172925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe7802ad0344c918d14093f66168426', 'request_id': 'req-260e94ac-2aef-43e8-81dd-4d1d3383bd46'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:49.189243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe7802ad0344c918d14093f66168426', 'request_id': 'req-260e94ac-2aef-43e8-81dd-4d1d3383bd46'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:49.230565 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] The token cache is being invalidate because project 0fe7802ad0344c918d14093f66168426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:53:49.230565 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:49.231005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:49.236464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 827/1668] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:53:48 2022] DELETE /identity/v3/projects/0fe7802ad0344c918d14093f66168426 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:49.240240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166ff82-a097-483d-9cf4-f6cdcc41daf3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:49.264179 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166ff82-a097-483d-9cf4-f6cdcc41daf3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:49.337399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:49.396274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:49.397634 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:49.470862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7a875-3d2d-437e-8bf6-af2d75ceb6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:49.471640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7a875-3d2d-437e-8bf6-af2d75ceb6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:49.471931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7a875-3d2d-437e-8bf6-af2d75ceb6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:49.473719 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7a875-3d2d-437e-8bf6-af2d75ceb6b5 admin admin] PATH_INFO: `/v3/users/ece3d1e6680b4c46975749f0bc329f35` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:49.475401 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7a875-3d2d-437e-8bf6-af2d75ceb6b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece3d1e6680b4c46975749f0bc329f35)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:49.482561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7a875-3d2d-437e-8bf6-af2d75ceb6b5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:49.621727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0fa7a875-3d2d-437e-8bf6-af2d75ceb6b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece3d1e6680b4c46975749f0bc329f35'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:49.623372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0fa7a875-3d2d-437e-8bf6-af2d75ceb6b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece3d1e6680b4c46975749f0bc329f35'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:49.639849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e94ac-2aef-43e8-81dd-4d1d3383bd46 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:49.650881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0fa7a875-3d2d-437e-8bf6-af2d75ceb6b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece3d1e6680b4c46975749f0bc329f35'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:49.666469 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f6443-6376-4e37-a626-812c161d8988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:49.674799 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0fa7a875-3d2d-437e-8bf6-af2d75ceb6b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece3d1e6680b4c46975749f0bc329f35'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:49.676764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f6443-6376-4e37-a626-812c161d8988 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:49.677526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f6443-6376-4e37-a626-812c161d8988 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:49.684526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f6443-6376-4e37-a626-812c161d8988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:49.690728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-423f6443-6376-4e37-a626-812c161d8988 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:49.716475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0fa7a875-3d2d-437e-8bf6-af2d75ceb6b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece3d1e6680b4c46975749f0bc329f35'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:49.737469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 842/1669] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:53:49 2022] DELETE /identity/v3/users/ece3d1e6680b4c46975749f0bc329f35 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:49.872911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f6443-6376-4e37-a626-812c161d8988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:49.875038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f6443-6376-4e37-a626-812c161d8988 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:49.895062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 828/1670] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:49.952317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e63459-6113-4655-a399-32f36b6d5511 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:49.952611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e63459-6113-4655-a399-32f36b6d5511 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:49.953287 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e63459-6113-4655-a399-32f36b6d5511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:50.003989 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-28e63459-6113-4655-a399-32f36b6d5511 None None] MFA Rules not processed for user `7ed1be3a1ae249828caa8b88fd606557`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:50.007161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-28e63459-6113-4655-a399-32f36b6d5511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:50.265744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 843/1671] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:50.560430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f6443-6376-4e37-a626-812c161d8988 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:50.562791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-423f6443-6376-4e37-a626-812c161d8988 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:50.591437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f6443-6376-4e37-a626-812c161d8988 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:50.659363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:50.840306 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:50.856084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:50.858382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:50.864869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7 admin admin] PATH_INFO: `/v3/projects/f32627e2875940bea91a8c36b60bfb22` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:50.872663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32627e2875940bea91a8c36b60bfb22)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:50.879563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:50.990944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32627e2875940bea91a8c36b60bfb22', 'request_id': 'req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:51.009687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32627e2875940bea91a8c36b60bfb22', 'request_id': 'req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:51.022428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32627e2875940bea91a8c36b60bfb22', 'request_id': 'req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:51.047021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7 admin admin] The token cache is being invalidate because project f32627e2875940bea91a8c36b60bfb22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:53:51.047786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:51.049565 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-384a3a95-3992-4ab8-bfa9-edb9b11a67f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:51.056963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc7641-4bfa-4827-a4b5-0cb8607f6430 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:51.057541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 829/1672] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:53:50 2022] DELETE /identity/v3/projects/f32627e2875940bea91a8c36b60bfb22 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:51.058118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc7641-4bfa-4827-a4b5-0cb8607f6430 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:51.058468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc7641-4bfa-4827-a4b5-0cb8607f6430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:51.121245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d1dc7641-4bfa-4827-a4b5-0cb8607f6430 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:51.128830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d1dc7641-4bfa-4827-a4b5-0cb8607f6430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:51.300594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:51.370729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 844/1673] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:53:51.389123 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171b90c-b2ae-4989-b827-acf9b7836a9d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:51.393888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171b90c-b2ae-4989-b827-acf9b7836a9d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:51.393888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171b90c-b2ae-4989-b827-acf9b7836a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:51.469706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5171b90c-b2ae-4989-b827-acf9b7836a9d None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:51.480788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5171b90c-b2ae-4989-b827-acf9b7836a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:51.537692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 830/1674] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:51.538444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc7641-4bfa-4827-a4b5-0cb8607f6430 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:51.557381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc7641-4bfa-4827-a4b5-0cb8607f6430 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:51.601357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf978d17-6468-4989-b9d1-60f9892437d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:51.610101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf978d17-6468-4989-b9d1-60f9892437d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:51.614539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf978d17-6468-4989-b9d1-60f9892437d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:51.619780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf978d17-6468-4989-b9d1-60f9892437d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:51.621139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf978d17-6468-4989-b9d1-60f9892437d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:51.621561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf978d17-6468-4989-b9d1-60f9892437d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:51.624211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf978d17-6468-4989-b9d1-60f9892437d5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:51.730772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 845/1675] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:53:51.732295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171b90c-b2ae-4989-b827-acf9b7836a9d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:51.750199 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171b90c-b2ae-4989-b827-acf9b7836a9d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:51.811324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61da5e-4000-42e1-9912-1b710c8b1ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:51.814460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61da5e-4000-42e1-9912-1b710c8b1ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:51.815646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61da5e-4000-42e1-9912-1b710c8b1ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:51.816987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61da5e-4000-42e1-9912-1b710c8b1ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:51.818206 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61da5e-4000-42e1-9912-1b710c8b1ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:51.824628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61da5e-4000-42e1-9912-1b710c8b1ebf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:51.974189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 831/1676] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:51 2022] POST /identity/v3/projects => generated 381 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:51.980409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf978d17-6468-4989-b9d1-60f9892437d5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:52.012152 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf978d17-6468-4989-b9d1-60f9892437d5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:52.206904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625f026-91c9-48eb-bf82-35e8bd5fbccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:52.210598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625f026-91c9-48eb-bf82-35e8bd5fbccc admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:52.215088 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625f026-91c9-48eb-bf82-35e8bd5fbccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:52.215665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625f026-91c9-48eb-bf82-35e8bd5fbccc admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:52.219867 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625f026-91c9-48eb-bf82-35e8bd5fbccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:52.222471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625f026-91c9-48eb-bf82-35e8bd5fbccc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:52.282111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 846/1677] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:51 2022] POST /identity/v3/users => generated 291 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:52.286087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61da5e-4000-42e1-9912-1b710c8b1ebf admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:52.302883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61da5e-4000-42e1-9912-1b710c8b1ebf admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:52.326729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b15b5-3d0e-426a-bfff-65296de58bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:52.326729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b15b5-3d0e-426a-bfff-65296de58bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:52.326729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b15b5-3d0e-426a-bfff-65296de58bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:52.327076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b15b5-3d0e-426a-bfff-65296de58bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:52.327708 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b15b5-3d0e-426a-bfff-65296de58bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:52.339126 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b15b5-3d0e-426a-bfff-65296de58bf7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:52.392399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625f026-91c9-48eb-bf82-35e8bd5fbccc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:52.415064 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 832/1678] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:52.427502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625f026-91c9-48eb-bf82-35e8bd5fbccc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:52.447495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c9ade-e4e8-4d52-b094-c8f80b6daa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:52.448160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c9ade-e4e8-4d52-b094-c8f80b6daa9e admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:52.448471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c9ade-e4e8-4d52-b094-c8f80b6daa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:52.448757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c9ade-e4e8-4d52-b094-c8f80b6daa9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:52.449570 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c9ade-e4e8-4d52-b094-c8f80b6daa9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:52.451173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c9ade-e4e8-4d52-b094-c8f80b6daa9e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:52.472862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 847/1679] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:52.477445 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b15b5-3d0e-426a-bfff-65296de58bf7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:52.497337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b15b5-3d0e-426a-bfff-65296de58bf7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:52.523535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114191d-ce4b-4577-8b89-d40c3af7e36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:52.524276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114191d-ce4b-4577-8b89-d40c3af7e36b admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:52.524570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114191d-ce4b-4577-8b89-d40c3af7e36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:52.540509 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114191d-ce4b-4577-8b89-d40c3af7e36b admin admin] PATH_INFO: `/v3/projects/7e501c3fe4f5480da9351d807743cf9f/users/312ac1a29c514f6e856d3430eb9f151a/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:52.586307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114191d-ce4b-4577-8b89-d40c3af7e36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e501c3fe4f5480da9351d807743cf9f, user_id=312ac1a29c514f6e856d3430eb9f151a, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:52.601885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114191d-ce4b-4577-8b89-d40c3af7e36b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:52.664774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 833/1680] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:52 2022] PUT /identity/v3/projects/7e501c3fe4f5480da9351d807743cf9f/users/312ac1a29c514f6e856d3430eb9f151a/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:52.680030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc6ae6-b844-45b5-a524-5013c72f83b7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:52.680030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc6ae6-b844-45b5-a524-5013c72f83b7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:52.680030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc6ae6-b844-45b5-a524-5013c72f83b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:52.754579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d1dc6ae6-b844-45b5-a524-5013c72f83b7 None None] MFA Rules not processed for user `312ac1a29c514f6e856d3430eb9f151a`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:52.763742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d1dc6ae6-b844-45b5-a524-5013c72f83b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:53.041342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 848/1681] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:53.044837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114191d-ce4b-4577-8b89-d40c3af7e36b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:53.159024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc6ae6-b844-45b5-a524-5013c72f83b7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:53.161630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d1dc6ae6-b844-45b5-a524-5013c72f83b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:53.221323 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:53.241189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114191d-ce4b-4577-8b89-d40c3af7e36b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:53.286238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5011a01-aad5-412a-8fac-1e84d76c3837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:53.286890 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5011a01-aad5-412a-8fac-1e84d76c3837 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:53.287174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5011a01-aad5-412a-8fac-1e84d76c3837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:53.287449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5011a01-aad5-412a-8fac-1e84d76c3837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:53.288171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5011a01-aad5-412a-8fac-1e84d76c3837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:53.290180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5011a01-aad5-412a-8fac-1e84d76c3837 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:53.376779 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:53.466784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 834/1682] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:53 2022] POST /identity/v3/projects => generated 381 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:53.471158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc6ae6-b844-45b5-a524-5013c72f83b7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:53.471409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5011a01-aad5-412a-8fac-1e84d76c3837 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:53.799154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5011a01-aad5-412a-8fac-1e84d76c3837 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:53.828133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d5545-76a7-4be9-a627-7af6284798b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:53.830221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d5545-76a7-4be9-a627-7af6284798b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:53.833758 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d5545-76a7-4be9-a627-7af6284798b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:53.834096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d5545-76a7-4be9-a627-7af6284798b0 admin admin] PATH_INFO: `/v3/users/aece0983b10f4b1b833248e2ccf0d7be` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:53.838487 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710b444-0319-4dff-96ce-fe0dea54cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:53.839263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710b444-0319-4dff-96ce-fe0dea54cfeb admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:53.840837 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d5545-76a7-4be9-a627-7af6284798b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aece0983b10f4b1b833248e2ccf0d7be)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:53.840982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710b444-0319-4dff-96ce-fe0dea54cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:53.841379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710b444-0319-4dff-96ce-fe0dea54cfeb admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:53.842142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710b444-0319-4dff-96ce-fe0dea54cfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:53.847945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710b444-0319-4dff-96ce-fe0dea54cfeb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:53.848880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d5545-76a7-4be9-a627-7af6284798b0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:53.909955 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 835/1683] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:53 2022] POST /identity/v3/users => generated 297 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:53.923472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710b444-0319-4dff-96ce-fe0dea54cfeb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:53.991778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710b444-0319-4dff-96ce-fe0dea54cfeb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:54.010798 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f582cf2-7e00-48aa-8f18-81614a03603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:54.012037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f582cf2-7e00-48aa-8f18-81614a03603f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:54.014862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f582cf2-7e00-48aa-8f18-81614a03603f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:54.015298 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f582cf2-7e00-48aa-8f18-81614a03603f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:54.016353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f582cf2-7e00-48aa-8f18-81614a03603f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:54.017977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f582cf2-7e00-48aa-8f18-81614a03603f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:54.101151 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 836/1684] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:54.104748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f582cf2-7e00-48aa-8f18-81614a03603f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:54.147152 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5e8d5545-76a7-4be9-a627-7af6284798b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aece0983b10f4b1b833248e2ccf0d7be'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:54.162316 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5e8d5545-76a7-4be9-a627-7af6284798b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aece0983b10f4b1b833248e2ccf0d7be'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:54.205414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f582cf2-7e00-48aa-8f18-81614a03603f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:54.213429 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5e8d5545-76a7-4be9-a627-7af6284798b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aece0983b10f4b1b833248e2ccf0d7be'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:54.236910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f410e-ed50-4337-8e57-d7e20a301711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:54.239954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f410e-ed50-4337-8e57-d7e20a301711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:54.240409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f410e-ed50-4337-8e57-d7e20a301711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:54.241875 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f410e-ed50-4337-8e57-d7e20a301711 admin admin] PATH_INFO: `/v3/projects/a83dedf3036f4448ab88467a007da616/users/05b24575d60042928bf401edeb2f0180/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:54.307154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f410e-ed50-4337-8e57-d7e20a301711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83dedf3036f4448ab88467a007da616, user_id=05b24575d60042928bf401edeb2f0180, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:54.313476 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5e8d5545-76a7-4be9-a627-7af6284798b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aece0983b10f4b1b833248e2ccf0d7be'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:54.338601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f410e-ed50-4337-8e57-d7e20a301711 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:54.377434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5e8d5545-76a7-4be9-a627-7af6284798b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aece0983b10f4b1b833248e2ccf0d7be'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:54.395278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 837/1685] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:54 2022] PUT /identity/v3/projects/a83dedf3036f4448ab88467a007da616/users/05b24575d60042928bf401edeb2f0180/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:54.400814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f410e-ed50-4337-8e57-d7e20a301711 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:54.405394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bf5f410e-ed50-4337-8e57-d7e20a301711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:54.413682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 849/1686] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:53:53 2022] DELETE /identity/v3/users/aece0983b10f4b1b833248e2ccf0d7be => generated 0 bytes in 1252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:54.423789 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50473c14-ed2d-4777-b75b-7e1038301e0f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:54.424695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50473c14-ed2d-4777-b75b-7e1038301e0f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:54.424991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50473c14-ed2d-4777-b75b-7e1038301e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:54.536784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-50473c14-ed2d-4777-b75b-7e1038301e0f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:54.547933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-50473c14-ed2d-4777-b75b-7e1038301e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:54.773439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 850/1687] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:54.775512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f410e-ed50-4337-8e57-d7e20a301711 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:54.781873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b839-043a-421d-a9ef-fa22203ec460 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:54.783013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b839-043a-421d-a9ef-fa22203ec460 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:54.783404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b839-043a-421d-a9ef-fa22203ec460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:54.845641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affb12f-325d-4773-849a-8c4178a411a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:54.846299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affb12f-325d-4773-849a-8c4178a411a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:54.846588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affb12f-325d-4773-849a-8c4178a411a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:54.846875 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affb12f-325d-4773-849a-8c4178a411a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:54.847595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affb12f-325d-4773-849a-8c4178a411a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:54.864291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affb12f-325d-4773-849a-8c4178a411a0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:54.882507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:54.923061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 838/1688] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 519 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:54.923061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affb12f-325d-4773-849a-8c4178a411a0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:54.929477 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4affb12f-325d-4773-849a-8c4178a411a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:55.005927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-31c4b839-043a-421d-a9ef-fa22203ec460 None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:55.008062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-31c4b839-043a-421d-a9ef-fa22203ec460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:55.066398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:55.153992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affb12f-325d-4773-849a-8c4178a411a0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:55.164639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5318-3d2c-479a-ae1a-2f07f06c4942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:55.166274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5318-3d2c-479a-ae1a-2f07f06c4942 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:55.167113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5318-3d2c-479a-ae1a-2f07f06c4942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:55.167583 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5318-3d2c-479a-ae1a-2f07f06c4942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:55.240110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5318-3d2c-479a-ae1a-2f07f06c4942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:55.256888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5318-3d2c-479a-ae1a-2f07f06c4942 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:55.298816 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 851/1689] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:55.301283 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4b839-043a-421d-a9ef-fa22203ec460 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:55.328239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 839/1690] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:55.342603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4b839-043a-421d-a9ef-fa22203ec460 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:55.364977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0b4c-1bc6-4e60-880b-fc9cf78f16bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:55.370302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0b4c-1bc6-4e60-880b-fc9cf78f16bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:55.370582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0b4c-1bc6-4e60-880b-fc9cf78f16bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:55.370862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0b4c-1bc6-4e60-880b-fc9cf78f16bc admin admin] PATH_INFO: `/v3/projects/a83dedf3036f4448ab88467a007da616/users/05b24575d60042928bf401edeb2f0180/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:55.379535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0b4c-1bc6-4e60-880b-fc9cf78f16bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83dedf3036f4448ab88467a007da616, user_id=05b24575d60042928bf401edeb2f0180, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:55.386799 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0b4c-1bc6-4e60-880b-fc9cf78f16bc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:55.427194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 852/1691] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:53:55 2022] PUT /identity/v3/projects/a83dedf3036f4448ab88467a007da616/users/05b24575d60042928bf401edeb2f0180/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:55.442454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492f84e-5ed9-4823-9a29-3ea42f734a67 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:55.442746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492f84e-5ed9-4823-9a29-3ea42f734a67 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:55.443036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492f84e-5ed9-4823-9a29-3ea42f734a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:55.545481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9492f84e-5ed9-4823-9a29-3ea42f734a67 None None] MFA Rules not processed for user `05b24575d60042928bf401edeb2f0180`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:55.547922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9492f84e-5ed9-4823-9a29-3ea42f734a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:55.615647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0b4c-1bc6-4e60-880b-fc9cf78f16bc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:55.617912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a21e0b4c-1bc6-4e60-880b-fc9cf78f16bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:55.717658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 840/1692] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:55.731742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492f84e-5ed9-4823-9a29-3ea42f734a67 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:55.733238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9492f84e-5ed9-4823-9a29-3ea42f734a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:55.904694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0b4c-1bc6-4e60-880b-fc9cf78f16bc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:55.919480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9ee3e-64a7-46d7-b85d-24bc8bad2f7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:55.920238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9ee3e-64a7-46d7-b85d-24bc8bad2f7e service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:55.920527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9ee3e-64a7-46d7-b85d-24bc8bad2f7e service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:55.922103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9ee3e-64a7-46d7-b85d-24bc8bad2f7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:55.926925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492f84e-5ed9-4823-9a29-3ea42f734a67 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:55.936723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ab992-962a-4af6-9bd3-bd6416247914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:55.937495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab992-962a-4af6-9bd3-bd6416247914 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:55.937791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab992-962a-4af6-9bd3-bd6416247914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:55.938069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab992-962a-4af6-9bd3-bd6416247914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:55.957344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ab992-962a-4af6-9bd3-bd6416247914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:55.959954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ab992-962a-4af6-9bd3-bd6416247914 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:55.984083 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 841/1693] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:56.048076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:56.074095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9ee3e-64a7-46d7-b85d-24bc8bad2f7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:56.076066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9ee3e-64a7-46d7-b85d-24bc8bad2f7e service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:56.093341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 853/1694] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 08:53:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:53:56.747913 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d4aff-7138-49c8-967e-474fdf75f2ba None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:56.748503 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d4aff-7138-49c8-967e-474fdf75f2ba None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:56.748503 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d4aff-7138-49c8-967e-474fdf75f2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:56.865619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ed2d4aff-7138-49c8-967e-474fdf75f2ba None None] MFA Rules not processed for user `2b15c4ba64ca4097a4cdb653fdb94d78`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:56.867089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ed2d4aff-7138-49c8-967e-474fdf75f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:57.041443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9d0d-198a-4e9c-a0ad-c926ffc0fc99 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:57.045775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9d0d-198a-4e9c-a0ad-c926ffc0fc99 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:57.048019 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9d0d-198a-4e9c-a0ad-c926ffc0fc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:57.174485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0eec9d0d-198a-4e9c-a0ad-c926ffc0fc99 None None] MFA Rules not processed for user `c9162dcfb8d542679c7217fae8f5c185`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:57.180185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0eec9d0d-198a-4e9c-a0ad-c926ffc0fc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:57.256833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 842/1695] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:57.395223 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 854/1696] 10.222.0.61 () {58 vars in 1015 bytes} [Tue Aug 2 08:53:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:53:57.447324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d4aff-7138-49c8-967e-474fdf75f2ba None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:57.449734 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ed2d4aff-7138-49c8-967e-474fdf75f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:57.464753 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec9d0d-198a-4e9c-a0ad-c926ffc0fc99 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:57.504309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:57.509038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec9d0d-198a-4e9c-a0ad-c926ffc0fc99 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:57.512545 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d4aff-7138-49c8-967e-474fdf75f2ba None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:57.521190 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f5bab-6ffd-471c-9bef-3eab61c59a46 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b24575d60042928bf401edeb2f0180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83dedf3036f4448ab88467a007da616', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:57.522273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f5bab-6ffd-471c-9bef-3eab61c59a46 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:57.522273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f5bab-6ffd-471c-9bef-3eab61c59a46 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:57.522468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f5bab-6ffd-471c-9bef-3eab61c59a46 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:57.523102 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f5bab-6ffd-471c-9bef-3eab61c59a46 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:57.523416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f5bab-6ffd-471c-9bef-3eab61c59a46 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:57.524942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019345c-47dd-4195-af13-ae94b3375747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:57.525716 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019345c-47dd-4195-af13-ae94b3375747 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:57.526073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019345c-47dd-4195-af13-ae94b3375747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:57.526572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019345c-47dd-4195-af13-ae94b3375747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:57.528605 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f5bab-6ffd-471c-9bef-3eab61c59a46 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:57.546760 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019345c-47dd-4195-af13-ae94b3375747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:57.548411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019345c-47dd-4195-af13-ae94b3375747 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:57.559363 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 855/1697] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:53:57.563819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f5bab-6ffd-471c-9bef-3eab61c59a46 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:57.573982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 843/1698] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:53:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:53:57.580486 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f5bab-6ffd-471c-9bef-3eab61c59a46 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:57.596073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6959f-cd3f-40b5-99be-19f68743a4c2 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b24575d60042928bf401edeb2f0180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83dedf3036f4448ab88467a007da616', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:57.597829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6959f-cd3f-40b5-99be-19f68743a4c2 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:57.598120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6959f-cd3f-40b5-99be-19f68743a4c2 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:57.598477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6959f-cd3f-40b5-99be-19f68743a4c2 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:57.599161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6959f-cd3f-40b5-99be-19f68743a4c2 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:57.608105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6959f-cd3f-40b5-99be-19f68743a4c2 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:57.715595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019345c-47dd-4195-af13-ae94b3375747 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:57.718050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 856/1699] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:53:57 2022] POST /identity/v3/projects => generated 354 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:57.742793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019345c-47dd-4195-af13-ae94b3375747 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:57.963330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b43bd3-119e-483e-8de0-2014385600cf tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b24575d60042928bf401edeb2f0180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83dedf3036f4448ab88467a007da616', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:57.964942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43bd3-119e-483e-8de0-2014385600cf tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:57.965677 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43bd3-119e-483e-8de0-2014385600cf tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:57.966344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43bd3-119e-483e-8de0-2014385600cf tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:57.967850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b43bd3-119e-483e-8de0-2014385600cf tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:57.968358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b43bd3-119e-483e-8de0-2014385600cf tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:57.970489 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b43bd3-119e-483e-8de0-2014385600cf tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:57.995421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 844/1700] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:53:58.088038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6959f-cd3f-40b5-99be-19f68743a4c2 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:58.114325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6959f-cd3f-40b5-99be-19f68743a4c2 tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:58.128552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b24575d60042928bf401edeb2f0180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83dedf3036f4448ab88467a007da616', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:58.129902 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:58.130581 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:58.131148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] PATH_INFO: `/v3/projects/7e1fdb133e8e4ffdb8544958260f595d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:58.132827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7e1fdb133e8e4ffdb8544958260f595d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:58.134527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: WARNING py.warnings [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:53:58.134527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: warnings.warn(msg) Aug 02 08:53:58.134527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: Aug 02 08:53:58.136552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:58.271765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1fdb133e8e4ffdb8544958260f595d', 'request_id': 'req-c731bd3e-b599-4180-868a-e6caeddbe49d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:58.307589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1fdb133e8e4ffdb8544958260f595d', 'request_id': 'req-c731bd3e-b599-4180-868a-e6caeddbe49d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:58.328064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1fdb133e8e4ffdb8544958260f595d', 'request_id': 'req-c731bd3e-b599-4180-868a-e6caeddbe49d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:58.368441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] The token cache is being invalidate because project 7e1fdb133e8e4ffdb8544958260f595d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:53:58.368920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:58.400395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:58.411205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 857/1701] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:53:58 2022] DELETE /identity/v3/projects/7e1fdb133e8e4ffdb8544958260f595d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:58.894038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b43bd3-119e-483e-8de0-2014385600cf tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:58.896290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-74b43bd3-119e-483e-8de0-2014385600cf tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:58.987489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:58.989306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:59.105420 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b43bd3-119e-483e-8de0-2014385600cf tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:59.155722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:59.209408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731bd3e-b599-4180-868a-e6caeddbe49d tempest-VolumeQuotaClassesTest-1574257137 tempest-VolumeQuotaClassesTest-1574257137-project-admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:59.233751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0885fc-0e51-49e5-a721-ba6aa13b5ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:59.235607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0885fc-0e51-49e5-a721-ba6aa13b5ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:59.238209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0885fc-0e51-49e5-a721-ba6aa13b5ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:59.238907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0885fc-0e51-49e5-a721-ba6aa13b5ebc admin admin] PATH_INFO: `/v3/users/36ca2a6586764135a7f7f3bfc101ffd3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:59.244526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0885fc-0e51-49e5-a721-ba6aa13b5ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ca2a6586764135a7f7f3bfc101ffd3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:59.249052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0885fc-0e51-49e5-a721-ba6aa13b5ebc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:59.300423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f00f24-0022-49eb-8fa2-be037c184520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:59.301515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f00f24-0022-49eb-8fa2-be037c184520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:59.302184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f00f24-0022-49eb-8fa2-be037c184520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:59.302968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f00f24-0022-49eb-8fa2-be037c184520 admin admin] PATH_INFO: `/v3/users/312ac1a29c514f6e856d3430eb9f151a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:59.306006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f00f24-0022-49eb-8fa2-be037c184520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312ac1a29c514f6e856d3430eb9f151a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:59.307531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: WARNING py.warnings [None req-37f00f24-0022-49eb-8fa2-be037c184520 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:53:59.307531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: warnings.warn(msg) Aug 02 08:53:59.307531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: Aug 02 08:53:59.309359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f00f24-0022-49eb-8fa2-be037c184520 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:59.493104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:59.513220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac0885fc-0e51-49e5-a721-ba6aa13b5ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ca2a6586764135a7f7f3bfc101ffd3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:59.527712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac0885fc-0e51-49e5-a721-ba6aa13b5ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ca2a6586764135a7f7f3bfc101ffd3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:59.533005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-37f00f24-0022-49eb-8fa2-be037c184520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312ac1a29c514f6e856d3430eb9f151a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:59.537394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-37f00f24-0022-49eb-8fa2-be037c184520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312ac1a29c514f6e856d3430eb9f151a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:59.564664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac0885fc-0e51-49e5-a721-ba6aa13b5ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ca2a6586764135a7f7f3bfc101ffd3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:59.615668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac0885fc-0e51-49e5-a721-ba6aa13b5ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ca2a6586764135a7f7f3bfc101ffd3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:59.628135 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-37f00f24-0022-49eb-8fa2-be037c184520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312ac1a29c514f6e856d3430eb9f151a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:59.650261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac0885fc-0e51-49e5-a721-ba6aa13b5ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ca2a6586764135a7f7f3bfc101ffd3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:59.658772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-37f00f24-0022-49eb-8fa2-be037c184520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312ac1a29c514f6e856d3430eb9f151a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:59.685449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 858/1702] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:53:58 2022] DELETE /identity/v3/users/36ca2a6586764135a7f7f3bfc101ffd3 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:59.690109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c2661-9f0a-4e70-831c-8bac1d33a17b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:59.692896 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c2661-9f0a-4e70-831c-8bac1d33a17b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:59.693204 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c2661-9f0a-4e70-831c-8bac1d33a17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:59.706057 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-37f00f24-0022-49eb-8fa2-be037c184520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312ac1a29c514f6e856d3430eb9f151a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:53:59.738167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 845/1703] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:53:58 2022] DELETE /identity/v3/users/312ac1a29c514f6e856d3430eb9f151a => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:59.747829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cafb2-90ea-464a-b592-efbe996297c4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:59.748146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cafb2-90ea-464a-b592-efbe996297c4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:59.748448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cafb2-90ea-464a-b592-efbe996297c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:59.772970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1e0c2661-9f0a-4e70-831c-8bac1d33a17b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:59.774084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1e0c2661-9f0a-4e70-831c-8bac1d33a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:59.810850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-275cafb2-90ea-464a-b592-efbe996297c4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:59.812206 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-275cafb2-90ea-464a-b592-efbe996297c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:59.981045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 846/1704] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:53:59.983613 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 859/1705] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:00.067774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cafb2-90ea-464a-b592-efbe996297c4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:00.069340 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-275cafb2-90ea-464a-b592-efbe996297c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:00.071732 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c2661-9f0a-4e70-831c-8bac1d33a17b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:00.073675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1e0c2661-9f0a-4e70-831c-8bac1d33a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:00.223057 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cafb2-90ea-464a-b592-efbe996297c4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:00.223815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c2661-9f0a-4e70-831c-8bac1d33a17b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:00.232809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdc2c9-f172-4bbe-a4a8-0a1974dd9fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:00.233570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4df0d9-970e-493b-b22f-11d5390ead29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:00.234837 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdc2c9-f172-4bbe-a4a8-0a1974dd9fae service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:00.238370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4df0d9-970e-493b-b22f-11d5390ead29 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:00.239546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4df0d9-970e-493b-b22f-11d5390ead29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:00.239682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4df0d9-970e-493b-b22f-11d5390ead29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:00.250530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdc2c9-f172-4bbe-a4a8-0a1974dd9fae service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:00.251001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdc2c9-f172-4bbe-a4a8-0a1974dd9fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:00.269780 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4df0d9-970e-493b-b22f-11d5390ead29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:00.274778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4df0d9-970e-493b-b22f-11d5390ead29 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:00.276823 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdc2c9-f172-4bbe-a4a8-0a1974dd9fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:00.278456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdc2c9-f172-4bbe-a4a8-0a1974dd9fae service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:00.306124 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 860/1706] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:00.312204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 847/1707] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:01.194613 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdc2c9-f172-4bbe-a4a8-0a1974dd9fae service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:01.199618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3fcdc2c9-f172-4bbe-a4a8-0a1974dd9fae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:01.243657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdc2c9-f172-4bbe-a4a8-0a1974dd9fae service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:01.265389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7bcc6-6266-4a11-9148-bf535901a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:01.266494 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7bcc6-6266-4a11-9148-bf535901a199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:01.267085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7bcc6-6266-4a11-9148-bf535901a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:01.267580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7bcc6-6266-4a11-9148-bf535901a199 admin admin] PATH_INFO: `/v3/projects/01a4c7b61759414da02f2d103681fb8e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:01.269201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7bcc6-6266-4a11-9148-bf535901a199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a4c7b61759414da02f2d103681fb8e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:01.271423 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7bcc6-6266-4a11-9148-bf535901a199 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:01.278281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:01.390294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aac7bcc6-6266-4a11-9148-bf535901a199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a4c7b61759414da02f2d103681fb8e', 'request_id': 'req-aac7bcc6-6266-4a11-9148-bf535901a199'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:01.417636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aac7bcc6-6266-4a11-9148-bf535901a199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a4c7b61759414da02f2d103681fb8e', 'request_id': 'req-aac7bcc6-6266-4a11-9148-bf535901a199'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:01.434782 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aac7bcc6-6266-4a11-9148-bf535901a199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a4c7b61759414da02f2d103681fb8e', 'request_id': 'req-aac7bcc6-6266-4a11-9148-bf535901a199'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:01.470425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aac7bcc6-6266-4a11-9148-bf535901a199 admin admin] The token cache is being invalidate because project 01a4c7b61759414da02f2d103681fb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:01.473173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aac7bcc6-6266-4a11-9148-bf535901a199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:01.474627 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aac7bcc6-6266-4a11-9148-bf535901a199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:01.480906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 861/1708] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:01 2022] DELETE /identity/v3/projects/01a4c7b61759414da02f2d103681fb8e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:01.487029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af99904-415e-4e88-b1d0-6480ff47bfd5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:01.488326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af99904-415e-4e88-b1d0-6480ff47bfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:01.488874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af99904-415e-4e88-b1d0-6480ff47bfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:01.538687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7af99904-415e-4e88-b1d0-6480ff47bfd5 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:01.542382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7af99904-415e-4e88-b1d0-6480ff47bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:01.671624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:01.692421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 848/1709] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:01.701793 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de82ec9-e01d-45f5-b8ac-169cda0d23de None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:01.702084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de82ec9-e01d-45f5-b8ac-169cda0d23de None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:01.702370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de82ec9-e01d-45f5-b8ac-169cda0d23de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:01.744014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9de82ec9-e01d-45f5-b8ac-169cda0d23de None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:01.745412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9de82ec9-e01d-45f5-b8ac-169cda0d23de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:01.775365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 862/1710] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:01.777028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af99904-415e-4e88-b1d0-6480ff47bfd5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:01.788350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af99904-415e-4e88-b1d0-6480ff47bfd5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:01.807355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0ceaa-598f-43ac-a58c-63c9c75042e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:01.809095 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ceaa-598f-43ac-a58c-63c9c75042e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:01.809545 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ceaa-598f-43ac-a58c-63c9c75042e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:01.809949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ceaa-598f-43ac-a58c-63c9c75042e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:01.811238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0ceaa-598f-43ac-a58c-63c9c75042e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:01.811677 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0ceaa-598f-43ac-a58c-63c9c75042e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:01.819412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0ceaa-598f-43ac-a58c-63c9c75042e9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:01.846706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 849/1711] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:01.848965 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de82ec9-e01d-45f5-b8ac-169cda0d23de None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:01.864859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de82ec9-e01d-45f5-b8ac-169cda0d23de None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:01.879963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782a149-f303-4454-aadb-d3fd73a5f209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:01.881155 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782a149-f303-4454-aadb-d3fd73a5f209 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:01.881694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782a149-f303-4454-aadb-d3fd73a5f209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:01.882266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782a149-f303-4454-aadb-d3fd73a5f209 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:01.883301 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782a149-f303-4454-aadb-d3fd73a5f209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:01.886341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782a149-f303-4454-aadb-d3fd73a5f209 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:01.978758 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0ceaa-598f-43ac-a58c-63c9c75042e9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:01.979594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 863/1712] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:01 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:01.996094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0ceaa-598f-43ac-a58c-63c9c75042e9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:02.211637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f1cb7-efd3-435c-b864-de0b61970c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:02.213055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f1cb7-efd3-435c-b864-de0b61970c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:02.213362 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f1cb7-efd3-435c-b864-de0b61970c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:02.213644 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f1cb7-efd3-435c-b864-de0b61970c1f admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:02.214345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f1cb7-efd3-435c-b864-de0b61970c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:02.222867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f1cb7-efd3-435c-b864-de0b61970c1f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:02.276813 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782a149-f303-4454-aadb-d3fd73a5f209 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:02.286424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 850/1713] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:01 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:02.296186 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782a149-f303-4454-aadb-d3fd73a5f209 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:02.302656 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e84570-2401-4701-8cff-f22b20ecb690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:02.303295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e84570-2401-4701-8cff-f22b20ecb690 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:02.303583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e84570-2401-4701-8cff-f22b20ecb690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:02.303865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e84570-2401-4701-8cff-f22b20ecb690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:02.304636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e84570-2401-4701-8cff-f22b20ecb690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:02.306570 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e84570-2401-4701-8cff-f22b20ecb690 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:02.323927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f1cb7-efd3-435c-b864-de0b61970c1f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:02.324482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 864/1714] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:02.342097 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f1cb7-efd3-435c-b864-de0b61970c1f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:02.355414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5ac2e-f5f8-4a18-bbc2-76a6521a1ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:02.358128 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ac2e-f5f8-4a18-bbc2-76a6521a1ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:02.358417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ac2e-f5f8-4a18-bbc2-76a6521a1ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:02.358817 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ac2e-f5f8-4a18-bbc2-76a6521a1ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:02.360771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5ac2e-f5f8-4a18-bbc2-76a6521a1ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:02.362975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5ac2e-f5f8-4a18-bbc2-76a6521a1ae3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:02.383750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 851/1715] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:02.387671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e84570-2401-4701-8cff-f22b20ecb690 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:02.400475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e84570-2401-4701-8cff-f22b20ecb690 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:02.414374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f464e8-189c-4158-8730-5dda5ebaeb2d None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:02.415092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f464e8-189c-4158-8730-5dda5ebaeb2d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:02.415583 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f464e8-189c-4158-8730-5dda5ebaeb2d None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:02.417776 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 852/1716] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 08:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:54:02.426863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505023a-617b-42ea-8f71-d2f46b5ba4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:02.427571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505023a-617b-42ea-8f71-d2f46b5ba4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:02.427853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505023a-617b-42ea-8f71-d2f46b5ba4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:02.428149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505023a-617b-42ea-8f71-d2f46b5ba4a7 admin admin] PATH_INFO: `/v3/projects/008c3781588b422ca5378eba0b0afdf7/users/d3a0a307db9b42d68890f2d8f50707d2/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:02.474398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237e553-37d7-4754-890b-8c0d0e59c593 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:02.475267 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237e553-37d7-4754-890b-8c0d0e59c593 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:02.475804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237e553-37d7-4754-890b-8c0d0e59c593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:02.497425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505023a-617b-42ea-8f71-d2f46b5ba4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=008c3781588b422ca5378eba0b0afdf7, user_id=d3a0a307db9b42d68890f2d8f50707d2, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:02.508608 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505023a-617b-42ea-8f71-d2f46b5ba4a7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:02.532961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9237e553-37d7-4754-890b-8c0d0e59c593 None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:02.535003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9237e553-37d7-4754-890b-8c0d0e59c593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:02.568563 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 865/1717] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:02 2022] PUT /identity/v3/projects/008c3781588b422ca5378eba0b0afdf7/users/d3a0a307db9b42d68890f2d8f50707d2/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:02.570427 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04ae2d-68ce-42f9-bd16-da2bd100bcd0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:02.570727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04ae2d-68ce-42f9-bd16-da2bd100bcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:02.571017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04ae2d-68ce-42f9-bd16-da2bd100bcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:02.632556 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3a04ae2d-68ce-42f9-bd16-da2bd100bcd0 None None] MFA Rules not processed for user `d3a0a307db9b42d68890f2d8f50707d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:02.633804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3a04ae2d-68ce-42f9-bd16-da2bd100bcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:02.731777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 853/1718] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 08:54:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:02.801861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237e553-37d7-4754-890b-8c0d0e59c593 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:02.802880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 866/1719] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:02.974007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:02.993050 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237e553-37d7-4754-890b-8c0d0e59c593 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:03.035753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943daa8-5c38-441a-bf48-4603e786c3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:03.038220 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943daa8-5c38-441a-bf48-4603e786c3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:03.050095 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943daa8-5c38-441a-bf48-4603e786c3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:03.050576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943daa8-5c38-441a-bf48-4603e786c3e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:03.071099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943daa8-5c38-441a-bf48-4603e786c3e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:03.077555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943daa8-5c38-441a-bf48-4603e786c3e8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:03.242018 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 854/1720] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:02 2022] POST /identity/v3/projects => generated 383 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:03.246087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04ae2d-68ce-42f9-bd16-da2bd100bcd0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:03.291687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04ae2d-68ce-42f9-bd16-da2bd100bcd0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:03.361444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:03.550330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be7574-3b9b-4307-879b-ab9c02a44eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:03.550987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be7574-3b9b-4307-879b-ab9c02a44eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:03.551281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be7574-3b9b-4307-879b-ab9c02a44eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:03.551708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be7574-3b9b-4307-879b-ab9c02a44eaf admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:03.552512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be7574-3b9b-4307-879b-ab9c02a44eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:03.554569 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be7574-3b9b-4307-879b-ab9c02a44eaf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:03.633815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 867/1721] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:03 2022] POST /identity/v3/users => generated 298 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:03.635397 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943daa8-5c38-441a-bf48-4603e786c3e8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:03.660988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943daa8-5c38-441a-bf48-4603e786c3e8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:03.681913 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde992b-9735-444e-b600-f489cb467f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:03.682564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde992b-9735-444e-b600-f489cb467f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:03.682854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde992b-9735-444e-b600-f489cb467f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:03.686675 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde992b-9735-444e-b600-f489cb467f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:03.688551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde992b-9735-444e-b600-f489cb467f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:03.690209 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde992b-9735-444e-b600-f489cb467f89 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:03.752998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 855/1722] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:03.754357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be7574-3b9b-4307-879b-ab9c02a44eaf admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:03.773526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be7574-3b9b-4307-879b-ab9c02a44eaf admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:03.782119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b17f62-0ff6-44a7-87d1-d50c075eccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:03.783141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b17f62-0ff6-44a7-87d1-d50c075eccf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:03.783771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b17f62-0ff6-44a7-87d1-d50c075eccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:03.784285 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b17f62-0ff6-44a7-87d1-d50c075eccf0 admin admin] PATH_INFO: `/v3/projects/13417eebfd454deabce8992a9c621c52/users/c9cb00378db445909b8eca5986dad712/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:03.844337 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b17f62-0ff6-44a7-87d1-d50c075eccf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13417eebfd454deabce8992a9c621c52, user_id=c9cb00378db445909b8eca5986dad712, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:03.847460 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b17f62-0ff6-44a7-87d1-d50c075eccf0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:03.883233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 868/1723] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:03 2022] PUT /identity/v3/projects/13417eebfd454deabce8992a9c621c52/users/c9cb00378db445909b8eca5986dad712/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:03.889009 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde992b-9735-444e-b600-f489cb467f89 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:03.900335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde992b-9735-444e-b600-f489cb467f89 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:04.077066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d18db-bf79-4234-a328-0e673f34f900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:04.080996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d18db-bf79-4234-a328-0e673f34f900 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:04.081499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d18db-bf79-4234-a328-0e673f34f900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:04.081963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d18db-bf79-4234-a328-0e673f34f900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:04.083226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d18db-bf79-4234-a328-0e673f34f900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:04.085653 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d18db-bf79-4234-a328-0e673f34f900 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:04.106610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 856/1724] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:04.112353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b17f62-0ff6-44a7-87d1-d50c075eccf0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:04.128473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b17f62-0ff6-44a7-87d1-d50c075eccf0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:04.149729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a167171-0fad-43e6-a0c6-f7bcaadd5815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:04.152973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a167171-0fad-43e6-a0c6-f7bcaadd5815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:04.153277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a167171-0fad-43e6-a0c6-f7bcaadd5815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:04.153565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a167171-0fad-43e6-a0c6-f7bcaadd5815 admin admin] PATH_INFO: `/v3/projects/13417eebfd454deabce8992a9c621c52/users/c9cb00378db445909b8eca5986dad712/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:04.161895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a167171-0fad-43e6-a0c6-f7bcaadd5815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13417eebfd454deabce8992a9c621c52, user_id=c9cb00378db445909b8eca5986dad712, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:04.171560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a167171-0fad-43e6-a0c6-f7bcaadd5815 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:04.203105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 869/1725] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:04 2022] PUT /identity/v3/projects/13417eebfd454deabce8992a9c621c52/users/c9cb00378db445909b8eca5986dad712/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:04.214902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cb619-0405-4a81-b06a-1408e2bd247b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:04.216632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cb619-0405-4a81-b06a-1408e2bd247b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:04.217008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cb619-0405-4a81-b06a-1408e2bd247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:04.286938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3d6cb619-0405-4a81-b06a-1408e2bd247b None None] MFA Rules not processed for user `c9cb00378db445909b8eca5986dad712`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:04.291631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3d6cb619-0405-4a81-b06a-1408e2bd247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:04.413822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 857/1726] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:04.415108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a167171-0fad-43e6-a0c6-f7bcaadd5815 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:04.418217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2a167171-0fad-43e6-a0c6-f7bcaadd5815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:04.571322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a167171-0fad-43e6-a0c6-f7bcaadd5815 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:04.578566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298cda2-736e-4c96-b2dc-d0353cc00fa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:04.579418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298cda2-736e-4c96-b2dc-d0353cc00fa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:04.579711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298cda2-736e-4c96-b2dc-d0353cc00fa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:04.580087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298cda2-736e-4c96-b2dc-d0353cc00fa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:04.602938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298cda2-736e-4c96-b2dc-d0353cc00fa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:04.606099 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298cda2-736e-4c96-b2dc-d0353cc00fa6 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:04.649677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 870/1727] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:04.733688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cb619-0405-4a81-b06a-1408e2bd247b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:04.735189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3d6cb619-0405-4a81-b06a-1408e2bd247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:04.823254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298cda2-736e-4c96-b2dc-d0353cc00fa6 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:04.933040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298cda2-736e-4c96-b2dc-d0353cc00fa6 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:04.939793 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082b4b7-3218-4426-9e85-4fc3f6067a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:04.940901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082b4b7-3218-4426-9e85-4fc3f6067a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:04.941548 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082b4b7-3218-4426-9e85-4fc3f6067a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:04.941957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082b4b7-3218-4426-9e85-4fc3f6067a4d admin admin] PATH_INFO: `/v3/users/d3a0a307db9b42d68890f2d8f50707d2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:04.947056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082b4b7-3218-4426-9e85-4fc3f6067a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a0a307db9b42d68890f2d8f50707d2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:04.949903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082b4b7-3218-4426-9e85-4fc3f6067a4d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:04.973471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:05.032052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:05.083110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a082b4b7-3218-4426-9e85-4fc3f6067a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a0a307db9b42d68890f2d8f50707d2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.084620 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a082b4b7-3218-4426-9e85-4fc3f6067a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a0a307db9b42d68890f2d8f50707d2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.132454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a082b4b7-3218-4426-9e85-4fc3f6067a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a0a307db9b42d68890f2d8f50707d2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.145893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cb619-0405-4a81-b06a-1408e2bd247b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:05.174418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a082b4b7-3218-4426-9e85-4fc3f6067a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a0a307db9b42d68890f2d8f50707d2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.180014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6c0c0-4321-4707-a09d-054b1cc12502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:05.180677 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6c0c0-4321-4707-a09d-054b1cc12502 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:05.180971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6c0c0-4321-4707-a09d-054b1cc12502 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:05.181261 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6c0c0-4321-4707-a09d-054b1cc12502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:05.185779 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a082b4b7-3218-4426-9e85-4fc3f6067a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a0a307db9b42d68890f2d8f50707d2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.203639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 871/1728] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:04 2022] DELETE /identity/v3/users/d3a0a307db9b42d68890f2d8f50707d2 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:05.209905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7289cf-ceb1-4c4f-a756-420ba8193ad3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:05.210208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7289cf-ceb1-4c4f-a756-420ba8193ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:05.210679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7289cf-ceb1-4c4f-a756-420ba8193ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:05.238599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6c0c0-4321-4707-a09d-054b1cc12502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:05.249884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6c0c0-4321-4707-a09d-054b1cc12502 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:05.286213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2d7289cf-ceb1-4c4f-a756-420ba8193ad3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:05.286514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 858/1729] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:05.293403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2d7289cf-ceb1-4c4f-a756-420ba8193ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:05.343923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6c0c0-4321-4707-a09d-054b1cc12502 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:05.345513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-81b6c0c0-4321-4707-a09d-054b1cc12502 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:05.382442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6c0c0-4321-4707-a09d-054b1cc12502 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:05.597856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 872/1730] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:05.642946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7289cf-ceb1-4c4f-a756-420ba8193ad3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:05.644575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2d7289cf-ceb1-4c4f-a756-420ba8193ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:05.658525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:05.658525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:05.658525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:05.658525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] PATH_INFO: `/v3/users/f12c086394c54205903483ed0f22dc4e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:05.660415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12c086394c54205903483ed0f22dc4e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:05.663684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:05.669005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7289cf-ceb1-4c4f-a756-420ba8193ad3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:05.682711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:05.684093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:05.684466 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:05.684808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] PATH_INFO: `/v3/projects/7e501c3fe4f5480da9351d807743cf9f` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:05.689408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e501c3fe4f5480da9351d807743cf9f)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:05.692040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:05.819988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e501c3fe4f5480da9351d807743cf9f', 'request_id': 'req-80676b9a-937c-46dd-a129-f471dec4d58e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.834937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e501c3fe4f5480da9351d807743cf9f', 'request_id': 'req-80676b9a-937c-46dd-a129-f471dec4d58e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.844654 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12c086394c54205903483ed0f22dc4e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.845648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12c086394c54205903483ed0f22dc4e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.867905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e501c3fe4f5480da9351d807743cf9f', 'request_id': 'req-80676b9a-937c-46dd-a129-f471dec4d58e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.879825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12c086394c54205903483ed0f22dc4e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.893713 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] The token cache is being invalidate because project 7e501c3fe4f5480da9351d807743cf9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:05.894584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.896178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.905774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 873/1731] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:05 2022] DELETE /identity/v3/projects/7e501c3fe4f5480da9351d807743cf9f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:05.909228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:05.913292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:05.917428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12c086394c54205903483ed0f22dc4e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.941395 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12c086394c54205903483ed0f22dc4e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:05.967425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:05.981301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 859/1732] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:05 2022] DELETE /identity/v3/users/f12c086394c54205903483ed0f22dc4e => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:05.985540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:05.989315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:06.085817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80676b9a-937c-46dd-a129-f471dec4d58e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:06.223491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273b77-3b9c-4752-b6a6-913fcae61ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:06.224293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273b77-3b9c-4752-b6a6-913fcae61ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:06.224824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273b77-3b9c-4752-b6a6-913fcae61ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:06.224995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273b77-3b9c-4752-b6a6-913fcae61ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:06.255546 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dc273b77-3b9c-4752-b6a6-913fcae61ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:06.265184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:06.320784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8833fe-ed39-4d03-aa3a-7f56cadd417f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:06.337699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:06.339040 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:06.339651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:06.340289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] PATH_INFO: `/v3/users/05b24575d60042928bf401edeb2f0180` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:06.348036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b24575d60042928bf401edeb2f0180)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:06.351939 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:06.534598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b24575d60042928bf401edeb2f0180'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:06.537599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b24575d60042928bf401edeb2f0180'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:06.557499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc273b77-3b9c-4752-b6a6-913fcae61ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:06.559065 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc273b77-3b9c-4752-b6a6-913fcae61ce3 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:06.568278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b24575d60042928bf401edeb2f0180'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:06.585652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 874/1733] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:06.589718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b24575d60042928bf401edeb2f0180'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:06.626370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be6bcd-f7b5-44d6-b5fa-76ac61c26798 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:06.627701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be6bcd-f7b5-44d6-b5fa-76ac61c26798 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:06.628040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be6bcd-f7b5-44d6-b5fa-76ac61c26798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:06.632383 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b24575d60042928bf401edeb2f0180'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:06.657428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 860/1734] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:05 2022] DELETE /identity/v3/users/05b24575d60042928bf401edeb2f0180 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:06.658644 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:06.663925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:06.686375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-38be6bcd-f7b5-44d6-b5fa-76ac61c26798 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:06.689795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-38be6bcd-f7b5-44d6-b5fa-76ac61c26798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:06.883027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076dc2b-fe78-462c-afb7-4273838b2c16 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:06.889606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd513024-332a-4c3d-b0a9-02427afb3d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:06.890394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd513024-332a-4c3d-b0a9-02427afb3d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:06.891158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd513024-332a-4c3d-b0a9-02427afb3d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:06.891403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd513024-332a-4c3d-b0a9-02427afb3d9a admin admin] PATH_INFO: `/v3/projects/047108da01094783bb085e7c08f7e48c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:06.893323 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd513024-332a-4c3d-b0a9-02427afb3d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=047108da01094783bb085e7c08f7e48c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:06.895320 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd513024-332a-4c3d-b0a9-02427afb3d9a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:06.925547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 875/1735] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:07.005439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be6bcd-f7b5-44d6-b5fa-76ac61c26798 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:07.008255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-38be6bcd-f7b5-44d6-b5fa-76ac61c26798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:07.035841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-dd513024-332a-4c3d-b0a9-02427afb3d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '047108da01094783bb085e7c08f7e48c', 'request_id': 'req-dd513024-332a-4c3d-b0a9-02427afb3d9a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:07.061435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-dd513024-332a-4c3d-b0a9-02427afb3d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '047108da01094783bb085e7c08f7e48c', 'request_id': 'req-dd513024-332a-4c3d-b0a9-02427afb3d9a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:07.065470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:07.090992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-dd513024-332a-4c3d-b0a9-02427afb3d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '047108da01094783bb085e7c08f7e48c', 'request_id': 'req-dd513024-332a-4c3d-b0a9-02427afb3d9a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:07.131962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-dd513024-332a-4c3d-b0a9-02427afb3d9a admin admin] The token cache is being invalidate because project 047108da01094783bb085e7c08f7e48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:07.132471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-dd513024-332a-4c3d-b0a9-02427afb3d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:07.133317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-dd513024-332a-4c3d-b0a9-02427afb3d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:07.138242 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 861/1736] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:06 2022] DELETE /identity/v3/projects/047108da01094783bb085e7c08f7e48c => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:07.146149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a55efc-bab5-4446-8675-f02dcf69f81a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:07.146642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a55efc-bab5-4446-8675-f02dcf69f81a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:07.149024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a55efc-bab5-4446-8675-f02dcf69f81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:07.162235 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be6bcd-f7b5-44d6-b5fa-76ac61c26798 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:07.178206 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:07.245885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-07a55efc-bab5-4446-8675-f02dcf69f81a None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:07.247392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-07a55efc-bab5-4446-8675-f02dcf69f81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:07.329148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541f37-c746-45f8-8051-19369844119a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:07.329983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541f37-c746-45f8-8051-19369844119a service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:07.330412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541f37-c746-45f8-8051-19369844119a service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:07.330859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541f37-c746-45f8-8051-19369844119a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:07.349421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bc541f37-c746-45f8-8051-19369844119a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:07.463317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 862/1737] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:07.465592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5787876-ec1a-4fea-8a04-c9f15e3c69c8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:07.465949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5787876-ec1a-4fea-8a04-c9f15e3c69c8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:07.466240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5787876-ec1a-4fea-8a04-c9f15e3c69c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:07.523746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f5787876-ec1a-4fea-8a04-c9f15e3c69c8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:07.528595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f5787876-ec1a-4fea-8a04-c9f15e3c69c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:07.554378 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 863/1738] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:07.555914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5787876-ec1a-4fea-8a04-c9f15e3c69c8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:07.574318 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5787876-ec1a-4fea-8a04-c9f15e3c69c8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:07.581289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072483db-2caf-4ee0-8553-912a7dbe67da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:07.582251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072483db-2caf-4ee0-8553-912a7dbe67da admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:07.583102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072483db-2caf-4ee0-8553-912a7dbe67da admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:07.583561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072483db-2caf-4ee0-8553-912a7dbe67da admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:07.584862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072483db-2caf-4ee0-8553-912a7dbe67da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:07.585327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072483db-2caf-4ee0-8553-912a7dbe67da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:07.587393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072483db-2caf-4ee0-8553-912a7dbe67da admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:07.607042 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc541f37-c746-45f8-8051-19369844119a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:07.611091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc541f37-c746-45f8-8051-19369844119a service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:07.617117 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 864/1739] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:07.618442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072483db-2caf-4ee0-8553-912a7dbe67da admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:07.632859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072483db-2caf-4ee0-8553-912a7dbe67da admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:07.638320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 876/1740] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:07.642032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9bfc3-5840-458e-a7a5-2102fb8ba4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:07.642943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9bfc3-5840-458e-a7a5-2102fb8ba4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:07.643445 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9bfc3-5840-458e-a7a5-2102fb8ba4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:07.643876 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9bfc3-5840-458e-a7a5-2102fb8ba4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:07.644807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9bfc3-5840-458e-a7a5-2102fb8ba4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:07.646947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9bfc3-5840-458e-a7a5-2102fb8ba4f7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:07.756502 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 865/1741] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:07 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:07.762529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541f37-c746-45f8-8051-19369844119a service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:07.826256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541f37-c746-45f8-8051-19369844119a service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:07.897931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9bfc3-5840-458e-a7a5-2102fb8ba4f7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:07.900302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d5d9bfc3-5840-458e-a7a5-2102fb8ba4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:07.984897 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2ce1d-fc41-4804-848c-bd3cf5e8e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:07.987676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2ce1d-fc41-4804-848c-bd3cf5e8e90f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:07.987850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2ce1d-fc41-4804-848c-bd3cf5e8e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:07.988239 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2ce1d-fc41-4804-848c-bd3cf5e8e90f admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:07.989023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2ce1d-fc41-4804-848c-bd3cf5e8e90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:07.991140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2ce1d-fc41-4804-848c-bd3cf5e8e90f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:08.028586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 877/1742] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:07 2022] POST /identity/v3/users => generated 287 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:08.034327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2ce1d-fc41-4804-848c-bd3cf5e8e90f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:08.059375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2ce1d-fc41-4804-848c-bd3cf5e8e90f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:08.070267 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9bfc3-5840-458e-a7a5-2102fb8ba4f7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:08.074123 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae62c8-57c5-4ee3-9ffd-545e373b8cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:08.075304 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae62c8-57c5-4ee3-9ffd-545e373b8cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:08.075304 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae62c8-57c5-4ee3-9ffd-545e373b8cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:08.075803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae62c8-57c5-4ee3-9ffd-545e373b8cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:08.076854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae62c8-57c5-4ee3-9ffd-545e373b8cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:08.078207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b918fb-44cb-4b29-b0d6-65ad0568487b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:08.079224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b918fb-44cb-4b29-b0d6-65ad0568487b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:08.079711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b918fb-44cb-4b29-b0d6-65ad0568487b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:08.080214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b918fb-44cb-4b29-b0d6-65ad0568487b admin admin] PATH_INFO: `/v3/projects/a83dedf3036f4448ab88467a007da616` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:08.080769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae62c8-57c5-4ee3-9ffd-545e373b8cc3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:08.082298 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b918fb-44cb-4b29-b0d6-65ad0568487b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83dedf3036f4448ab88467a007da616)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:08.085341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b918fb-44cb-4b29-b0d6-65ad0568487b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:08.126278 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 878/1743] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:08.131060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae62c8-57c5-4ee3-9ffd-545e373b8cc3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:08.148304 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae62c8-57c5-4ee3-9ffd-545e373b8cc3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:08.157876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76781f5b-7b1a-4f93-8114-e10048c7f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:08.158603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76781f5b-7b1a-4f93-8114-e10048c7f304 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:08.159069 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76781f5b-7b1a-4f93-8114-e10048c7f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:08.159498 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76781f5b-7b1a-4f93-8114-e10048c7f304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:08.162357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76781f5b-7b1a-4f93-8114-e10048c7f304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:08.165538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76781f5b-7b1a-4f93-8114-e10048c7f304 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:08.168631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:08.208740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 879/1744] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:08.208988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-80b918fb-44cb-4b29-b0d6-65ad0568487b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83dedf3036f4448ab88467a007da616', 'request_id': 'req-80b918fb-44cb-4b29-b0d6-65ad0568487b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:08.209619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76781f5b-7b1a-4f93-8114-e10048c7f304 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:08.221135 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-80b918fb-44cb-4b29-b0d6-65ad0568487b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83dedf3036f4448ab88467a007da616', 'request_id': 'req-80b918fb-44cb-4b29-b0d6-65ad0568487b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:08.228969 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76781f5b-7b1a-4f93-8114-e10048c7f304 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:08.230475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-80b918fb-44cb-4b29-b0d6-65ad0568487b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83dedf3036f4448ab88467a007da616', 'request_id': 'req-80b918fb-44cb-4b29-b0d6-65ad0568487b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:08.237231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:08.277269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-80b918fb-44cb-4b29-b0d6-65ad0568487b admin admin] The token cache is being invalidate because project a83dedf3036f4448ab88467a007da616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:08.281030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-80b918fb-44cb-4b29-b0d6-65ad0568487b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:08.283242 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-80b918fb-44cb-4b29-b0d6-65ad0568487b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:08.290294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 866/1745] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:07 2022] DELETE /identity/v3/projects/a83dedf3036f4448ab88467a007da616 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:08.297454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4740bd-eaff-4672-aab5-da6de5ffc540 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:08.298111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4740bd-eaff-4672-aab5-da6de5ffc540 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:08.300696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4740bd-eaff-4672-aab5-da6de5ffc540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:08.372163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2f4740bd-eaff-4672-aab5-da6de5ffc540 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:08.381571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2f4740bd-eaff-4672-aab5-da6de5ffc540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:08.410604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7c584-42ac-49dc-affe-8f3a1ca6285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:08.416285 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7c584-42ac-49dc-affe-8f3a1ca6285e admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:08.416285 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7c584-42ac-49dc-affe-8f3a1ca6285e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:08.416285 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7c584-42ac-49dc-affe-8f3a1ca6285e admin admin] PATH_INFO: `/v3/projects/386fd7f8d111413aacf7e7bdad3463f4/users/09f5b0fb700a4e079090214abf62b761/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:08.490054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7c584-42ac-49dc-affe-8f3a1ca6285e admin admin] RBAC: Authorizing `identity:create_grant(project_id=386fd7f8d111413aacf7e7bdad3463f4, user_id=09f5b0fb700a4e079090214abf62b761, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:08.502578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7c584-42ac-49dc-affe-8f3a1ca6285e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:08.568258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 880/1746] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:08 2022] PUT /identity/v3/projects/386fd7f8d111413aacf7e7bdad3463f4/users/09f5b0fb700a4e079090214abf62b761/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:08.576914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab26bec-282d-402e-9ed8-46b62ea3d4f2 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:08.582532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab26bec-282d-402e-9ed8-46b62ea3d4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:08.583403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab26bec-282d-402e-9ed8-46b62ea3d4f2 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:08.591845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 881/1747] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 08:54:08 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:54:08.598673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410c419-758a-497c-aae4-45d28598ff8b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:08.599169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410c419-758a-497c-aae4-45d28598ff8b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:08.602786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410c419-758a-497c-aae4-45d28598ff8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:08.786404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 867/1748] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:08.792318 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258b2b-0c1e-410d-b021-c76c61995f4d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:08.792825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258b2b-0c1e-410d-b021-c76c61995f4d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:08.802229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258b2b-0c1e-410d-b021-c76c61995f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:08.807866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7410c419-758a-497c-aae4-45d28598ff8b None None] MFA Rules not processed for user `09f5b0fb700a4e079090214abf62b761`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:08.811376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7410c419-758a-497c-aae4-45d28598ff8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:08.871078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-48258b2b-0c1e-410d-b021-c76c61995f4d None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:08.875295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-48258b2b-0c1e-410d-b021-c76c61995f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:09.035567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 882/1749] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:09.038619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53184351-34a2-4276-bb07-20213fb0a4bb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:09.040976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53184351-34a2-4276-bb07-20213fb0a4bb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:09.041492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53184351-34a2-4276-bb07-20213fb0a4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:09.089195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 868/1750] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:09.103323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-53184351-34a2-4276-bb07-20213fb0a4bb None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:09.113203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-53184351-34a2-4276-bb07-20213fb0a4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:09.154002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258b2b-0c1e-410d-b021-c76c61995f4d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:09.157535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-48258b2b-0c1e-410d-b021-c76c61995f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:09.483067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 883/1751] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:09.492068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53184351-34a2-4276-bb07-20213fb0a4bb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:09.509128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53184351-34a2-4276-bb07-20213fb0a4bb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:09.517482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0b9ab-2934-44a5-93f6-169ee436807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:09.518298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0b9ab-2934-44a5-93f6-169ee436807b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:09.518811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0b9ab-2934-44a5-93f6-169ee436807b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:09.519089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0b9ab-2934-44a5-93f6-169ee436807b admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:09.520567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0b9ab-2934-44a5-93f6-169ee436807b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:09.521059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0b9ab-2934-44a5-93f6-169ee436807b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:09.524152 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0b9ab-2934-44a5-93f6-169ee436807b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:09.527820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258b2b-0c1e-410d-b021-c76c61995f4d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:09.527988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:09.557326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:09.557326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:09.557326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:09.557326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] PATH_INFO: `/v3/projects/008c3781588b422ca5378eba0b0afdf7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:09.558032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=008c3781588b422ca5378eba0b0afdf7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:09.561263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 884/1752] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:09.561422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:09.566323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0b9ab-2934-44a5-93f6-169ee436807b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:09.585714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0b9ab-2934-44a5-93f6-169ee436807b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:09.602726 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747a040-dbb8-413b-a74e-07d4089a3f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:09.603028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747a040-dbb8-413b-a74e-07d4089a3f28 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:09.603384 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747a040-dbb8-413b-a74e-07d4089a3f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:09.603720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747a040-dbb8-413b-a74e-07d4089a3f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:09.604795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747a040-dbb8-413b-a74e-07d4089a3f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:09.608079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747a040-dbb8-413b-a74e-07d4089a3f28 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:09.625959 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=1,keystone:DELETE=2,keystone:SELECT=97 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:09.655029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 885/1753] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:09 2022] POST /identity/v3/projects => generated 391 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:09.656781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008c3781588b422ca5378eba0b0afdf7', 'request_id': 'req-11a5ed37-ac15-4c47-84c1-18333dbb0c03'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:09.656908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747a040-dbb8-413b-a74e-07d4089a3f28 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:09.659690 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6747a040-dbb8-413b-a74e-07d4089a3f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:09.664179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008c3781588b422ca5378eba0b0afdf7', 'request_id': 'req-11a5ed37-ac15-4c47-84c1-18333dbb0c03'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:09.672450 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008c3781588b422ca5378eba0b0afdf7', 'request_id': 'req-11a5ed37-ac15-4c47-84c1-18333dbb0c03'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:09.695551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] The token cache is being invalidate because project 008c3781588b422ca5378eba0b0afdf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:09.696301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:09.697483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:09.700888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 869/1754] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:09 2022] DELETE /identity/v3/projects/008c3781588b422ca5378eba0b0afdf7 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:09.702263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:09.709938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:09.760471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747a040-dbb8-413b-a74e-07d4089a3f28 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:09.769255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9eb3b8-a490-4fdb-a383-9b9a25f43aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:09.770051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9eb3b8-a490-4fdb-a383-9b9a25f43aab service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:09.770452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9eb3b8-a490-4fdb-a383-9b9a25f43aab service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:09.770834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9eb3b8-a490-4fdb-a383-9b9a25f43aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:09.773329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0f9eb3b8-a490-4fdb-a383-9b9a25f43aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:09.844853 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5ed37-ac15-4c47-84c1-18333dbb0c03 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:09.854053 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ad897-2e4b-483d-b805-00974baee588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:09.855185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ad897-2e4b-483d-b805-00974baee588 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:09.855727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ad897-2e4b-483d-b805-00974baee588 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:09.856295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ad897-2e4b-483d-b805-00974baee588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:09.859815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-432ad897-2e4b-483d-b805-00974baee588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:09.879758 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9eb3b8-a490-4fdb-a383-9b9a25f43aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:09.882694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9eb3b8-a490-4fdb-a383-9b9a25f43aab service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:09.888408 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ad897-2e4b-483d-b805-00974baee588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:09.894472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ad897-2e4b-483d-b805-00974baee588 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:09.913618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 886/1755] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:09.914594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9eb3b8-a490-4fdb-a383-9b9a25f43aab service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:09.916149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0f9eb3b8-a490-4fdb-a383-9b9a25f43aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:09.918656 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 870/1756] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:09.919804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ad897-2e4b-483d-b805-00974baee588 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:09.922877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-432ad897-2e4b-483d-b805-00974baee588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:10.077700 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ad897-2e4b-483d-b805-00974baee588 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:10.095157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:10.095735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:10.096026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:10.096324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] PATH_INFO: `/v3/users/c9cb00378db445909b8eca5986dad712` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:10.096457 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9eb3b8-a490-4fdb-a383-9b9a25f43aab service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:10.098695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9cb00378db445909b8eca5986dad712)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:10.102147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e342e-00a9-4afa-ac3b-f3856dde945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:10.102788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e342e-00a9-4afa-ac3b-f3856dde945f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:10.103072 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e342e-00a9-4afa-ac3b-f3856dde945f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:10.104367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e342e-00a9-4afa-ac3b-f3856dde945f admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:10.104367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e342e-00a9-4afa-ac3b-f3856dde945f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:10.105031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:10.106152 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e342e-00a9-4afa-ac3b-f3856dde945f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:10.153830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:10.164322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 887/1757] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:09 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:10.169681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e342e-00a9-4afa-ac3b-f3856dde945f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:10.197362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e342e-00a9-4afa-ac3b-f3856dde945f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:10.208612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:10.216382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e88f69-aad6-4a37-bebf-692ab62a0276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:10.216951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e88f69-aad6-4a37-bebf-692ab62a0276 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:10.217325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e88f69-aad6-4a37-bebf-692ab62a0276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:10.217526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e88f69-aad6-4a37-bebf-692ab62a0276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:10.218342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e88f69-aad6-4a37-bebf-692ab62a0276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:10.218549 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9cb00378db445909b8eca5986dad712'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.220194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e88f69-aad6-4a37-bebf-692ab62a0276 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:10.220490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9cb00378db445909b8eca5986dad712'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.233474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 888/1758] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:10.234861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e88f69-aad6-4a37-bebf-692ab62a0276 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:10.236669 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-79e88f69-aad6-4a37-bebf-692ab62a0276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:10.240461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9cb00378db445909b8eca5986dad712'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.254426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e88f69-aad6-4a37-bebf-692ab62a0276 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:10.254986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9cb00378db445909b8eca5986dad712'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.259917 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:10.260609 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:10.261032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:10.261318 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] PATH_INFO: `/v3/projects/6d2a0fb79eb742578ff5ce3895d09979` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:10.262529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d2a0fb79eb742578ff5ce3895d09979)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:10.264101 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9cb00378db445909b8eca5986dad712'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.265211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:10.270947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 871/1759] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:09 2022] DELETE /identity/v3/users/c9cb00378db445909b8eca5986dad712 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:10.272189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:10.274034 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:10.322979 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d2a0fb79eb742578ff5ce3895d09979', 'request_id': 'req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.332982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d2a0fb79eb742578ff5ce3895d09979', 'request_id': 'req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.342801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d2a0fb79eb742578ff5ce3895d09979', 'request_id': 'req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.353168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bcdf5-5525-4fc4-83be-8c658012fc40 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:10.361159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] The token cache is being invalidate because project 6d2a0fb79eb742578ff5ce3895d09979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:10.362075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.362265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.364916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 889/1760] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:10 2022] DELETE /identity/v3/projects/6d2a0fb79eb742578ff5ce3895d09979 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:10.365999 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:10.367566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:10.432149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:10.433201 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:10.433518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:10.433804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] PATH_INFO: `/v3/users/09f5b0fb700a4e079090214abf62b761` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:10.435562 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09f5b0fb700a4e079090214abf62b761)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:10.438065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:10.466743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1156c-24b6-42f8-9fd9-8bd1b5e0ed11 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:10.475461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f04d6-1e7d-4e92-bb49-fd03bf72a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:10.476172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f04d6-1e7d-4e92-bb49-fd03bf72a352 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:10.476507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f04d6-1e7d-4e92-bb49-fd03bf72a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:10.476962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f04d6-1e7d-4e92-bb49-fd03bf72a352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:10.478062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f04d6-1e7d-4e92-bb49-fd03bf72a352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:10.481392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f04d6-1e7d-4e92-bb49-fd03bf72a352 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:10.497671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 890/1761] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:10.499898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f04d6-1e7d-4e92-bb49-fd03bf72a352 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:10.503739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-313f04d6-1e7d-4e92-bb49-fd03bf72a352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:10.516634 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09f5b0fb700a4e079090214abf62b761'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.517796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09f5b0fb700a4e079090214abf62b761'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.518963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f04d6-1e7d-4e92-bb49-fd03bf72a352 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:10.525532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93d054-2b7c-4b1e-86a0-000f63e47ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:10.526343 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93d054-2b7c-4b1e-86a0-000f63e47ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:10.526633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93d054-2b7c-4b1e-86a0-000f63e47ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:10.526908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93d054-2b7c-4b1e-86a0-000f63e47ca6 admin admin] PATH_INFO: `/v3/users/2d07e03c5e6e4ceeb8251f0e369711c9` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:10.528638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93d054-2b7c-4b1e-86a0-000f63e47ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d07e03c5e6e4ceeb8251f0e369711c9)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:10.534745 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93d054-2b7c-4b1e-86a0-000f63e47ca6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:10.553738 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09f5b0fb700a4e079090214abf62b761'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.557964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:10.573490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09f5b0fb700a4e079090214abf62b761'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.588753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09f5b0fb700a4e079090214abf62b761'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.598436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 872/1762] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:10 2022] DELETE /identity/v3/users/09f5b0fb700a4e079090214abf62b761 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:10.599778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:10.601707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:10.621370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d93d054-2b7c-4b1e-86a0-000f63e47ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d07e03c5e6e4ceeb8251f0e369711c9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.621997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d93d054-2b7c-4b1e-86a0-000f63e47ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d07e03c5e6e4ceeb8251f0e369711c9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.637504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d93d054-2b7c-4b1e-86a0-000f63e47ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d07e03c5e6e4ceeb8251f0e369711c9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.648290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:10.660312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d93d054-2b7c-4b1e-86a0-000f63e47ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d07e03c5e6e4ceeb8251f0e369711c9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.667725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d93d054-2b7c-4b1e-86a0-000f63e47ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d07e03c5e6e4ceeb8251f0e369711c9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.677841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 891/1763] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:10 2022] DELETE /identity/v3/users/2d07e03c5e6e4ceeb8251f0e369711c9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:10.679739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12d21d-a174-4e97-a72c-339c1ed48615 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:10.680257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12d21d-a174-4e97-a72c-339c1ed48615 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:10.680611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12d21d-a174-4e97-a72c-339c1ed48615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:10.704420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1f12d21d-a174-4e97-a72c-339c1ed48615 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:10.705649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1f12d21d-a174-4e97-a72c-339c1ed48615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:10.713617 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606df1a0-70ad-4fbd-b2bf-b3673c37b4d9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:10.801104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 892/1764] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:10.801104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12d21d-a174-4e97-a72c-339c1ed48615 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:10.802565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1f12d21d-a174-4e97-a72c-339c1ed48615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:10.821600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12d21d-a174-4e97-a72c-339c1ed48615 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:10.827495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946c409-1906-40b9-9c66-3c19513932d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:10.829115 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946c409-1906-40b9-9c66-3c19513932d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:10.829235 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef2372-3ae9-41d8-b2b1-9a003dc078f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:10.829532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946c409-1906-40b9-9c66-3c19513932d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:10.829980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2372-3ae9-41d8-b2b1-9a003dc078f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:10.830081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946c409-1906-40b9-9c66-3c19513932d5 admin admin] PATH_INFO: `/v3/projects/13417eebfd454deabce8992a9c621c52` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:10.830928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2372-3ae9-41d8-b2b1-9a003dc078f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:10.830928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2372-3ae9-41d8-b2b1-9a003dc078f5 admin admin] PATH_INFO: `/v3/projects/9e466428d1fd4e12910119d90087525e/users/46290ece463c41cb82c644cc251efba8/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:10.832441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946c409-1906-40b9-9c66-3c19513932d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13417eebfd454deabce8992a9c621c52)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:10.835604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946c409-1906-40b9-9c66-3c19513932d5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:10.860058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef2372-3ae9-41d8-b2b1-9a003dc078f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e466428d1fd4e12910119d90087525e, user_id=46290ece463c41cb82c644cc251efba8, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:10.864971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef2372-3ae9-41d8-b2b1-9a003dc078f5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:10.884093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 873/1765] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:10 2022] PUT /identity/v3/projects/9e466428d1fd4e12910119d90087525e/users/46290ece463c41cb82c644cc251efba8/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:10.885306 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef2372-3ae9-41d8-b2b1-9a003dc078f5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:10.900072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-73ef2372-3ae9-41d8-b2b1-9a003dc078f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:10.927212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6946c409-1906-40b9-9c66-3c19513932d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13417eebfd454deabce8992a9c621c52', 'request_id': 'req-6946c409-1906-40b9-9c66-3c19513932d5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.936493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6946c409-1906-40b9-9c66-3c19513932d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13417eebfd454deabce8992a9c621c52', 'request_id': 'req-6946c409-1906-40b9-9c66-3c19513932d5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.946993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6946c409-1906-40b9-9c66-3c19513932d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13417eebfd454deabce8992a9c621c52', 'request_id': 'req-6946c409-1906-40b9-9c66-3c19513932d5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.964212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6946c409-1906-40b9-9c66-3c19513932d5 admin admin] The token cache is being invalidate because project 13417eebfd454deabce8992a9c621c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:10.964665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6946c409-1906-40b9-9c66-3c19513932d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.965387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6946c409-1906-40b9-9c66-3c19513932d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:10.971261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 893/1766] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:10 2022] DELETE /identity/v3/projects/13417eebfd454deabce8992a9c621c52 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:10.972977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c790af-947a-4057-97f4-8b8c30b63174 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:10.973204 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c790af-947a-4057-97f4-8b8c30b63174 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:10.973431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c790af-947a-4057-97f4-8b8c30b63174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:10.995572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef2372-3ae9-41d8-b2b1-9a003dc078f5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:11.010402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-41c790af-947a-4057-97f4-8b8c30b63174 None None] MFA Rules not processed for user `46290ece463c41cb82c644cc251efba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:11.011959 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-41c790af-947a-4057-97f4-8b8c30b63174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.029165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:11.063610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c36e9-e9bb-4b08-8f0b-3cb3f0cd9f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:11.064803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c36e9-e9bb-4b08-8f0b-3cb3f0cd9f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.064803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c36e9-e9bb-4b08-8f0b-3cb3f0cd9f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.065251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c36e9-e9bb-4b08-8f0b-3cb3f0cd9f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.067250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-927c36e9-e9bb-4b08-8f0b-3cb3f0cd9f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.121582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:11.145884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 894/1767] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:11.145884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745ed24-3730-4b98-b090-431b4f3a6c9a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.145884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745ed24-3730-4b98-b090-431b4f3a6c9a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.145884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745ed24-3730-4b98-b090-431b4f3a6c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.178234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f745ed24-3730-4b98-b090-431b4f3a6c9a None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:11.179146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f745ed24-3730-4b98-b090-431b4f3a6c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.200338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c36e9-e9bb-4b08-8f0b-3cb3f0cd9f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:11.201806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c36e9-e9bb-4b08-8f0b-3cb3f0cd9f5f service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:11.213886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 874/1768] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:11.215215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c36e9-e9bb-4b08-8f0b-3cb3f0cd9f5f service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:11.216982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-927c36e9-e9bb-4b08-8f0b-3cb3f0cd9f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.235684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c36e9-e9bb-4b08-8f0b-3cb3f0cd9f5f service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:11.240527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:11.241186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.241469 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.241740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] PATH_INFO: `/v3/projects/642ec49a52554192ae10771fef9da620` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.243075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=642ec49a52554192ae10771fef9da620)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:11.245036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:11.254889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 895/1769] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:11.256055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745ed24-3730-4b98-b090-431b4f3a6c9a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:11.257641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f745ed24-3730-4b98-b090-431b4f3a6c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.273794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745ed24-3730-4b98-b090-431b4f3a6c9a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:11.280167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16895aae-f081-4c31-ac65-66931c4d2564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:11.281490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16895aae-f081-4c31-ac65-66931c4d2564 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.282267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16895aae-f081-4c31-ac65-66931c4d2564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.282532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16895aae-f081-4c31-ac65-66931c4d2564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.283367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16895aae-f081-4c31-ac65-66931c4d2564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:11.285789 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16895aae-f081-4c31-ac65-66931c4d2564 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:11.316835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '642ec49a52554192ae10771fef9da620', 'request_id': 'req-98a8992e-e9a7-459a-9e14-3f4ec98c6930'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:11.320170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 896/1770] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:11 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:11.320170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40c51d-5f15-47c3-a709-7c21f23d0915 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.320170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40c51d-5f15-47c3-a709-7c21f23d0915 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.320482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40c51d-5f15-47c3-a709-7c21f23d0915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.329056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '642ec49a52554192ae10771fef9da620', 'request_id': 'req-98a8992e-e9a7-459a-9e14-3f4ec98c6930'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:11.337996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '642ec49a52554192ae10771fef9da620', 'request_id': 'req-98a8992e-e9a7-459a-9e14-3f4ec98c6930'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:11.342844 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7e40c51d-5f15-47c3-a709-7c21f23d0915 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:11.344176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7e40c51d-5f15-47c3-a709-7c21f23d0915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.354383 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] The token cache is being invalidate because project 642ec49a52554192ae10771fef9da620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:11.354835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:11.355846 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:11.357886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 875/1771] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:11 2022] DELETE /identity/v3/projects/642ec49a52554192ae10771fef9da620 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:11.360296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:11.361539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.427543 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 897/1772] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:11.429178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f187c75-8789-4019-9699-21f654c9f748 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.429432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f187c75-8789-4019-9699-21f654c9f748 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.429708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f187c75-8789-4019-9699-21f654c9f748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.464302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8992e-e9a7-459a-9e14-3f4ec98c6930 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:11.469721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51bbb-00c0-43fe-a6da-544de927d8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:11.470949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51bbb-00c0-43fe-a6da-544de927d8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.470949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51bbb-00c0-43fe-a6da-544de927d8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.471172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51bbb-00c0-43fe-a6da-544de927d8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.471948 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51bbb-00c0-43fe-a6da-544de927d8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:11.472339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8f187c75-8789-4019-9699-21f654c9f748 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:11.474177 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51bbb-00c0-43fe-a6da-544de927d8a0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:11.474636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8f187c75-8789-4019-9699-21f654c9f748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.485998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:11.495775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 898/1773] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:11.496906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f187c75-8789-4019-9699-21f654c9f748 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:11.510207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f187c75-8789-4019-9699-21f654c9f748 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:11.514624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 876/1774] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:11 2022] POST /identity/v3/users => generated 303 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:11.516411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226f0c1-f1fa-46ed-b088-a921e5100ea3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.516706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226f0c1-f1fa-46ed-b088-a921e5100ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.516987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226f0c1-f1fa-46ed-b088-a921e5100ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.519261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15b22-58f8-4fce-8dde-7d4fd4760fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:11.519947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15b22-58f8-4fce-8dde-7d4fd4760fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.520408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15b22-58f8-4fce-8dde-7d4fd4760fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.520777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15b22-58f8-4fce-8dde-7d4fd4760fa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.528381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e15b22-58f8-4fce-8dde-7d4fd4760fa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:11.528381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e15b22-58f8-4fce-8dde-7d4fd4760fa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:11.528381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e15b22-58f8-4fce-8dde-7d4fd4760fa7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:11.547980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d226f0c1-f1fa-46ed-b088-a921e5100ea3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:11.548355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 899/1775] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:11.548355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15b22-58f8-4fce-8dde-7d4fd4760fa7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:11.548624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d226f0c1-f1fa-46ed-b088-a921e5100ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.559880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15b22-58f8-4fce-8dde-7d4fd4760fa7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:11.562087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 877/1776] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:11.566149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226f0c1-f1fa-46ed-b088-a921e5100ea3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:11.574860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b80120-e615-44fd-a89a-8aee09d69c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:11.576399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b80120-e615-44fd-a89a-8aee09d69c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.577505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b80120-e615-44fd-a89a-8aee09d69c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.578637 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b80120-e615-44fd-a89a-8aee09d69c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.579605 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b80120-e615-44fd-a89a-8aee09d69c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:11.581073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226f0c1-f1fa-46ed-b088-a921e5100ea3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:11.581651 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b80120-e615-44fd-a89a-8aee09d69c80 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:11.589466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6fda-93d8-4887-b98c-b48c4caf3953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:11.590083 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6fda-93d8-4887-b98c-b48c4caf3953 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.590595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6fda-93d8-4887-b98c-b48c4caf3953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.590851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6fda-93d8-4887-b98c-b48c4caf3953 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.591548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a6fda-93d8-4887-b98c-b48c4caf3953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:11.593519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a6fda-93d8-4887-b98c-b48c4caf3953 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:11.598614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 900/1777] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:11.598614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b80120-e615-44fd-a89a-8aee09d69c80 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:11.598614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d0b80120-e615-44fd-a89a-8aee09d69c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.613284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b80120-e615-44fd-a89a-8aee09d69c80 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:11.619022 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:11.619836 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.620422 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.620540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] PATH_INFO: `/v3/projects/386fd7f8d111413aacf7e7bdad3463f4` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.621798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386fd7f8d111413aacf7e7bdad3463f4)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:11.623839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:11.627529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 878/1778] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:11 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:11.628452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6fda-93d8-4887-b98c-b48c4caf3953 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:11.681770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:11.694440 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386fd7f8d111413aacf7e7bdad3463f4', 'request_id': 'req-cdb632f2-d29d-4fab-b650-a22b81e4f061'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:11.702447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386fd7f8d111413aacf7e7bdad3463f4', 'request_id': 'req-cdb632f2-d29d-4fab-b650-a22b81e4f061'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:11.713908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6fda-93d8-4887-b98c-b48c4caf3953 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:11.716394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386fd7f8d111413aacf7e7bdad3463f4', 'request_id': 'req-cdb632f2-d29d-4fab-b650-a22b81e4f061'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:11.731120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] The token cache is being invalidate because project 386fd7f8d111413aacf7e7bdad3463f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:11.731523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:11.732334 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:11.742708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 901/1779] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:11 2022] DELETE /identity/v3/projects/386fd7f8d111413aacf7e7bdad3463f4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:11.742708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:11.745786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.793589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7e6b9-1126-483e-b12c-03966fc2480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:11.794321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7e6b9-1126-483e-b12c-03966fc2480a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.795258 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7e6b9-1126-483e-b12c-03966fc2480a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.795735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7e6b9-1126-483e-b12c-03966fc2480a admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.796977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7e6b9-1126-483e-b12c-03966fc2480a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:11.797419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7e6b9-1126-483e-b12c-03966fc2480a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:11.802731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7e6b9-1126-483e-b12c-03966fc2480a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:11.830733 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 879/1780] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:11.831434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7e6b9-1126-483e-b12c-03966fc2480a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:11.836630 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cac7e6b9-1126-483e-b12c-03966fc2480a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.852513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7e6b9-1126-483e-b12c-03966fc2480a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:11.863884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71c46e-9b51-49c1-b994-921ae4036c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:11.864939 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71c46e-9b51-49c1-b994-921ae4036c5a admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.865521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71c46e-9b51-49c1-b994-921ae4036c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.865804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb632f2-d29d-4fab-b650-a22b81e4f061 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:11.866489 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71c46e-9b51-49c1-b994-921ae4036c5a admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.867602 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71c46e-9b51-49c1-b994-921ae4036c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:11.870783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71c46e-9b51-49c1-b994-921ae4036c5a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:11.871370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafde8f-8bf8-4bb1-ab4f-3eb6a0606175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:11.872064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafde8f-8bf8-4bb1-ab4f-3eb6a0606175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.872396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafde8f-8bf8-4bb1-ab4f-3eb6a0606175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.872676 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafde8f-8bf8-4bb1-ab4f-3eb6a0606175 admin admin] PATH_INFO: `/v3/projects/fa19419317c74aa4aac0d55d992cf7af/users/1d40ee235cbd4bbd804f1fc2a8d5bb7d/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.889660 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafde8f-8bf8-4bb1-ab4f-3eb6a0606175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa19419317c74aa4aac0d55d992cf7af, user_id=1d40ee235cbd4bbd804f1fc2a8d5bb7d, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:11.893183 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafde8f-8bf8-4bb1-ab4f-3eb6a0606175 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:11.897021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 880/1781] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:11 2022] POST /identity/v3/users => generated 293 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:11.898476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868202-b783-4413-a537-be70c2465e97 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:11.898783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868202-b783-4413-a537-be70c2465e97 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:11.899077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868202-b783-4413-a537-be70c2465e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:11.907150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 902/1782] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:11 2022] PUT /identity/v3/projects/fa19419317c74aa4aac0d55d992cf7af/users/1d40ee235cbd4bbd804f1fc2a8d5bb7d/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:11.907971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafde8f-8bf8-4bb1-ab4f-3eb6a0606175 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:11.909835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0cafde8f-8bf8-4bb1-ab4f-3eb6a0606175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.926654 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d8868202-b783-4413-a537-be70c2465e97 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:11.928034 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d8868202-b783-4413-a537-be70c2465e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:11.986452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:12.004554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafde8f-8bf8-4bb1-ab4f-3eb6a0606175 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.007393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 881/1783] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:12.008415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8868202-b783-4413-a537-be70c2465e97 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.019177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85045c5d-b0bf-43ff-9f1a-378f0b03e7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.019831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85045c5d-b0bf-43ff-9f1a-378f0b03e7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.020441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85045c5d-b0bf-43ff-9f1a-378f0b03e7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.020441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85045c5d-b0bf-43ff-9f1a-378f0b03e7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.021079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85045c5d-b0bf-43ff-9f1a-378f0b03e7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.023024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85045c5d-b0bf-43ff-9f1a-378f0b03e7b7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.024337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8868202-b783-4413-a537-be70c2465e97 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.029970 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4003c7-ba4e-4dea-88da-f224cd47b117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.030776 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4003c7-ba4e-4dea-88da-f224cd47b117 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.031167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4003c7-ba4e-4dea-88da-f224cd47b117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.031530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4003c7-ba4e-4dea-88da-f224cd47b117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.032389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4003c7-ba4e-4dea-88da-f224cd47b117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.034097 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4003c7-ba4e-4dea-88da-f224cd47b117 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.071240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 903/1784] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:11 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:12.072255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 882/1785] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:12.072560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85045c5d-b0bf-43ff-9f1a-378f0b03e7b7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.074771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa85ba-00b3-4f97-bcd4-1203d4262f14 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.076206 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa85ba-00b3-4f97-bcd4-1203d4262f14 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.076504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa85ba-00b3-4f97-bcd4-1203d4262f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.127373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-01fa85ba-00b3-4f97-bcd4-1203d4262f14 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:12.131898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-01fa85ba-00b3-4f97-bcd4-1203d4262f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:12.147534 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:12.208524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85045c5d-b0bf-43ff-9f1a-378f0b03e7b7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.218247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789881f-5ff9-46b7-98a4-c13477a5a417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.218935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789881f-5ff9-46b7-98a4-c13477a5a417 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.219227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789881f-5ff9-46b7-98a4-c13477a5a417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.219506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789881f-5ff9-46b7-98a4-c13477a5a417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.220260 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789881f-5ff9-46b7-98a4-c13477a5a417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.221910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789881f-5ff9-46b7-98a4-c13477a5a417 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.235401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 883/1786] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:12.236990 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa85ba-00b3-4f97-bcd4-1203d4262f14 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.239242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 904/1787] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:12.240259 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789881f-5ff9-46b7-98a4-c13477a5a417 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.258253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa85ba-00b3-4f97-bcd4-1203d4262f14 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.268329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789881f-5ff9-46b7-98a4-c13477a5a417 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.269189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499f28c-0903-4d78-b938-4c695f9d100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.270284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499f28c-0903-4d78-b938-4c695f9d100c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.270927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499f28c-0903-4d78-b938-4c695f9d100c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.271424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499f28c-0903-4d78-b938-4c695f9d100c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.273091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499f28c-0903-4d78-b938-4c695f9d100c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.274521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc4465-b1f9-48b3-8939-aff23d298cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.275159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc4465-b1f9-48b3-8939-aff23d298cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.275446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc4465-b1f9-48b3-8939-aff23d298cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.275725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc4465-b1f9-48b3-8939-aff23d298cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.276439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc4465-b1f9-48b3-8939-aff23d298cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.276760 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499f28c-0903-4d78-b938-4c695f9d100c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.278384 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc4465-b1f9-48b3-8939-aff23d298cd6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.299315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 884/1788] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:12.300637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499f28c-0903-4d78-b938-4c695f9d100c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.319440 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 905/1789] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:12 2022] POST /identity/v3/users => generated 294 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:12.320853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc4465-b1f9-48b3-8939-aff23d298cd6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.325151 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499f28c-0903-4d78-b938-4c695f9d100c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.332444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed84ca5-9e3b-4388-92de-9edbc420be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.333753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed84ca5-9e3b-4388-92de-9edbc420be37 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.334946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed84ca5-9e3b-4388-92de-9edbc420be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.335241 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed84ca5-9e3b-4388-92de-9edbc420be37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.336384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed84ca5-9e3b-4388-92de-9edbc420be37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:12.336859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed84ca5-9e3b-4388-92de-9edbc420be37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.338575 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed84ca5-9e3b-4388-92de-9edbc420be37 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.339322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc4465-b1f9-48b3-8939-aff23d298cd6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.350225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3e57c-4ba8-40df-9aaa-8b7129c4763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.353615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3e57c-4ba8-40df-9aaa-8b7129c4763b admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.354252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3e57c-4ba8-40df-9aaa-8b7129c4763b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.355204 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3e57c-4ba8-40df-9aaa-8b7129c4763b admin admin] PATH_INFO: `/v3/projects/fa19419317c74aa4aac0d55d992cf7af/users/1d40ee235cbd4bbd804f1fc2a8d5bb7d/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.358245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3e57c-4ba8-40df-9aaa-8b7129c4763b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa19419317c74aa4aac0d55d992cf7af, user_id=1d40ee235cbd4bbd804f1fc2a8d5bb7d, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.361777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 885/1790] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:12.362962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3e57c-4ba8-40df-9aaa-8b7129c4763b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.365206 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed84ca5-9e3b-4388-92de-9edbc420be37 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.381537 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 906/1791] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:12 2022] PUT /identity/v3/projects/fa19419317c74aa4aac0d55d992cf7af/users/1d40ee235cbd4bbd804f1fc2a8d5bb7d/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:12.382520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3e57c-4ba8-40df-9aaa-8b7129c4763b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.384750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed84ca5-9e3b-4388-92de-9edbc420be37 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.463938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0e8c4-dbbe-448d-a2de-9d0594e56d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.464734 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0e8c4-dbbe-448d-a2de-9d0594e56d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.465022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0e8c4-dbbe-448d-a2de-9d0594e56d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.465303 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0e8c4-dbbe-448d-a2de-9d0594e56d42 admin admin] PATH_INFO: `/v3/projects/fc18dc191bed4d5582d08eae7c0e44fe/users/3732294ba3874cfb87de3f2e33a07220/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.466380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3e57c-4ba8-40df-9aaa-8b7129c4763b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.475682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45684e-82d8-41a5-b38e-1726886ce5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.477011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45684e-82d8-41a5-b38e-1726886ce5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.477526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45684e-82d8-41a5-b38e-1726886ce5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.478058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45684e-82d8-41a5-b38e-1726886ce5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.479343 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45684e-82d8-41a5-b38e-1726886ce5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.482630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45684e-82d8-41a5-b38e-1726886ce5c6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.484904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0e8c4-dbbe-448d-a2de-9d0594e56d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc18dc191bed4d5582d08eae7c0e44fe, user_id=3732294ba3874cfb87de3f2e33a07220, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.489100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0e8c4-dbbe-448d-a2de-9d0594e56d42 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.509379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 907/1792] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:12.510329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45684e-82d8-41a5-b38e-1726886ce5c6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.513121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 886/1793] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:12 2022] PUT /identity/v3/projects/fc18dc191bed4d5582d08eae7c0e44fe/users/3732294ba3874cfb87de3f2e33a07220/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:12.521748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ed15a-6305-4b0b-8a02-ad550ba8bae1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.522046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ed15a-6305-4b0b-8a02-ad550ba8bae1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.522343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ed15a-6305-4b0b-8a02-ad550ba8bae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.531368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45684e-82d8-41a5-b38e-1726886ce5c6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.557919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-341ed15a-6305-4b0b-8a02-ad550ba8bae1 None None] MFA Rules not processed for user `1d40ee235cbd4bbd804f1fc2a8d5bb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:12.567053 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-341ed15a-6305-4b0b-8a02-ad550ba8bae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:12.601603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:12.616571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e33978-cb91-46bc-a638-7a6c33893da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.617134 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e33978-cb91-46bc-a638-7a6c33893da0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.617383 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e33978-cb91-46bc-a638-7a6c33893da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.617898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e33978-cb91-46bc-a638-7a6c33893da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.619081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e33978-cb91-46bc-a638-7a6c33893da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.621356 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e33978-cb91-46bc-a638-7a6c33893da0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.657221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 908/1794] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:12 2022] POST /identity/v3/projects => generated 403 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:12.657221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e33978-cb91-46bc-a638-7a6c33893da0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.658032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 887/1795] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:12.658032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b25eb-d685-469c-8aec-240b707756a7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.658032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b25eb-d685-469c-8aec-240b707756a7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.658032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b25eb-d685-469c-8aec-240b707756a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.696599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-904b25eb-d685-469c-8aec-240b707756a7 None None] MFA Rules not processed for user `3732294ba3874cfb87de3f2e33a07220`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:12.697847 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:12.699336 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-904b25eb-d685-469c-8aec-240b707756a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:12.759126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e33978-cb91-46bc-a638-7a6c33893da0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.765150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5c87d-68f1-45e6-8d37-57386bf981a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.766834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5c87d-68f1-45e6-8d37-57386bf981a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.766834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5c87d-68f1-45e6-8d37-57386bf981a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.766834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5c87d-68f1-45e6-8d37-57386bf981a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.767729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5c87d-68f1-45e6-8d37-57386bf981a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.769648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5c87d-68f1-45e6-8d37-57386bf981a2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.782145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 909/1796] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:12.783008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5c87d-68f1-45e6-8d37-57386bf981a2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.794997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5c87d-68f1-45e6-8d37-57386bf981a2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.803361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc8c1a-a373-48e9-b6ce-50f23d9a9f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.804306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc8c1a-a373-48e9-b6ce-50f23d9a9f26 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.804769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc8c1a-a373-48e9-b6ce-50f23d9a9f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.805199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc8c1a-a373-48e9-b6ce-50f23d9a9f26 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.807815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc8c1a-a373-48e9-b6ce-50f23d9a9f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.810462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc8c1a-a373-48e9-b6ce-50f23d9a9f26 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.820643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 888/1797] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:12.821619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b25eb-d685-469c-8aec-240b707756a7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.823073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-904b25eb-d685-469c-8aec-240b707756a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:12.855711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 910/1798] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:12 2022] POST /identity/v3/users => generated 302 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:12.855711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc8c1a-a373-48e9-b6ce-50f23d9a9f26 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:12.879602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc8c1a-a373-48e9-b6ce-50f23d9a9f26 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.888886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb022f-af08-478f-8fc1-039bad4e3ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.890907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb022f-af08-478f-8fc1-039bad4e3ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.891198 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb022f-af08-478f-8fc1-039bad4e3ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.891534 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb022f-af08-478f-8fc1-039bad4e3ef9 admin admin] PATH_INFO: `/v3/projects/03242d87d4634963b686b6df0d98f243/users/c06133c0dc634d65aa6c05d8d056430d/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.902732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b25eb-d685-469c-8aec-240b707756a7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:12.910117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb022f-af08-478f-8fc1-039bad4e3ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03242d87d4634963b686b6df0d98f243, user_id=c06133c0dc634d65aa6c05d8d056430d, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:12.913111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb022f-af08-478f-8fc1-039bad4e3ef9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:12.916429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e511e-02e0-49b3-a67c-9a36d1aa726b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:12.917483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e511e-02e0-49b3-a67c-9a36d1aa726b service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:12.917483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e511e-02e0-49b3-a67c-9a36d1aa726b service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:12.918096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e511e-02e0-49b3-a67c-9a36d1aa726b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:12.941230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 911/1799] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:12 2022] PUT /identity/v3/projects/03242d87d4634963b686b6df0d98f243/users/c06133c0dc634d65aa6c05d8d056430d/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:12.943147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb022f-af08-478f-8fc1-039bad4e3ef9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.004977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e511e-02e0-49b3-a67c-9a36d1aa726b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.007484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e511e-02e0-49b3-a67c-9a36d1aa726b service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.028634 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb022f-af08-478f-8fc1-039bad4e3ef9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.035343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 889/1800] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:13.036789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e511e-02e0-49b3-a67c-9a36d1aa726b service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.041003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319b2b1-2271-490a-9e79-e1705737dc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.042329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319b2b1-2271-490a-9e79-e1705737dc39 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.042856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:13.042953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319b2b1-2271-490a-9e79-e1705737dc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.043671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319b2b1-2271-490a-9e79-e1705737dc39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.044884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319b2b1-2271-490a-9e79-e1705737dc39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.047023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319b2b1-2271-490a-9e79-e1705737dc39 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.050844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e511e-02e0-49b3-a67c-9a36d1aa726b service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.061123 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f60975-68fa-4767-96d1-f40abd4f5624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.061974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f60975-68fa-4767-96d1-f40abd4f5624 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.063258 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f60975-68fa-4767-96d1-f40abd4f5624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.063619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f60975-68fa-4767-96d1-f40abd4f5624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.064618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f60975-68fa-4767-96d1-f40abd4f5624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.066642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f60975-68fa-4767-96d1-f40abd4f5624 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.088420 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 890/1801] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:13.088420 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1996a4-9e57-4de0-951e-5c63722ea8a2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.088420 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1996a4-9e57-4de0-951e-5c63722ea8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.088420 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1996a4-9e57-4de0-951e-5c63722ea8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.094940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 912/1802] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:12 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:13.096050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319b2b1-2271-490a-9e79-e1705737dc39 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.130046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9e1996a4-9e57-4de0-951e-5c63722ea8a2 None None] MFA Rules not processed for user `c06133c0dc634d65aa6c05d8d056430d`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:13.131654 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9e1996a4-9e57-4de0-951e-5c63722ea8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:13.180255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319b2b1-2271-490a-9e79-e1705737dc39 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.185662 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b670ca-f8b6-4825-a5df-050e90d949c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.186456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b670ca-f8b6-4825-a5df-050e90d949c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.186748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b670ca-f8b6-4825-a5df-050e90d949c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.187027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b670ca-f8b6-4825-a5df-050e90d949c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.188484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b670ca-f8b6-4825-a5df-050e90d949c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.190420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b670ca-f8b6-4825-a5df-050e90d949c3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.192014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:13.213496 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 913/1803] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:13.213496 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b670ca-f8b6-4825-a5df-050e90d949c3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.222383 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 891/1804] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:13.223277 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1996a4-9e57-4de0-951e-5c63722ea8a2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.228476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9e1996a4-9e57-4de0-951e-5c63722ea8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:13.233849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b670ca-f8b6-4825-a5df-050e90d949c3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.240505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f313db1-5152-4a3c-9398-5e4ab932c64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.241454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f313db1-5152-4a3c-9398-5e4ab932c64f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.241972 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f313db1-5152-4a3c-9398-5e4ab932c64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.242316 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f313db1-5152-4a3c-9398-5e4ab932c64f admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.243080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f313db1-5152-4a3c-9398-5e4ab932c64f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.247104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f313db1-5152-4a3c-9398-5e4ab932c64f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.281900 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 914/1805] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:13 2022] POST /identity/v3/users => generated 294 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:13.282926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f313db1-5152-4a3c-9398-5e4ab932c64f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.294305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f313db1-5152-4a3c-9398-5e4ab932c64f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.300052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287920cc-c641-41bc-bbe8-ff35a0a0a96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.301047 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287920cc-c641-41bc-bbe8-ff35a0a0a96e admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.301047 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287920cc-c641-41bc-bbe8-ff35a0a0a96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.301328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287920cc-c641-41bc-bbe8-ff35a0a0a96e admin admin] PATH_INFO: `/v3/projects/f60ce70d32a94443a0bfb33050be3e8e/users/11d7b95a5eff4dc79d0f213c6160b225/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.301598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1996a4-9e57-4de0-951e-5c63722ea8a2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.305334 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5dc44-3ce0-48a7-8997-90394916d89f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.305964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5dc44-3ce0-48a7-8997-90394916d89f service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.306245 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5dc44-3ce0-48a7-8997-90394916d89f service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.306521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5dc44-3ce0-48a7-8997-90394916d89f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.308454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-68b5dc44-3ce0-48a7-8997-90394916d89f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:13.319988 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287920cc-c641-41bc-bbe8-ff35a0a0a96e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60ce70d32a94443a0bfb33050be3e8e, user_id=11d7b95a5eff4dc79d0f213c6160b225, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.322778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287920cc-c641-41bc-bbe8-ff35a0a0a96e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.339944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 915/1806] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:13 2022] PUT /identity/v3/projects/f60ce70d32a94443a0bfb33050be3e8e/users/11d7b95a5eff4dc79d0f213c6160b225/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:13.345522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287920cc-c641-41bc-bbe8-ff35a0a0a96e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.384810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5dc44-3ce0-48a7-8997-90394916d89f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.386251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5dc44-3ce0-48a7-8997-90394916d89f service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.395909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 892/1807] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:13.396587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5dc44-3ce0-48a7-8997-90394916d89f service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.408106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5dc44-3ce0-48a7-8997-90394916d89f service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.413987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70e92d-7f91-4828-922c-46e2d59ede50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.414609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70e92d-7f91-4828-922c-46e2d59ede50 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.414890 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70e92d-7f91-4828-922c-46e2d59ede50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.415163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70e92d-7f91-4828-922c-46e2d59ede50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.416017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70e92d-7f91-4828-922c-46e2d59ede50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.417539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287920cc-c641-41bc-bbe8-ff35a0a0a96e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.417668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70e92d-7f91-4828-922c-46e2d59ede50 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.423410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dbc08-ab02-40b5-a6d9-7a749c436ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.424325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dbc08-ab02-40b5-a6d9-7a749c436ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.424818 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dbc08-ab02-40b5-a6d9-7a749c436ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.426951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dbc08-ab02-40b5-a6d9-7a749c436ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.427656 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dbc08-ab02-40b5-a6d9-7a749c436ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.429642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 893/1808] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:13.430918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516af60-d6c8-4252-95ab-ddfe0ff5231d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.431210 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516af60-d6c8-4252-95ab-ddfe0ff5231d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.431485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516af60-d6c8-4252-95ab-ddfe0ff5231d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.433130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dbc08-ab02-40b5-a6d9-7a749c436ee0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.452365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7516af60-d6c8-4252-95ab-ddfe0ff5231d None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:13.453611 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7516af60-d6c8-4252-95ab-ddfe0ff5231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:13.465008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 894/1809] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:13.465008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516af60-d6c8-4252-95ab-ddfe0ff5231d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.477124 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516af60-d6c8-4252-95ab-ddfe0ff5231d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.480958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 916/1810] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:13 2022] POST /identity/v3/projects => generated 389 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:13.481903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dbc08-ab02-40b5-a6d9-7a749c436ee0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.486002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1a4dbc08-ab02-40b5-a6d9-7a749c436ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:13.494062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cfbd0-92c4-4e53-8d6e-a37eb285503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.494771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cfbd0-92c4-4e53-8d6e-a37eb285503e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.495057 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cfbd0-92c4-4e53-8d6e-a37eb285503e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.495337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cfbd0-92c4-4e53-8d6e-a37eb285503e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.496226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cfbd0-92c4-4e53-8d6e-a37eb285503e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.497852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cfbd0-92c4-4e53-8d6e-a37eb285503e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.509298 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 895/1811] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:13.509957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cfbd0-92c4-4e53-8d6e-a37eb285503e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.532940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cfbd0-92c4-4e53-8d6e-a37eb285503e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.537788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:13.550623 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dbc08-ab02-40b5-a6d9-7a749c436ee0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.556515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9949d1-c71c-4ef6-8fcf-0f9bf6531c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.556999 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9949d1-c71c-4ef6-8fcf-0f9bf6531c91 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.557286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9949d1-c71c-4ef6-8fcf-0f9bf6531c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.557900 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9949d1-c71c-4ef6-8fcf-0f9bf6531c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.626492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965d068-a20f-4dfd-b3be-aec8ac4221c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.626740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:13.627439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965d068-a20f-4dfd-b3be-aec8ac4221c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.627826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965d068-a20f-4dfd-b3be-aec8ac4221c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.628388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965d068-a20f-4dfd-b3be-aec8ac4221c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.630228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965d068-a20f-4dfd-b3be-aec8ac4221c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.633678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965d068-a20f-4dfd-b3be-aec8ac4221c6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.645813 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9949d1-c71c-4ef6-8fcf-0f9bf6531c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.648873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9949d1-c71c-4ef6-8fcf-0f9bf6531c91 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.663126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 917/1812] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:13.669873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 896/1813] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:13 2022] POST /identity/v3/users => generated 301 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:13.677211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9949d1-c71c-4ef6-8fcf-0f9bf6531c91 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.680491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965d068-a20f-4dfd-b3be-aec8ac4221c6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.691769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9949d1-c71c-4ef6-8fcf-0f9bf6531c91 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.700310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3873-8238-47c3-b1b9-ad0ea319f120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.701133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3873-8238-47c3-b1b9-ad0ea319f120 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.701487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3873-8238-47c3-b1b9-ad0ea319f120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.701865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3873-8238-47c3-b1b9-ad0ea319f120 admin admin] PATH_INFO: `/v3/projects/faf77496920c4578ad58feca560e79c3/users/9c30750853ab4147839280451b29c6fc/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.715157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965d068-a20f-4dfd-b3be-aec8ac4221c6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.739243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe49a9c-c86a-4a3c-852c-136aec11709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.739487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3873-8238-47c3-b1b9-ad0ea319f120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf77496920c4578ad58feca560e79c3, user_id=9c30750853ab4147839280451b29c6fc, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.740685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe49a9c-c86a-4a3c-852c-136aec11709a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.743438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe49a9c-c86a-4a3c-852c-136aec11709a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.743887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe49a9c-c86a-4a3c-852c-136aec11709a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.745067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe49a9c-c86a-4a3c-852c-136aec11709a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.746021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3873-8238-47c3-b1b9-ad0ea319f120 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.752811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe49a9c-c86a-4a3c-852c-136aec11709a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.773128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 918/1814] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:13 2022] PUT /identity/v3/projects/faf77496920c4578ad58feca560e79c3/users/9c30750853ab4147839280451b29c6fc/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:13.776542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 897/1815] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:13.780376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3873-8238-47c3-b1b9-ad0ea319f120 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.792568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b871c-54d9-44aa-94da-7cb6f24f5c85 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.793945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b871c-54d9-44aa-94da-7cb6f24f5c85 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.794422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b871c-54d9-44aa-94da-7cb6f24f5c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.861625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-aa0b871c-54d9-44aa-94da-7cb6f24f5c85 None None] MFA Rules not processed for user `9c30750853ab4147839280451b29c6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:13.863186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-aa0b871c-54d9-44aa-94da-7cb6f24f5c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:13.925124 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3873-8238-47c3-b1b9-ad0ea319f120 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:13.933007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950c8af-b8d6-4be3-bf6b-97cedbe1c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:13.934544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950c8af-b8d6-4be3-bf6b-97cedbe1c532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:13.934840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950c8af-b8d6-4be3-bf6b-97cedbe1c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:13.935275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950c8af-b8d6-4be3-bf6b-97cedbe1c532 admin admin] PATH_INFO: `/v3/projects/3244931769514e54af15d37cb11d4eb1/users/ff43f2aba1b54e3b938e7d2c371818ad/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:13.956701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950c8af-b8d6-4be3-bf6b-97cedbe1c532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3244931769514e54af15d37cb11d4eb1, user_id=ff43f2aba1b54e3b938e7d2c371818ad, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:13.960217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950c8af-b8d6-4be3-bf6b-97cedbe1c532 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:13.962692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 898/1816] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:13.969895 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b871c-54d9-44aa-94da-7cb6f24f5c85 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.982344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 919/1817] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:13 2022] PUT /identity/v3/projects/3244931769514e54af15d37cb11d4eb1/users/ff43f2aba1b54e3b938e7d2c371818ad/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:13.983380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950c8af-b8d6-4be3-bf6b-97cedbe1c532 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:13.985367 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b871c-54d9-44aa-94da-7cb6f24f5c85 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:14.097145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d339aa-5d2a-4ba7-ba7b-0847b54c82fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:14.097858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d339aa-5d2a-4ba7-ba7b-0847b54c82fb admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:14.098148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d339aa-5d2a-4ba7-ba7b-0847b54c82fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:14.098997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d339aa-5d2a-4ba7-ba7b-0847b54c82fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:14.100004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d339aa-5d2a-4ba7-ba7b-0847b54c82fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:14.103195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d339aa-5d2a-4ba7-ba7b-0847b54c82fb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:14.104888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950c8af-b8d6-4be3-bf6b-97cedbe1c532 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:14.112864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd59b4-bb18-4dfb-9e4f-4761450cfc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:14.113684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd59b4-bb18-4dfb-9e4f-4761450cfc5c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:14.114124 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd59b4-bb18-4dfb-9e4f-4761450cfc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:14.114637 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd59b4-bb18-4dfb-9e4f-4761450cfc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:14.115895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd59b4-bb18-4dfb-9e4f-4761450cfc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:14.119076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd59b4-bb18-4dfb-9e4f-4761450cfc5c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:14.137731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:14.152947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 920/1818] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:14.156179 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd59b4-bb18-4dfb-9e4f-4761450cfc5c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:14.158144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 899/1819] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:13 2022] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:14.163142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d339aa-5d2a-4ba7-ba7b-0847b54c82fb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:14.174576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd59b4-bb18-4dfb-9e4f-4761450cfc5c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:14.279156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d339aa-5d2a-4ba7-ba7b-0847b54c82fb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:14.280307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:14.291947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e9353-9307-49ad-bcc4-5f9ac7e1ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:14.292801 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e9353-9307-49ad-bcc4-5f9ac7e1ddae admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:14.293086 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e9353-9307-49ad-bcc4-5f9ac7e1ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:14.293401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e9353-9307-49ad-bcc4-5f9ac7e1ddae admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:14.294366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e9353-9307-49ad-bcc4-5f9ac7e1ddae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:14.297567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e9353-9307-49ad-bcc4-5f9ac7e1ddae admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:14.325729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85058bd8-4346-449d-882b-aafb33021519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:14.328407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85058bd8-4346-449d-882b-aafb33021519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:14.328407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85058bd8-4346-449d-882b-aafb33021519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:14.328852 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85058bd8-4346-449d-882b-aafb33021519 admin admin] PATH_INFO: `/v3/projects/3244931769514e54af15d37cb11d4eb1/users/ff43f2aba1b54e3b938e7d2c371818ad/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:14.335626 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85058bd8-4346-449d-882b-aafb33021519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3244931769514e54af15d37cb11d4eb1, user_id=ff43f2aba1b54e3b938e7d2c371818ad, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:14.335826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 900/1820] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:14 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:14.337350 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85058bd8-4346-449d-882b-aafb33021519 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:14.339382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e9353-9307-49ad-bcc4-5f9ac7e1ddae admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:14.353023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e9353-9307-49ad-bcc4-5f9ac7e1ddae admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:14.369185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 921/1821] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:14 2022] PUT /identity/v3/projects/3244931769514e54af15d37cb11d4eb1/users/ff43f2aba1b54e3b938e7d2c371818ad/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:14.373644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68093f13-c035-4016-b9fa-75a030444f76 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:14.373848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68093f13-c035-4016-b9fa-75a030444f76 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:14.374046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68093f13-c035-4016-b9fa-75a030444f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:14.414227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-68093f13-c035-4016-b9fa-75a030444f76 None None] MFA Rules not processed for user `ff43f2aba1b54e3b938e7d2c371818ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:14.415375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-68093f13-c035-4016-b9fa-75a030444f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:14.439431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ced30-d593-4654-9329-caba214f58de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:14.440069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ced30-d593-4654-9329-caba214f58de admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:14.440393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ced30-d593-4654-9329-caba214f58de admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:14.440676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ced30-d593-4654-9329-caba214f58de admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:14.441393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ced30-d593-4654-9329-caba214f58de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:14.443659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ced30-d593-4654-9329-caba214f58de admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:14.460176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 901/1822] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:14.462161 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ced30-d593-4654-9329-caba214f58de admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:14.484750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ced30-d593-4654-9329-caba214f58de admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:14.498725 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f59d7-03f6-465c-9bec-53ad0fbfc337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:14.499540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f59d7-03f6-465c-9bec-53ad0fbfc337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:14.501341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f59d7-03f6-465c-9bec-53ad0fbfc337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:14.501729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f59d7-03f6-465c-9bec-53ad0fbfc337 admin admin] PATH_INFO: `/v3/projects/c900c138688e4a15b3715e5487b3a639/users/a386e697f2584f92982262336ebfb0e7/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:14.528255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f59d7-03f6-465c-9bec-53ad0fbfc337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c900c138688e4a15b3715e5487b3a639, user_id=a386e697f2584f92982262336ebfb0e7, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:14.533176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f59d7-03f6-465c-9bec-53ad0fbfc337 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:14.559966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 922/1823] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:14.591413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68093f13-c035-4016-b9fa-75a030444f76 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:14.621676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 902/1824] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:14 2022] PUT /identity/v3/projects/c900c138688e4a15b3715e5487b3a639/users/a386e697f2584f92982262336ebfb0e7/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:14.627400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f59d7-03f6-465c-9bec-53ad0fbfc337 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:14.712661 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f59d7-03f6-465c-9bec-53ad0fbfc337 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:14.718694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8ddb4-ea99-4493-b38c-277b2aeab19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:14.719703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8ddb4-ea99-4493-b38c-277b2aeab19a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:14.720158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8ddb4-ea99-4493-b38c-277b2aeab19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:14.720601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8ddb4-ea99-4493-b38c-277b2aeab19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:14.721414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8ddb4-ea99-4493-b38c-277b2aeab19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:14.723771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8ddb4-ea99-4493-b38c-277b2aeab19a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:14.726642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:14.736114 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68093f13-c035-4016-b9fa-75a030444f76 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:14.740969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 903/1825] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:14.741893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8ddb4-ea99-4493-b38c-277b2aeab19a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:14.754089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8ddb4-ea99-4493-b38c-277b2aeab19a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:14.760853 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a9b14-d3ce-46f0-a017-185c853dc855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:14.761537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9b14-d3ce-46f0-a017-185c853dc855 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:14.761820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9b14-d3ce-46f0-a017-185c853dc855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:14.762101 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9b14-d3ce-46f0-a017-185c853dc855 admin admin] PATH_INFO: `/v3/projects/c900c138688e4a15b3715e5487b3a639/users/a386e697f2584f92982262336ebfb0e7/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:14.764161 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a9b14-d3ce-46f0-a017-185c853dc855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c900c138688e4a15b3715e5487b3a639, user_id=a386e697f2584f92982262336ebfb0e7, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:14.768438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a9b14-d3ce-46f0-a017-185c853dc855 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:14.782849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 904/1826] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:14 2022] PUT /identity/v3/projects/c900c138688e4a15b3715e5487b3a639/users/a386e697f2584f92982262336ebfb0e7/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:14.793653 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971650eb-0122-47ad-9ff0-fe94c7b902c1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:14.793948 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971650eb-0122-47ad-9ff0-fe94c7b902c1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:14.794190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971650eb-0122-47ad-9ff0-fe94c7b902c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:14.840670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-971650eb-0122-47ad-9ff0-fe94c7b902c1 None None] MFA Rules not processed for user `a386e697f2584f92982262336ebfb0e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:14.841998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-971650eb-0122-47ad-9ff0-fe94c7b902c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:14.842174 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583ca85-e051-409c-b386-324d054634fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:14.843086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583ca85-e051-409c-b386-324d054634fe service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:14.843903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583ca85-e051-409c-b386-324d054634fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:14.844212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583ca85-e051-409c-b386-324d054634fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:14.892447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:14.934183 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583ca85-e051-409c-b386-324d054634fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:14.936159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583ca85-e051-409c-b386-324d054634fe service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:14.948223 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 923/1827] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:14 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:14.963599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 905/1828] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:14.981587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583ca85-e051-409c-b386-324d054634fe service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:14.997328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583ca85-e051-409c-b386-324d054634fe service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:15.069656 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3402c-5ebc-45d0-a6fe-60ffa815b3ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:15.071117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3402c-5ebc-45d0-a6fe-60ffa815b3ca service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:15.071117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3402c-5ebc-45d0-a6fe-60ffa815b3ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:15.071742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3402c-5ebc-45d0-a6fe-60ffa815b3ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:15.089251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3402c-5ebc-45d0-a6fe-60ffa815b3ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:15.091158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3402c-5ebc-45d0-a6fe-60ffa815b3ca service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:15.106694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 924/1829] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:15.119708 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704f666-6c23-444c-99ce-2e363f36816e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:15.120295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704f666-6c23-444c-99ce-2e363f36816e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:15.120665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704f666-6c23-444c-99ce-2e363f36816e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:15.170854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1704f666-6c23-444c-99ce-2e363f36816e None None] MFA Rules not processed for user `11d7b95a5eff4dc79d0f213c6160b225`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:15.172718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1704f666-6c23-444c-99ce-2e363f36816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:15.278011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 906/1830] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:15.279465 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3402c-5ebc-45d0-a6fe-60ffa815b3ca service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:15.440977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3402c-5ebc-45d0-a6fe-60ffa815b3ca service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:15.458498 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e842a-8e84-43ec-826c-bf472b10a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:15.460310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e842a-8e84-43ec-826c-bf472b10a0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:15.461871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e842a-8e84-43ec-826c-bf472b10a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:15.462162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e842a-8e84-43ec-826c-bf472b10a0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:15.464622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e842a-8e84-43ec-826c-bf472b10a0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:15.471151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e842a-8e84-43ec-826c-bf472b10a0f1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:15.540362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 925/1831] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:15 2022] POST /identity/v3/projects => generated 403 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:15.541964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704f666-6c23-444c-99ce-2e363f36816e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:15.560506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704f666-6c23-444c-99ce-2e363f36816e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:15.604643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e842a-8e84-43ec-826c-bf472b10a0f1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:15.754111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98a2c0-7423-46c0-9dfe-18fc8ddbc0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:15.756828 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98a2c0-7423-46c0-9dfe-18fc8ddbc0ad admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:15.758256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98a2c0-7423-46c0-9dfe-18fc8ddbc0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:15.758546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98a2c0-7423-46c0-9dfe-18fc8ddbc0ad admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:15.759224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98a2c0-7423-46c0-9dfe-18fc8ddbc0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:15.766624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:15.767500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98a2c0-7423-46c0-9dfe-18fc8ddbc0ad admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:15.773820 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e842a-8e84-43ec-826c-bf472b10a0f1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:15.793491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb9268-fe4a-4c83-a792-5b1895a2957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:15.794416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9268-fe4a-4c83-a792-5b1895a2957e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:15.795033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9268-fe4a-4c83-a792-5b1895a2957e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:15.795415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9268-fe4a-4c83-a792-5b1895a2957e admin admin] PATH_INFO: `/v3/users/c06133c0dc634d65aa6c05d8d056430d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:15.797608 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb9268-fe4a-4c83-a792-5b1895a2957e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06133c0dc634d65aa6c05d8d056430d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:15.799700 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb9268-fe4a-4c83-a792-5b1895a2957e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:15.801738 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:15.832951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 907/1832] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:15 2022] POST /identity/v3/users => generated 308 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:15.834848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98a2c0-7423-46c0-9dfe-18fc8ddbc0ad admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:15.849885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98a2c0-7423-46c0-9dfe-18fc8ddbc0ad admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:15.855628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2428256-8d8d-4093-9759-59b54f8ca19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:15.856292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2428256-8d8d-4093-9759-59b54f8ca19f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:15.856607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2428256-8d8d-4093-9759-59b54f8ca19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:15.857023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2428256-8d8d-4093-9759-59b54f8ca19f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:15.857901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2428256-8d8d-4093-9759-59b54f8ca19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:15.860651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2428256-8d8d-4093-9759-59b54f8ca19f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:15.875220 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 908/1833] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:15.886088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2428256-8d8d-4093-9759-59b54f8ca19f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:15.911519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2428256-8d8d-4093-9759-59b54f8ca19f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:15.929356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844f7ca-ca48-4a79-bb6a-faf8e45ddb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:15.930354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f7ca-ca48-4a79-bb6a-faf8e45ddb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:15.930715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f7ca-ca48-4a79-bb6a-faf8e45ddb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:15.931063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f7ca-ca48-4a79-bb6a-faf8e45ddb94 admin admin] PATH_INFO: `/v3/projects/0237f17667c84a32852d79b07fb1a2e9/users/df455003c1bd44819765b039e93e3091/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:15.944628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-10eb9268-fe4a-4c83-a792-5b1895a2957e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06133c0dc634d65aa6c05d8d056430d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:15.948051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-10eb9268-fe4a-4c83-a792-5b1895a2957e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06133c0dc634d65aa6c05d8d056430d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:15.953758 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844f7ca-ca48-4a79-bb6a-faf8e45ddb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0237f17667c84a32852d79b07fb1a2e9, user_id=df455003c1bd44819765b039e93e3091, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:15.957181 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844f7ca-ca48-4a79-bb6a-faf8e45ddb94 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:15.960776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-10eb9268-fe4a-4c83-a792-5b1895a2957e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06133c0dc634d65aa6c05d8d056430d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:15.989065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 909/1834] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:15 2022] PUT /identity/v3/projects/0237f17667c84a32852d79b07fb1a2e9/users/df455003c1bd44819765b039e93e3091/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:15.992997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844f7ca-ca48-4a79-bb6a-faf8e45ddb94 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:16.017068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-10eb9268-fe4a-4c83-a792-5b1895a2957e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06133c0dc634d65aa6c05d8d056430d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:16.039325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-10eb9268-fe4a-4c83-a792-5b1895a2957e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06133c0dc634d65aa6c05d8d056430d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:16.061191 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 926/1835] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:15 2022] DELETE /identity/v3/users/c06133c0dc634d65aa6c05d8d056430d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:16.065040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3dbe6-0572-4fa5-8542-8825f45f3162 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:16.065333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3dbe6-0572-4fa5-8542-8825f45f3162 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:16.065611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3dbe6-0572-4fa5-8542-8825f45f3162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:16.098446 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844f7ca-ca48-4a79-bb6a-faf8e45ddb94 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:16.108941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e2c3dbe6-0572-4fa5-8542-8825f45f3162 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:16.112321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e2c3dbe6-0572-4fa5-8542-8825f45f3162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:16.240759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 927/1836] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:16.242744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3dbe6-0572-4fa5-8542-8825f45f3162 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:16.244226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e2c3dbe6-0572-4fa5-8542-8825f45f3162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:16.279373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9c583-27b5-40c7-964c-fa6090950ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:16.280132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9c583-27b5-40c7-964c-fa6090950ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:16.280651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9c583-27b5-40c7-964c-fa6090950ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:16.281630 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9c583-27b5-40c7-964c-fa6090950ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:16.282805 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9c583-27b5-40c7-964c-fa6090950ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:16.284861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9c583-27b5-40c7-964c-fa6090950ef3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:16.300163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 910/1837] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:16.300163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9c583-27b5-40c7-964c-fa6090950ef3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:16.302001 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-29d9c583-27b5-40c7-964c-fa6090950ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:16.353693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3dbe6-0572-4fa5-8542-8825f45f3162 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:16.358395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677e983-0092-4f5c-a588-b6ddc85068bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:16.359884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677e983-0092-4f5c-a588-b6ddc85068bc service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:16.360246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677e983-0092-4f5c-a588-b6ddc85068bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:16.360604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677e983-0092-4f5c-a588-b6ddc85068bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:16.372539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677e983-0092-4f5c-a588-b6ddc85068bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:16.374272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677e983-0092-4f5c-a588-b6ddc85068bc service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:16.387113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9c583-27b5-40c7-964c-fa6090950ef3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:16.387695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 928/1838] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:16.389119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677e983-0092-4f5c-a588-b6ddc85068bc service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:16.390732 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d677e983-0092-4f5c-a588-b6ddc85068bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:16.392263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a392ae-889b-491c-8304-51bf828f5462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:16.392903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a392ae-889b-491c-8304-51bf828f5462 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:16.393213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a392ae-889b-491c-8304-51bf828f5462 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:16.393496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a392ae-889b-491c-8304-51bf828f5462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:16.398997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-26a392ae-889b-491c-8304-51bf828f5462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:16.408731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677e983-0092-4f5c-a588-b6ddc85068bc service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:16.409638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:16.421023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda53a4-b933-4528-9039-e7a99eab0745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:16.425084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda53a4-b933-4528-9039-e7a99eab0745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:16.425870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda53a4-b933-4528-9039-e7a99eab0745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:16.428000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda53a4-b933-4528-9039-e7a99eab0745 admin admin] PATH_INFO: `/v3/projects/0237f17667c84a32852d79b07fb1a2e9/users/df455003c1bd44819765b039e93e3091/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:16.436193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda53a4-b933-4528-9039-e7a99eab0745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0237f17667c84a32852d79b07fb1a2e9, user_id=df455003c1bd44819765b039e93e3091, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:16.441412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda53a4-b933-4528-9039-e7a99eab0745 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:16.465706 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 929/1839] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:16 2022] PUT /identity/v3/projects/0237f17667c84a32852d79b07fb1a2e9/users/df455003c1bd44819765b039e93e3091/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:16.500829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a392ae-889b-491c-8304-51bf828f5462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:16.503358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a392ae-889b-491c-8304-51bf828f5462 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:16.519598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 911/1840] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:17.244827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda53a4-b933-4528-9039-e7a99eab0745 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:17.248311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ebda53a4-b933-4528-9039-e7a99eab0745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:17.268307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:17.358368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda53a4-b933-4528-9039-e7a99eab0745 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:17.364435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:17.365266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:17.366237 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:17.366237 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] PATH_INFO: `/v3/projects/03242d87d4634963b686b6df0d98f243` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:17.367435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03242d87d4634963b686b6df0d98f243)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:17.370108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:17.447788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03242d87d4634963b686b6df0d98f243', 'request_id': 'req-fb5150fe-ef75-45fe-ac99-987ca5800e68'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:17.453917 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03242d87d4634963b686b6df0d98f243', 'request_id': 'req-fb5150fe-ef75-45fe-ac99-987ca5800e68'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:17.463279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03242d87d4634963b686b6df0d98f243', 'request_id': 'req-fb5150fe-ef75-45fe-ac99-987ca5800e68'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:17.480775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] The token cache is being invalidate because project 03242d87d4634963b686b6df0d98f243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:17.481108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:17.481786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:17.486582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 930/1841] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:17 2022] DELETE /identity/v3/projects/03242d87d4634963b686b6df0d98f243 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:17.487823 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a392ae-889b-491c-8304-51bf828f5462 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:17.501801 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a392ae-889b-491c-8304-51bf828f5462 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:17.593094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0092e80-6c75-4d7a-8a2c-40d73aa8184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:17.593900 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0092e80-6c75-4d7a-8a2c-40d73aa8184a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:17.594254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0092e80-6c75-4d7a-8a2c-40d73aa8184a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:17.594604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0092e80-6c75-4d7a-8a2c-40d73aa8184a admin admin] PATH_INFO: `/v3/users/ff43f2aba1b54e3b938e7d2c371818ad` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:17.595894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0092e80-6c75-4d7a-8a2c-40d73aa8184a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff43f2aba1b54e3b938e7d2c371818ad)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:17.598219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0092e80-6c75-4d7a-8a2c-40d73aa8184a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:17.660214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c0092e80-6c75-4d7a-8a2c-40d73aa8184a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff43f2aba1b54e3b938e7d2c371818ad'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:17.661529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c0092e80-6c75-4d7a-8a2c-40d73aa8184a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff43f2aba1b54e3b938e7d2c371818ad'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:17.677495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c0092e80-6c75-4d7a-8a2c-40d73aa8184a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff43f2aba1b54e3b938e7d2c371818ad'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:17.689252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c0092e80-6c75-4d7a-8a2c-40d73aa8184a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff43f2aba1b54e3b938e7d2c371818ad'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:17.700904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c0092e80-6c75-4d7a-8a2c-40d73aa8184a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff43f2aba1b54e3b938e7d2c371818ad'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:17.712397 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 912/1842] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:17 2022] DELETE /identity/v3/users/ff43f2aba1b54e3b938e7d2c371818ad => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:17.886515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:17.889054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:17.910795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5150fe-ef75-45fe-ac99-987ca5800e68 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:18.002137 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:18.002985 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:18.003366 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:18.003888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] PATH_INFO: `/v3/users/46290ece463c41cb82c644cc251efba8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:18.005408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46290ece463c41cb82c644cc251efba8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:18.007703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:18.120657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:18.128712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46290ece463c41cb82c644cc251efba8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:18.130465 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46290ece463c41cb82c644cc251efba8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:18.176452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46290ece463c41cb82c644cc251efba8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:18.199655 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46290ece463c41cb82c644cc251efba8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:18.218164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46290ece463c41cb82c644cc251efba8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:18.241873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 931/1843] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:17 2022] DELETE /identity/v3/users/46290ece463c41cb82c644cc251efba8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:18.246042 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1253058-317a-4089-97d2-34ff691e07e0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:18.246343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1253058-317a-4089-97d2-34ff691e07e0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:18.246722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1253058-317a-4089-97d2-34ff691e07e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:18.286432 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b1253058-317a-4089-97d2-34ff691e07e0 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:18.287733 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b1253058-317a-4089-97d2-34ff691e07e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:18.338356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:18.424937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 913/1844] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:18.443115 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:18.444596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:18.492884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271265b-2c1b-4fe8-adcd-60fea4bf7817 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:18.493551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271265b-2c1b-4fe8-adcd-60fea4bf7817 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:18.496081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271265b-2c1b-4fe8-adcd-60fea4bf7817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:18.549362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8946378-2e25-4d3e-a579-3c52298b42e2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:18.556733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3b00c-a9a3-462f-b0cc-a0f4a9fff9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:18.557679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3b00c-a9a3-462f-b0cc-a0f4a9fff9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:18.558477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3b00c-a9a3-462f-b0cc-a0f4a9fff9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:18.558766 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3b00c-a9a3-462f-b0cc-a0f4a9fff9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:18.571011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9271265b-2c1b-4fe8-adcd-60fea4bf7817 None None] MFA Rules not processed for user `df455003c1bd44819765b039e93e3091`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:18.574983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3b00c-a9a3-462f-b0cc-a0f4a9fff9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:18.575769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9271265b-2c1b-4fe8-adcd-60fea4bf7817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:18.576698 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3b00c-a9a3-462f-b0cc-a0f4a9fff9a8 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:18.595747 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 932/1845] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:18.723431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 914/1846] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:18 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:18.864581 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3b00c-a9a3-462f-b0cc-a0f4a9fff9a8 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:18.874077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-47f3b00c-a9a3-462f-b0cc-a0f4a9fff9a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:18.896833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3b00c-a9a3-462f-b0cc-a0f4a9fff9a8 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:18.925578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:18.926091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:18.926708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:18.927213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa admin admin] PATH_INFO: `/v3/projects/3244931769514e54af15d37cb11d4eb1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:18.928724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3244931769514e54af15d37cb11d4eb1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:18.930904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:18.982315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3244931769514e54af15d37cb11d4eb1', 'request_id': 'req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:18.989588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3244931769514e54af15d37cb11d4eb1', 'request_id': 'req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:18.998093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3244931769514e54af15d37cb11d4eb1', 'request_id': 'req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.011131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa admin admin] The token cache is being invalidate because project 3244931769514e54af15d37cb11d4eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:19.011620 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.012864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bf32a66c-4f13-4b6a-b042-6a5cb79bc3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.014464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 933/1847] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:18 2022] DELETE /identity/v3/projects/3244931769514e54af15d37cb11d4eb1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:19.019516 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a6306-a8a7-43f0-a7f8-5a8711a361b3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.019881 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a6306-a8a7-43f0-a7f8-5a8711a361b3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.020269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a6306-a8a7-43f0-a7f8-5a8711a361b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.040690 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-304a6306-a8a7-43f0-a7f8-5a8711a361b3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:19.041957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-304a6306-a8a7-43f0-a7f8-5a8711a361b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:19.105476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 915/1848] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:19.114057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6eb41-e076-4b5d-a3fd-ace38ed16fbe None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.114504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6eb41-e076-4b5d-a3fd-ace38ed16fbe None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.114883 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6eb41-e076-4b5d-a3fd-ace38ed16fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.141503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c2e6eb41-e076-4b5d-a3fd-ace38ed16fbe None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:19.142908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c2e6eb41-e076-4b5d-a3fd-ace38ed16fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:19.162479 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 934/1849] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:19.167045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a6306-a8a7-43f0-a7f8-5a8711a361b3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:19.189892 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a6306-a8a7-43f0-a7f8-5a8711a361b3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:19.194459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6eb41-e076-4b5d-a3fd-ace38ed16fbe None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:19.196292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c2e6eb41-e076-4b5d-a3fd-ace38ed16fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:19.198017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb63c5-3511-43b5-8ccd-8faeb6fae145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:19.198908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb63c5-3511-43b5-8ccd-8faeb6fae145 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.199287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb63c5-3511-43b5-8ccd-8faeb6fae145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.199659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb63c5-3511-43b5-8ccd-8faeb6fae145 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.200609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb63c5-3511-43b5-8ccd-8faeb6fae145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:19.201017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb63c5-3511-43b5-8ccd-8faeb6fae145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:19.203711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb63c5-3511-43b5-8ccd-8faeb6fae145 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:19.217045 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6eb41-e076-4b5d-a3fd-ace38ed16fbe None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:19.223673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 916/1850] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:19.225062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb63c5-3511-43b5-8ccd-8faeb6fae145 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:19.237733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:19.238621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.239082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.239500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] PATH_INFO: `/v3/projects/9e466428d1fd4e12910119d90087525e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.240907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e466428d1fd4e12910119d90087525e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:19.242895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:19.255274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb63c5-3511-43b5-8ccd-8faeb6fae145 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:19.263416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e442cb0-2905-46f8-a831-deea04651039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:19.266038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e442cb0-2905-46f8-a831-deea04651039 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.267332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e442cb0-2905-46f8-a831-deea04651039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.268176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e442cb0-2905-46f8-a831-deea04651039 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.270031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e442cb0-2905-46f8-a831-deea04651039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:19.273321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e442cb0-2905-46f8-a831-deea04651039 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:19.317457 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:19.324321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 917/1851] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:19 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:19.327496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e442cb0-2905-46f8-a831-deea04651039 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:19.338329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e466428d1fd4e12910119d90087525e', 'request_id': 'req-2dbc99be-6aaa-41ca-936d-418839c50e77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.347081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e466428d1fd4e12910119d90087525e', 'request_id': 'req-2dbc99be-6aaa-41ca-936d-418839c50e77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.361851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e466428d1fd4e12910119d90087525e', 'request_id': 'req-2dbc99be-6aaa-41ca-936d-418839c50e77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.368039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:19.383193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] The token cache is being invalidate because project 9e466428d1fd4e12910119d90087525e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:19.383915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.385169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.390804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 935/1852] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:19 2022] DELETE /identity/v3/projects/9e466428d1fd4e12910119d90087525e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:19.392432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:19.394185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:19.429149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e442cb0-2905-46f8-a831-deea04651039 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:19.434681 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3187e32-ee70-4a07-8fc8-376d186267ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:19.435333 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3187e32-ee70-4a07-8fc8-376d186267ec admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.435618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3187e32-ee70-4a07-8fc8-376d186267ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.435899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3187e32-ee70-4a07-8fc8-376d186267ec admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.436846 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3187e32-ee70-4a07-8fc8-376d186267ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:19.439257 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3187e32-ee70-4a07-8fc8-376d186267ec admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:19.473941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 918/1853] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:19 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:19.481227 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3187e32-ee70-4a07-8fc8-376d186267ec admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:19.483293 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d3187e32-ee70-4a07-8fc8-376d186267ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:19.489382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc99be-6aaa-41ca-936d-418839c50e77 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:19.499310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3187e32-ee70-4a07-8fc8-376d186267ec admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:19.505465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414d61d-6838-459b-99a3-9c4330ff80c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:19.506432 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414d61d-6838-459b-99a3-9c4330ff80c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.506921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414d61d-6838-459b-99a3-9c4330ff80c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.507453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414d61d-6838-459b-99a3-9c4330ff80c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.508631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414d61d-6838-459b-99a3-9c4330ff80c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:19.510437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414d61d-6838-459b-99a3-9c4330ff80c1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:19.514795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612c59b-9052-4f7f-93bb-746d6cdefca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:19.515510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c59b-9052-4f7f-93bb-746d6cdefca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.515798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c59b-9052-4f7f-93bb-746d6cdefca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.516079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c59b-9052-4f7f-93bb-746d6cdefca9 admin admin] PATH_INFO: `/v3/users/1d40ee235cbd4bbd804f1fc2a8d5bb7d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.519191 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612c59b-9052-4f7f-93bb-746d6cdefca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d40ee235cbd4bbd804f1fc2a8d5bb7d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:19.521490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612c59b-9052-4f7f-93bb-746d6cdefca9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:19.527480 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 919/1854] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:19.530430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414d61d-6838-459b-99a3-9c4330ff80c1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:19.543224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414d61d-6838-459b-99a3-9c4330ff80c1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:19.552305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1512469-8e16-4d93-a807-4f0bdaa04615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:19.553005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1512469-8e16-4d93-a807-4f0bdaa04615 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.553330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1512469-8e16-4d93-a807-4f0bdaa04615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.553562 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1512469-8e16-4d93-a807-4f0bdaa04615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.554674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1512469-8e16-4d93-a807-4f0bdaa04615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:19.556480 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1512469-8e16-4d93-a807-4f0bdaa04615 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:19.573077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 920/1855] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:19.577627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1512469-8e16-4d93-a807-4f0bdaa04615 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:19.590556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1512469-8e16-4d93-a807-4f0bdaa04615 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:19.600563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088042a-05e9-439c-a923-c00aa7afb589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:19.601575 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088042a-05e9-439c-a923-c00aa7afb589 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.602114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088042a-05e9-439c-a923-c00aa7afb589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.603455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088042a-05e9-439c-a923-c00aa7afb589 admin admin] PATH_INFO: `/v3/projects/95d44928b1f84e64ac7f7428952c4e70/users/3ff2475f29ba408faf1ce5683045218a/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.630394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088042a-05e9-439c-a923-c00aa7afb589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d44928b1f84e64ac7f7428952c4e70, user_id=3ff2475f29ba408faf1ce5683045218a, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:19.635367 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088042a-05e9-439c-a923-c00aa7afb589 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:19.645214 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4612c59b-9052-4f7f-93bb-746d6cdefca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d40ee235cbd4bbd804f1fc2a8d5bb7d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.646397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4612c59b-9052-4f7f-93bb-746d6cdefca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d40ee235cbd4bbd804f1fc2a8d5bb7d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.673785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 921/1856] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:19 2022] PUT /identity/v3/projects/95d44928b1f84e64ac7f7428952c4e70/users/3ff2475f29ba408faf1ce5683045218a/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:19.676584 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310d5fb-8a51-4d65-ab62-ada995d69690 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.677178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310d5fb-8a51-4d65-ab62-ada995d69690 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.677655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310d5fb-8a51-4d65-ab62-ada995d69690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.682689 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4612c59b-9052-4f7f-93bb-746d6cdefca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d40ee235cbd4bbd804f1fc2a8d5bb7d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.708213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4612c59b-9052-4f7f-93bb-746d6cdefca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d40ee235cbd4bbd804f1fc2a8d5bb7d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.738555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4612c59b-9052-4f7f-93bb-746d6cdefca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d40ee235cbd4bbd804f1fc2a8d5bb7d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:19.755441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 936/1857] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:19 2022] DELETE /identity/v3/users/1d40ee235cbd4bbd804f1fc2a8d5bb7d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:19.755441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8811ad2-c1cb-4efe-b252-9cf49d7a45f5 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.755441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8811ad2-c1cb-4efe-b252-9cf49d7a45f5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.755441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8811ad2-c1cb-4efe-b252-9cf49d7a45f5 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.757286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 937/1858] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 08:54:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:54:19.777386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113977b-d90c-4afa-a67e-f456f0c149e4 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.778310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113977b-d90c-4afa-a67e-f456f0c149e4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.779473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113977b-d90c-4afa-a67e-f456f0c149e4 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.785048 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 938/1859] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 08:54:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:54:19.798485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c310d5fb-8a51-4d65-ab62-ada995d69690 None None] MFA Rules not processed for user `3ff2475f29ba408faf1ce5683045218a`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:19.813501 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c310d5fb-8a51-4d65-ab62-ada995d69690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:19.846949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ce7dc-0baa-4de1-aaef-a42329db8904 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.847377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ce7dc-0baa-4de1-aaef-a42329db8904 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.847878 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ce7dc-0baa-4de1-aaef-a42329db8904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:19.883369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a90ce7dc-0baa-4de1-aaef-a42329db8904 None None] MFA Rules not processed for user `cd9f2dc3c1c442b4b1b09964ff7c000b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:19.884830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a90ce7dc-0baa-4de1-aaef-a42329db8904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:19.954079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:19.975409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 922/1860] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:19.976874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e876e5-c579-4970-81de-ca473eab3405 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:19.977164 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e876e5-c579-4970-81de-ca473eab3405 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:19.977444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e876e5-c579-4970-81de-ca473eab3405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:20.001489 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-51e876e5-c579-4970-81de-ca473eab3405 None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:20.006009 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-51e876e5-c579-4970-81de-ca473eab3405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:20.059007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 939/1861] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 08:54:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:20.060221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ce7dc-0baa-4de1-aaef-a42329db8904 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:20.062440 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a90ce7dc-0baa-4de1-aaef-a42329db8904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:20.068286 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:20.106915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 923/1862] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 08:54:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:20.134352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e876e5-c579-4970-81de-ca473eab3405 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:20.137590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-51e876e5-c579-4970-81de-ca473eab3405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:20.183898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e876e5-c579-4970-81de-ca473eab3405 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:20.203815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2418878-1484-46ae-9c6b-e10fe78438be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:20.204514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418878-1484-46ae-9c6b-e10fe78438be service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:20.204789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418878-1484-46ae-9c6b-e10fe78438be service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:20.205071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418878-1484-46ae-9c6b-e10fe78438be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:20.225551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2418878-1484-46ae-9c6b-e10fe78438be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:20.227213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2418878-1484-46ae-9c6b-e10fe78438be service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:20.244666 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ce7dc-0baa-4de1-aaef-a42329db8904 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:20.253402 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 924/1863] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:20.254405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f9206-ea4e-4315-ae6f-f56d82308845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:20.254961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f9206-ea4e-4315-ae6f-f56d82308845 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:20.255339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f9206-ea4e-4315-ae6f-f56d82308845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:20.255674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f9206-ea4e-4315-ae6f-f56d82308845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:20.256465 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f9206-ea4e-4315-ae6f-f56d82308845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:20.258778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f9206-ea4e-4315-ae6f-f56d82308845 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:20.302611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 940/1864] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:20 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:20.303859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2418878-1484-46ae-9c6b-e10fe78438be service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:20.321604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2418878-1484-46ae-9c6b-e10fe78438be service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:20.462620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d058d-f808-4209-bd81-a1623edc96d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:20.463457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d058d-f808-4209-bd81-a1623edc96d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:20.463880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d058d-f808-4209-bd81-a1623edc96d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:20.464052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d058d-f808-4209-bd81-a1623edc96d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:20.467479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d058d-f808-4209-bd81-a1623edc96d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:20.470007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d058d-f808-4209-bd81-a1623edc96d4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:20.487090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f9206-ea4e-4315-ae6f-f56d82308845 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:20.489183 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-150f9206-ea4e-4315-ae6f-f56d82308845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:20.520533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 925/1865] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:20 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:20.524410 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d058d-f808-4209-bd81-a1623edc96d4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:20.538337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d058d-f808-4209-bd81-a1623edc96d4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:20.548110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70bdc-c5ad-4987-b9a4-9a2502c055ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:20.548991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70bdc-c5ad-4987-b9a4-9a2502c055ae admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:20.549421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70bdc-c5ad-4987-b9a4-9a2502c055ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:20.550002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70bdc-c5ad-4987-b9a4-9a2502c055ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:20.551373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70bdc-c5ad-4987-b9a4-9a2502c055ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:20.553360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70bdc-c5ad-4987-b9a4-9a2502c055ae admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:20.568923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 926/1866] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:20.573116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70bdc-c5ad-4987-b9a4-9a2502c055ae admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:20.591487 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70bdc-c5ad-4987-b9a4-9a2502c055ae admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:20.605184 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f9206-ea4e-4315-ae6f-f56d82308845 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:20.607162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc02727-78a4-4f8a-bd41-247e850b87a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:20.607873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc02727-78a4-4f8a-bd41-247e850b87a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:20.608184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc02727-78a4-4f8a-bd41-247e850b87a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:20.608471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc02727-78a4-4f8a-bd41-247e850b87a2 admin admin] PATH_INFO: `/v3/projects/88c75fa1f65d426a95e3872d8092cabb/users/e853b488b0724d1498ccaf9db05061e9/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:20.612942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc36965-82bf-4fe7-9acc-309c2a3fc2df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:20.613865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc36965-82bf-4fe7-9acc-309c2a3fc2df service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:20.614979 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc36965-82bf-4fe7-9acc-309c2a3fc2df service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:20.615493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc36965-82bf-4fe7-9acc-309c2a3fc2df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:20.625591 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc02727-78a4-4f8a-bd41-247e850b87a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c75fa1f65d426a95e3872d8092cabb, user_id=e853b488b0724d1498ccaf9db05061e9, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:20.626866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc36965-82bf-4fe7-9acc-309c2a3fc2df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:20.628353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc02727-78a4-4f8a-bd41-247e850b87a2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:20.629773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc36965-82bf-4fe7-9acc-309c2a3fc2df service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:20.644850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 941/1867] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:20.651158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 927/1868] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:20 2022] PUT /identity/v3/projects/88c75fa1f65d426a95e3872d8092cabb/users/e853b488b0724d1498ccaf9db05061e9/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:20.653153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc36965-82bf-4fe7-9acc-309c2a3fc2df service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:20.677634 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc36965-82bf-4fe7-9acc-309c2a3fc2df service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:20.728039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:20.748027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bdbeb-db5c-4ef0-afe4-11ffb87841f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:20.748552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bdbeb-db5c-4ef0-afe4-11ffb87841f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:20.748996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bdbeb-db5c-4ef0-afe4-11ffb87841f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:20.749285 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bdbeb-db5c-4ef0-afe4-11ffb87841f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:20.750027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bdbeb-db5c-4ef0-afe4-11ffb87841f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:20.751879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bdbeb-db5c-4ef0-afe4-11ffb87841f7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:20.763241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 942/1869] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:20.767826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc02727-78a4-4f8a-bd41-247e850b87a2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:20.778295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc02727-78a4-4f8a-bd41-247e850b87a2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:20.784046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a203928-1d05-4eb3-8c4a-59b32395cf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:20.784933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a203928-1d05-4eb3-8c4a-59b32395cf57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:20.784933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a203928-1d05-4eb3-8c4a-59b32395cf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:20.785227 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a203928-1d05-4eb3-8c4a-59b32395cf57 admin admin] PATH_INFO: `/v3/projects/88c75fa1f65d426a95e3872d8092cabb/users/e853b488b0724d1498ccaf9db05061e9/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:20.787234 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a203928-1d05-4eb3-8c4a-59b32395cf57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c75fa1f65d426a95e3872d8092cabb, user_id=e853b488b0724d1498ccaf9db05061e9, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:20.789929 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a203928-1d05-4eb3-8c4a-59b32395cf57 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:20.808799 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 928/1870] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:20 2022] PUT /identity/v3/projects/88c75fa1f65d426a95e3872d8092cabb/users/e853b488b0724d1498ccaf9db05061e9/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:20.821685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0b999-39d9-4ab9-916a-06b38012ee8b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:20.821882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0b999-39d9-4ab9-916a-06b38012ee8b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:20.822428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0b999-39d9-4ab9-916a-06b38012ee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:20.861637 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cdb0b999-39d9-4ab9-916a-06b38012ee8b None None] MFA Rules not processed for user `e853b488b0724d1498ccaf9db05061e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:20.864579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cdb0b999-39d9-4ab9-916a-06b38012ee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:20.970324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 943/1871] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:20.984955 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a203928-1d05-4eb3-8c4a-59b32395cf57 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:20.986845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3a203928-1d05-4eb3-8c4a-59b32395cf57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:21.023779 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0b999-39d9-4ab9-916a-06b38012ee8b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:21.026450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cdb0b999-39d9-4ab9-916a-06b38012ee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:21.085751 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a203928-1d05-4eb3-8c4a-59b32395cf57 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:21.092102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e5da2-d6b4-486a-a1c3-0a31ab5c5964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:21.093694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e5da2-d6b4-486a-a1c3-0a31ab5c5964 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:21.094509 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e5da2-d6b4-486a-a1c3-0a31ab5c5964 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:21.095199 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e5da2-d6b4-486a-a1c3-0a31ab5c5964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:21.151964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0b999-39d9-4ab9-916a-06b38012ee8b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:21.157938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:21.158698 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:21.159122 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:21.159315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d admin admin] PATH_INFO: `/v3/projects/fa19419317c74aa4aac0d55d992cf7af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:21.160893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa19419317c74aa4aac0d55d992cf7af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:21.161714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e5da2-d6b4-486a-a1c3-0a31ab5c5964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:21.163300 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:21.166087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e5da2-d6b4-486a-a1c3-0a31ab5c5964 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:21.189480 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 929/1872] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:21.191038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e5da2-d6b4-486a-a1c3-0a31ab5c5964 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:21.193430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7c0e5da2-d6b4-486a-a1c3-0a31ab5c5964 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:21.222523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e5da2-d6b4-486a-a1c3-0a31ab5c5964 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:21.232997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:21.236786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:21.237523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:21.238085 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] PATH_INFO: `/v3/users/11d7b95a5eff4dc79d0f213c6160b225` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:21.240574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d7b95a5eff4dc79d0f213c6160b225)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:21.257207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:21.275763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa19419317c74aa4aac0d55d992cf7af', 'request_id': 'req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:21.288196 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:21.300381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa19419317c74aa4aac0d55d992cf7af', 'request_id': 'req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:21.322449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa19419317c74aa4aac0d55d992cf7af', 'request_id': 'req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:21.326795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:21.345724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d admin admin] The token cache is being invalidate because project fa19419317c74aa4aac0d55d992cf7af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:21.348758 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:21.349709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a35cffdc-02ca-4d6b-8bcc-a541150a1d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:21.353069 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 944/1873] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:21 2022] DELETE /identity/v3/projects/fa19419317c74aa4aac0d55d992cf7af => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:21.358543 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e8717-2c00-418a-9e26-b16dc0201437 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:21.358721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e8717-2c00-418a-9e26-b16dc0201437 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:21.360020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e8717-2c00-418a-9e26-b16dc0201437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:21.380706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d7b95a5eff4dc79d0f213c6160b225'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:21.392884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d7b95a5eff4dc79d0f213c6160b225'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:21.403057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-124e8717-2c00-418a-9e26-b16dc0201437 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:21.405843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-124e8717-2c00-418a-9e26-b16dc0201437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:21.410423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d7b95a5eff4dc79d0f213c6160b225'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:21.434077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d7b95a5eff4dc79d0f213c6160b225'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:21.463412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d7b95a5eff4dc79d0f213c6160b225'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:21.481933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 930/1874] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:21 2022] DELETE /identity/v3/users/11d7b95a5eff4dc79d0f213c6160b225 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:21.522424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:21.524223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:21.536023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 945/1875] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:21.537792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91f021-e812-4308-ba2f-279b1f7774e1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:21.538094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91f021-e812-4308-ba2f-279b1f7774e1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:21.539401 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91f021-e812-4308-ba2f-279b1f7774e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:21.561663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5f91f021-e812-4308-ba2f-279b1f7774e1 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:21.563583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5f91f021-e812-4308-ba2f-279b1f7774e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:21.603076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed85a7-3024-4b4d-bb2c-e03a5206ca70 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:21.607059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f235a1-67e8-4015-bb8c-b3639ee2b678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:21.608301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f235a1-67e8-4015-bb8c-b3639ee2b678 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:21.608690 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f235a1-67e8-4015-bb8c-b3639ee2b678 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:21.609073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f235a1-67e8-4015-bb8c-b3639ee2b678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:21.627404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c0f235a1-67e8-4015-bb8c-b3639ee2b678 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:21.632821 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 946/1876] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:21.638200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91f021-e812-4308-ba2f-279b1f7774e1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:21.649503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91f021-e812-4308-ba2f-279b1f7774e1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:21.662704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd31253-9276-4eda-8e99-dcdac2db4115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:21.663520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd31253-9276-4eda-8e99-dcdac2db4115 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:21.663864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd31253-9276-4eda-8e99-dcdac2db4115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:21.664167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd31253-9276-4eda-8e99-dcdac2db4115 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:21.664889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd31253-9276-4eda-8e99-dcdac2db4115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:21.665203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd31253-9276-4eda-8e99-dcdac2db4115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:21.666846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd31253-9276-4eda-8e99-dcdac2db4115 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:21.708752 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 947/1877] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:21.710441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd31253-9276-4eda-8e99-dcdac2db4115 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:21.731695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f235a1-67e8-4015-bb8c-b3639ee2b678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:21.735374 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd31253-9276-4eda-8e99-dcdac2db4115 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:21.738884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f235a1-67e8-4015-bb8c-b3639ee2b678 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:21.741132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619992e1-4a09-432f-94c7-80502eadb0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:21.741770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619992e1-4a09-432f-94c7-80502eadb0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:21.742116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619992e1-4a09-432f-94c7-80502eadb0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:21.742545 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619992e1-4a09-432f-94c7-80502eadb0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:21.743238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619992e1-4a09-432f-94c7-80502eadb0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:21.745269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619992e1-4a09-432f-94c7-80502eadb0e4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:21.771442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 931/1878] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:21.804151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 948/1879] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:21 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:21.815799 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f235a1-67e8-4015-bb8c-b3639ee2b678 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:21.834152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f235a1-67e8-4015-bb8c-b3639ee2b678 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:21.922703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619992e1-4a09-432f-94c7-80502eadb0e4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:21.924112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:21.926090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-619992e1-4a09-432f-94c7-80502eadb0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:21.954442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266497dc-9aff-4642-b93a-d980136e77d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:21.955230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266497dc-9aff-4642-b93a-d980136e77d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:21.955610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266497dc-9aff-4642-b93a-d980136e77d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:21.956304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266497dc-9aff-4642-b93a-d980136e77d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:21.957235 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266497dc-9aff-4642-b93a-d980136e77d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:21.960369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266497dc-9aff-4642-b93a-d980136e77d7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:22.004285 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 932/1880] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:21 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:22.008476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266497dc-9aff-4642-b93a-d980136e77d7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:22.022511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266497dc-9aff-4642-b93a-d980136e77d7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:22.037935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bf520-ca9b-4649-9155-5a4e7c6b50f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:22.039219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bf520-ca9b-4649-9155-5a4e7c6b50f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:22.039606 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619992e1-4a09-432f-94c7-80502eadb0e4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:22.039941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bf520-ca9b-4649-9155-5a4e7c6b50f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:22.040442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bf520-ca9b-4649-9155-5a4e7c6b50f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:22.041486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bf520-ca9b-4649-9155-5a4e7c6b50f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:22.043817 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bf520-ca9b-4649-9155-5a4e7c6b50f6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:22.045828 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:22.046542 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:22.046824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:22.047100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] PATH_INFO: `/v3/projects/f60ce70d32a94443a0bfb33050be3e8e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:22.048427 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60ce70d32a94443a0bfb33050be3e8e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:22.050702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:22.053755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:22.061466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 933/1881] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:22.066275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bf520-ca9b-4649-9155-5a4e7c6b50f6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:22.086334 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bf520-ca9b-4649-9155-5a4e7c6b50f6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:22.096285 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf898e8d-b3db-48d1-8a4d-7a0c657b3b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:22.097436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf898e8d-b3db-48d1-8a4d-7a0c657b3b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:22.097977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf898e8d-b3db-48d1-8a4d-7a0c657b3b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:22.099132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf898e8d-b3db-48d1-8a4d-7a0c657b3b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:22.100304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf898e8d-b3db-48d1-8a4d-7a0c657b3b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:22.102263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf898e8d-b3db-48d1-8a4d-7a0c657b3b54 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:22.116866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 934/1882] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:22.117061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60ce70d32a94443a0bfb33050be3e8e', 'request_id': 'req-15321155-5bcd-4991-ae03-56a70082af28'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.120827 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf898e8d-b3db-48d1-8a4d-7a0c657b3b54 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:22.124270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60ce70d32a94443a0bfb33050be3e8e', 'request_id': 'req-15321155-5bcd-4991-ae03-56a70082af28'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.140870 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf898e8d-b3db-48d1-8a4d-7a0c657b3b54 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:22.149998 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60ce70d32a94443a0bfb33050be3e8e', 'request_id': 'req-15321155-5bcd-4991-ae03-56a70082af28'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.176634 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] The token cache is being invalidate because project f60ce70d32a94443a0bfb33050be3e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:22.176937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.180538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.189936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 949/1883] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:21 2022] DELETE /identity/v3/projects/f60ce70d32a94443a0bfb33050be3e8e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:22.194822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:22.196541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:22.253141 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9385af5-c4f3-46b9-8fad-8fa9417c1331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:22.253862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385af5-c4f3-46b9-8fad-8fa9417c1331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:22.255022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385af5-c4f3-46b9-8fad-8fa9417c1331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:22.255337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385af5-c4f3-46b9-8fad-8fa9417c1331 admin admin] PATH_INFO: `/v3/projects/999aee331d47409fb71221912860ff07/users/1acb9957bcb5428f820c4b1012119d15/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:22.284478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9385af5-c4f3-46b9-8fad-8fa9417c1331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=999aee331d47409fb71221912860ff07, user_id=1acb9957bcb5428f820c4b1012119d15, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:22.287985 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9385af5-c4f3-46b9-8fad-8fa9417c1331 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:22.319081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 935/1884] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:22 2022] PUT /identity/v3/projects/999aee331d47409fb71221912860ff07/users/1acb9957bcb5428f820c4b1012119d15/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:22.324402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15321155-5bcd-4991-ae03-56a70082af28 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:22.330474 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db362c-56d0-4d24-8378-89aeec5b24b7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:22.332411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db362c-56d0-4d24-8378-89aeec5b24b7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:22.333691 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db362c-56d0-4d24-8378-89aeec5b24b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:22.384778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a0db362c-56d0-4d24-8378-89aeec5b24b7 None None] MFA Rules not processed for user `1acb9957bcb5428f820c4b1012119d15`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:22.386514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a0db362c-56d0-4d24-8378-89aeec5b24b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:22.496712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:22.497377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:22.497656 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:22.497932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] PATH_INFO: `/v3/users/df455003c1bd44819765b039e93e3091` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:22.501023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df455003c1bd44819765b039e93e3091)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:22.505459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:22.559769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 936/1885] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:22.560664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db362c-56d0-4d24-8378-89aeec5b24b7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:22.574241 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a0db362c-56d0-4d24-8378-89aeec5b24b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:22.588964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:22.596752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db362c-56d0-4d24-8378-89aeec5b24b7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:22.600762 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df455003c1bd44819765b039e93e3091'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.601673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df455003c1bd44819765b039e93e3091'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.613337 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df455003c1bd44819765b039e93e3091'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.614502 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583ad01-9dad-4e08-af82-7c6958ceb157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:22.615456 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583ad01-9dad-4e08-af82-7c6958ceb157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:22.616013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583ad01-9dad-4e08-af82-7c6958ceb157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:22.616717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583ad01-9dad-4e08-af82-7c6958ceb157 admin admin] PATH_INFO: `/v3/users/3ff2475f29ba408faf1ce5683045218a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:22.618692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583ad01-9dad-4e08-af82-7c6958ceb157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff2475f29ba408faf1ce5683045218a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:22.621188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583ad01-9dad-4e08-af82-7c6958ceb157 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:22.642342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df455003c1bd44819765b039e93e3091'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.654336 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:22.662729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df455003c1bd44819765b039e93e3091'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.674726 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 950/1886] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:22 2022] DELETE /identity/v3/users/df455003c1bd44819765b039e93e3091 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:22.678781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:22.688682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:22.714982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a583ad01-9dad-4e08-af82-7c6958ceb157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff2475f29ba408faf1ce5683045218a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.716017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a583ad01-9dad-4e08-af82-7c6958ceb157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff2475f29ba408faf1ce5683045218a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.749302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a583ad01-9dad-4e08-af82-7c6958ceb157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff2475f29ba408faf1ce5683045218a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.771749 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a583ad01-9dad-4e08-af82-7c6958ceb157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff2475f29ba408faf1ce5683045218a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.798627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a583ad01-9dad-4e08-af82-7c6958ceb157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff2475f29ba408faf1ce5683045218a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:22.826454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 937/1887] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:22 2022] DELETE /identity/v3/users/3ff2475f29ba408faf1ce5683045218a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:22.835327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b297-eda9-42b1-869c-67ec59ac1b7f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:22.836619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b297-eda9-42b1-869c-67ec59ac1b7f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:22.837504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b297-eda9-42b1-869c-67ec59ac1b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:22.844881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacda25-cb16-4f95-9847-95134418cf46 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:22.880884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1a18b297-eda9-42b1-869c-67ec59ac1b7f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:22.882848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1a18b297-eda9-42b1-869c-67ec59ac1b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:22.973617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959b691-367c-44d3-8248-07602b2a5e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:22.974549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959b691-367c-44d3-8248-07602b2a5e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:22.975547 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959b691-367c-44d3-8248-07602b2a5e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:22.975932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959b691-367c-44d3-8248-07602b2a5e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:22.976942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959b691-367c-44d3-8248-07602b2a5e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:22.979006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959b691-367c-44d3-8248-07602b2a5e20 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:23.008223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 938/1888] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:23.068844 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 951/1889] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:22 2022] POST /identity/v3/projects => generated 383 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:23.074253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18b297-eda9-42b1-869c-67ec59ac1b7f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:23.076498 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1a18b297-eda9-42b1-869c-67ec59ac1b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:23.092515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18b297-eda9-42b1-869c-67ec59ac1b7f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:23.151365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959b691-367c-44d3-8248-07602b2a5e20 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:23.153596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0959b691-367c-44d3-8248-07602b2a5e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:23.189040 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb2eb5-1c2a-435d-85a2-2c86b9b1de25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:23.189856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb2eb5-1c2a-435d-85a2-2c86b9b1de25 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:23.190237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb2eb5-1c2a-435d-85a2-2c86b9b1de25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:23.190615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb2eb5-1c2a-435d-85a2-2c86b9b1de25 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:23.207051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb2eb5-1c2a-435d-85a2-2c86b9b1de25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:23.212914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb2eb5-1c2a-435d-85a2-2c86b9b1de25 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:23.267754 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 939/1890] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:23 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:23.273916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb2eb5-1c2a-435d-85a2-2c86b9b1de25 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:23.289766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb2eb5-1c2a-435d-85a2-2c86b9b1de25 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:23.298202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2764b5-c9b6-4696-8c34-44b981595c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:23.299167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2764b5-c9b6-4696-8c34-44b981595c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:23.299704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2764b5-c9b6-4696-8c34-44b981595c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:23.300273 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2764b5-c9b6-4696-8c34-44b981595c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:23.301363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2764b5-c9b6-4696-8c34-44b981595c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:23.303604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2764b5-c9b6-4696-8c34-44b981595c75 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:23.306770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959b691-367c-44d3-8248-07602b2a5e20 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:23.311148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30481f-a09d-4650-a5ca-a62922500515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:23.312219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30481f-a09d-4650-a5ca-a62922500515 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:23.312647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30481f-a09d-4650-a5ca-a62922500515 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:23.313066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30481f-a09d-4650-a5ca-a62922500515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:23.324451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30481f-a09d-4650-a5ca-a62922500515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:23.326267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30481f-a09d-4650-a5ca-a62922500515 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:23.330660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 940/1891] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:23.334866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:23.336354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2764b5-c9b6-4696-8c34-44b981595c75 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:23.343056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 952/1892] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:23.351933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2764b5-c9b6-4696-8c34-44b981595c75 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:23.358356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832b412-0470-4f7c-b6fe-6cdac87ac772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:23.359624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832b412-0470-4f7c-b6fe-6cdac87ac772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:23.360015 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832b412-0470-4f7c-b6fe-6cdac87ac772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:23.360451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832b412-0470-4f7c-b6fe-6cdac87ac772 admin admin] PATH_INFO: `/v3/projects/4bce186313bd4ff693f4cf76d083da6b/users/8f1498fcfedb4fed96e0e085e2b1d287/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:23.378327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:23.385821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832b412-0470-4f7c-b6fe-6cdac87ac772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bce186313bd4ff693f4cf76d083da6b, user_id=8f1498fcfedb4fed96e0e085e2b1d287, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:23.391741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832b412-0470-4f7c-b6fe-6cdac87ac772 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:23.414552 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 941/1893] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:23 2022] PUT /identity/v3/projects/4bce186313bd4ff693f4cf76d083da6b/users/8f1498fcfedb4fed96e0e085e2b1d287/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:23.419008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30481f-a09d-4650-a5ca-a62922500515 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:23.430825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30481f-a09d-4650-a5ca-a62922500515 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:23.522381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103122b2-b775-4215-812f-2a4a161e5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:23.523452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103122b2-b775-4215-812f-2a4a161e5e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:23.523712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103122b2-b775-4215-812f-2a4a161e5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:23.524000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103122b2-b775-4215-812f-2a4a161e5e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:23.529543 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103122b2-b775-4215-812f-2a4a161e5e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:23.531503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103122b2-b775-4215-812f-2a4a161e5e17 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:23.552750 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 953/1894] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:23.555355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832b412-0470-4f7c-b6fe-6cdac87ac772 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:23.579311 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832b412-0470-4f7c-b6fe-6cdac87ac772 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:23.588670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2e278-6b17-4c16-99e9-d45e9a01f135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:23.589927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2e278-6b17-4c16-99e9-d45e9a01f135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:23.590514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2e278-6b17-4c16-99e9-d45e9a01f135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:23.590770 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2e278-6b17-4c16-99e9-d45e9a01f135 admin admin] PATH_INFO: `/v3/projects/4bce186313bd4ff693f4cf76d083da6b/users/8f1498fcfedb4fed96e0e085e2b1d287/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:23.593621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2e278-6b17-4c16-99e9-d45e9a01f135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bce186313bd4ff693f4cf76d083da6b, user_id=8f1498fcfedb4fed96e0e085e2b1d287, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:23.596469 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2e278-6b17-4c16-99e9-d45e9a01f135 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:23.609230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 942/1895] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:23 2022] PUT /identity/v3/projects/4bce186313bd4ff693f4cf76d083da6b/users/8f1498fcfedb4fed96e0e085e2b1d287/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:23.620693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d3eb0-d5e6-445e-8a78-532095286610 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:23.620989 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d3eb0-d5e6-445e-8a78-532095286610 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:23.621274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d3eb0-d5e6-445e-8a78-532095286610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:23.664612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8f6d3eb0-d5e6-445e-8a78-532095286610 None None] MFA Rules not processed for user `8f1498fcfedb4fed96e0e085e2b1d287`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:23.665855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8f6d3eb0-d5e6-445e-8a78-532095286610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:23.812526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 954/1896] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:23.826874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2e278-6b17-4c16-99e9-d45e9a01f135 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:23.830246 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e9d2e278-6b17-4c16-99e9-d45e9a01f135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:23.938125 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2e278-6b17-4c16-99e9-d45e9a01f135 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:23.938639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d3eb0-d5e6-445e-8a78-532095286610 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:23.942084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8f6d3eb0-d5e6-445e-8a78-532095286610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:23.943513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc613ff-2a8f-4b4b-b1b3-e26cadd5a52a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:23.945343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc613ff-2a8f-4b4b-b1b3-e26cadd5a52a service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:23.945920 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc613ff-2a8f-4b4b-b1b3-e26cadd5a52a service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:23.946569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc613ff-2a8f-4b4b-b1b3-e26cadd5a52a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:23.964004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc613ff-2a8f-4b4b-b1b3-e26cadd5a52a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:23.966274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc613ff-2a8f-4b4b-b1b3-e26cadd5a52a service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:23.988473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 943/1897] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:24.089585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d3eb0-d5e6-445e-8a78-532095286610 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:24.109856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cbe21-2555-4b03-b7fa-50744f2c8529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:24.110706 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cbe21-2555-4b03-b7fa-50744f2c8529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:24.111096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cbe21-2555-4b03-b7fa-50744f2c8529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:24.111504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cbe21-2555-4b03-b7fa-50744f2c8529 admin admin] PATH_INFO: `/v3/projects/0237f17667c84a32852d79b07fb1a2e9` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:24.112912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cbe21-2555-4b03-b7fa-50744f2c8529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0237f17667c84a32852d79b07fb1a2e9)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:24.115615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cbe21-2555-4b03-b7fa-50744f2c8529 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:24.187706 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:24.217683 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc613ff-2a8f-4b4b-b1b3-e26cadd5a52a service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:24.233578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc613ff-2a8f-4b4b-b1b3-e26cadd5a52a service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:24.238025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9a0cbe21-2555-4b03-b7fa-50744f2c8529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0237f17667c84a32852d79b07fb1a2e9', 'request_id': 'req-9a0cbe21-2555-4b03-b7fa-50744f2c8529'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:24.247192 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9a0cbe21-2555-4b03-b7fa-50744f2c8529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0237f17667c84a32852d79b07fb1a2e9', 'request_id': 'req-9a0cbe21-2555-4b03-b7fa-50744f2c8529'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:24.264952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9a0cbe21-2555-4b03-b7fa-50744f2c8529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0237f17667c84a32852d79b07fb1a2e9', 'request_id': 'req-9a0cbe21-2555-4b03-b7fa-50744f2c8529'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:24.282938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9a0cbe21-2555-4b03-b7fa-50744f2c8529 admin admin] The token cache is being invalidate because project 0237f17667c84a32852d79b07fb1a2e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:24.283724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9a0cbe21-2555-4b03-b7fa-50744f2c8529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:24.287971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9a0cbe21-2555-4b03-b7fa-50744f2c8529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:24.290128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 955/1898] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:23 2022] DELETE /identity/v3/projects/0237f17667c84a32852d79b07fb1a2e9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:24.297208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdc711-d5f7-4283-a255-9aedf063f375 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:24.298137 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdc711-d5f7-4283-a255-9aedf063f375 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:24.299338 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdc711-d5f7-4283-a255-9aedf063f375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:24.334837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755db64b-36d7-498b-a484-8da7f9829258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:24.337971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db64b-36d7-498b-a484-8da7f9829258 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:24.338559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db64b-36d7-498b-a484-8da7f9829258 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:24.340540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db64b-36d7-498b-a484-8da7f9829258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:24.344576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-755db64b-36d7-498b-a484-8da7f9829258 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:24.375899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-39bdc711-d5f7-4283-a255-9aedf063f375 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:24.377233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-39bdc711-d5f7-4283-a255-9aedf063f375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:24.442857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755db64b-36d7-498b-a484-8da7f9829258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:24.444860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755db64b-36d7-498b-a484-8da7f9829258 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:24.458325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 944/1899] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:24.518388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 956/1900] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:24.527275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281e636-eccd-46f5-a48e-8f75f181f543 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:24.527643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281e636-eccd-46f5-a48e-8f75f181f543 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:24.527986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281e636-eccd-46f5-a48e-8f75f181f543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:24.594672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6281e636-eccd-46f5-a48e-8f75f181f543 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:24.602988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6281e636-eccd-46f5-a48e-8f75f181f543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:24.636306 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 945/1901] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:24.637819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdc711-d5f7-4283-a255-9aedf063f375 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:24.649396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdc711-d5f7-4283-a255-9aedf063f375 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:24.658217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2622-2682-4eab-8034-ec6be962b5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:24.659053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2622-2682-4eab-8034-ec6be962b5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:24.659438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2622-2682-4eab-8034-ec6be962b5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:24.659848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2622-2682-4eab-8034-ec6be962b5e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:24.660775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2622-2682-4eab-8034-ec6be962b5e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:24.661191 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2622-2682-4eab-8034-ec6be962b5e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:24.663072 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2622-2682-4eab-8034-ec6be962b5e7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:24.675053 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281e636-eccd-46f5-a48e-8f75f181f543 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:24.678552 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6281e636-eccd-46f5-a48e-8f75f181f543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:24.688224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 957/1902] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:54:24.694096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2622-2682-4eab-8034-ec6be962b5e7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:24.702573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281e636-eccd-46f5-a48e-8f75f181f543 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:24.711951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:24.712998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:24.713622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:24.714123 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] PATH_INFO: `/v3/projects/95d44928b1f84e64ac7f7428952c4e70` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:24.716612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d44928b1f84e64ac7f7428952c4e70)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:24.720750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:24.728734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2622-2682-4eab-8034-ec6be962b5e7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:24.747324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057950f-5eb1-4b3b-a788-609beecf2ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:24.747936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057950f-5eb1-4b3b-a788-609beecf2ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:24.748240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057950f-5eb1-4b3b-a788-609beecf2ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:24.748520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057950f-5eb1-4b3b-a788-609beecf2ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:24.749217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057950f-5eb1-4b3b-a788-609beecf2ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:24.752627 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057950f-5eb1-4b3b-a788-609beecf2ef6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:24.778075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:24.807425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 958/1903] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:24 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:24.812716 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057950f-5eb1-4b3b-a788-609beecf2ef6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:24.888863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d44928b1f84e64ac7f7428952c4e70', 'request_id': 'req-e87e562c-f341-44a9-b19c-2ba663918de6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:24.903489 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d44928b1f84e64ac7f7428952c4e70', 'request_id': 'req-e87e562c-f341-44a9-b19c-2ba663918de6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:24.918178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d44928b1f84e64ac7f7428952c4e70', 'request_id': 'req-e87e562c-f341-44a9-b19c-2ba663918de6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:24.934248 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057950f-5eb1-4b3b-a788-609beecf2ef6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:24.942043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] The token cache is being invalidate because project 95d44928b1f84e64ac7f7428952c4e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:24.942370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:24.943256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:24.945538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 946/1904] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:24 2022] DELETE /identity/v3/projects/95d44928b1f84e64ac7f7428952c4e70 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:24.949569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:24.951415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:24.958610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:25.042914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d80809-2bdd-4dd8-b785-9a90314ba998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:25.043567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d80809-2bdd-4dd8-b785-9a90314ba998 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.043856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d80809-2bdd-4dd8-b785-9a90314ba998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.044639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d80809-2bdd-4dd8-b785-9a90314ba998 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.045330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d80809-2bdd-4dd8-b785-9a90314ba998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:25.045438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e562c-f341-44a9-b19c-2ba663918de6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:25.049105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d80809-2bdd-4dd8-b785-9a90314ba998 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:25.050921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:25.051735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.052659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.052659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] PATH_INFO: `/v3/users/e853b488b0724d1498ccaf9db05061e9` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.054094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e853b488b0724d1498ccaf9db05061e9)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:25.057950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:25.105875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 959/1905] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:24 2022] POST /identity/v3/users => generated 283 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:25.110178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d80809-2bdd-4dd8-b785-9a90314ba998 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:25.117924 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b4d80809-2bdd-4dd8-b785-9a90314ba998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:25.124295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e853b488b0724d1498ccaf9db05061e9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.125419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e853b488b0724d1498ccaf9db05061e9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.134927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d80809-2bdd-4dd8-b785-9a90314ba998 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:25.144179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e853b488b0724d1498ccaf9db05061e9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.147203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bd0ef-2d35-4f48-81dc-c6fe5833e891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:25.147947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bd0ef-2d35-4f48-81dc-c6fe5833e891 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.148826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bd0ef-2d35-4f48-81dc-c6fe5833e891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.150044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bd0ef-2d35-4f48-81dc-c6fe5833e891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.150913 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bd0ef-2d35-4f48-81dc-c6fe5833e891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:25.152776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bd0ef-2d35-4f48-81dc-c6fe5833e891 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:25.155359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e853b488b0724d1498ccaf9db05061e9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.170829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 960/1906] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:25.173709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e853b488b0724d1498ccaf9db05061e9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.177709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bd0ef-2d35-4f48-81dc-c6fe5833e891 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:25.180061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b12bd0ef-2d35-4f48-81dc-c6fe5833e891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:25.191363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 947/1907] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:24 2022] DELETE /identity/v3/users/e853b488b0724d1498ccaf9db05061e9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:25.202314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bd0ef-2d35-4f48-81dc-c6fe5833e891 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:25.294984 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:25.296559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:25.329086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caab53b-5f6b-44e7-a2c6-5ec286faaac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:25.329645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caab53b-5f6b-44e7-a2c6-5ec286faaac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.330078 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caab53b-5f6b-44e7-a2c6-5ec286faaac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.330364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caab53b-5f6b-44e7-a2c6-5ec286faaac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.331722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caab53b-5f6b-44e7-a2c6-5ec286faaac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:25.334359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caab53b-5f6b-44e7-a2c6-5ec286faaac2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:25.360452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 961/1908] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:25.369358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caab53b-5f6b-44e7-a2c6-5ec286faaac2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:25.373016 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:25.398904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caab53b-5f6b-44e7-a2c6-5ec286faaac2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:25.408141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df7102-1781-46ea-bae8-cf533583eadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:25.408981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df7102-1781-46ea-bae8-cf533583eadd admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.409309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df7102-1781-46ea-bae8-cf533583eadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.409786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df7102-1781-46ea-bae8-cf533583eadd admin admin] PATH_INFO: `/v3/projects/5c7af47d6ef542e7a9a1668200693d44/users/1a7c15945c564467b5c13327b167f7ad/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.420880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a7331-6d9f-4b64-b044-dd0822a93945 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:25.431870 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9685b56-4168-408d-85ab-7c7d1623d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:25.432683 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9685b56-4168-408d-85ab-7c7d1623d338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.432876 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9685b56-4168-408d-85ab-7c7d1623d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.433529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9685b56-4168-408d-85ab-7c7d1623d338 admin admin] PATH_INFO: `/v3/users/3732294ba3874cfb87de3f2e33a07220` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.434080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df7102-1781-46ea-bae8-cf533583eadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7af47d6ef542e7a9a1668200693d44, user_id=1a7c15945c564467b5c13327b167f7ad, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:25.437429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9685b56-4168-408d-85ab-7c7d1623d338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3732294ba3874cfb87de3f2e33a07220)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:25.438515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df7102-1781-46ea-bae8-cf533583eadd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:25.440700 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9685b56-4168-408d-85ab-7c7d1623d338 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:25.464749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 962/1909] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:25 2022] PUT /identity/v3/projects/5c7af47d6ef542e7a9a1668200693d44/users/1a7c15945c564467b5c13327b167f7ad/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:25.475954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7577627-3dc7-4f58-b411-ef8756c263b4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.478408 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7577627-3dc7-4f58-b411-ef8756c263b4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.478690 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7577627-3dc7-4f58-b411-ef8756c263b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.523401 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e7577627-3dc7-4f58-b411-ef8756c263b4 None None] MFA Rules not processed for user `1a7c15945c564467b5c13327b167f7ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:25.525038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e7577627-3dc7-4f58-b411-ef8756c263b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:25.529836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9685b56-4168-408d-85ab-7c7d1623d338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3732294ba3874cfb87de3f2e33a07220'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.531120 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9685b56-4168-408d-85ab-7c7d1623d338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3732294ba3874cfb87de3f2e33a07220'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.550528 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9685b56-4168-408d-85ab-7c7d1623d338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3732294ba3874cfb87de3f2e33a07220'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.563370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9685b56-4168-408d-85ab-7c7d1623d338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3732294ba3874cfb87de3f2e33a07220'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.572060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9685b56-4168-408d-85ab-7c7d1623d338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3732294ba3874cfb87de3f2e33a07220'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.580486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 948/1910] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:25 2022] DELETE /identity/v3/users/3732294ba3874cfb87de3f2e33a07220 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:25.585657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028f6a8-e132-47f1-a41c-01099f616466 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.585955 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028f6a8-e132-47f1-a41c-01099f616466 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.586380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028f6a8-e132-47f1-a41c-01099f616466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.614850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5028f6a8-e132-47f1-a41c-01099f616466 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:25.616665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5028f6a8-e132-47f1-a41c-01099f616466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:25.641412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:25.653103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 963/1911] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:25.654296 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7577627-3dc7-4f58-b411-ef8756c263b4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:25.657227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e7577627-3dc7-4f58-b411-ef8756c263b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:25.719132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 949/1912] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:25.720035 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028f6a8-e132-47f1-a41c-01099f616466 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:25.721859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5028f6a8-e132-47f1-a41c-01099f616466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:25.745291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028f6a8-e132-47f1-a41c-01099f616466 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:25.751426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:25.752113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.752419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.752694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] PATH_INFO: `/v3/projects/88c75fa1f65d426a95e3872d8092cabb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.753119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7577627-3dc7-4f58-b411-ef8756c263b4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:25.754485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c75fa1f65d426a95e3872d8092cabb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:25.756539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:25.758007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303410c4-70ce-4415-9031-ac8961e4a4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:25.758648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303410c4-70ce-4415-9031-ac8961e4a4bc admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.758935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303410c4-70ce-4415-9031-ac8961e4a4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.759221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303410c4-70ce-4415-9031-ac8961e4a4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.759893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303410c4-70ce-4415-9031-ac8961e4a4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:25.761906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303410c4-70ce-4415-9031-ac8961e4a4bc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:25.795115 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 964/1913] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:25 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:25.795115 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303410c4-70ce-4415-9031-ac8961e4a4bc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:25.795115 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-303410c4-70ce-4415-9031-ac8961e4a4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:25.809801 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:25.816229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c75fa1f65d426a95e3872d8092cabb', 'request_id': 'req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.823506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c75fa1f65d426a95e3872d8092cabb', 'request_id': 'req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.829979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c75fa1f65d426a95e3872d8092cabb', 'request_id': 'req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.843504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] The token cache is being invalidate because project 88c75fa1f65d426a95e3872d8092cabb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:25.843856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.844542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:25.846104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 950/1914] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:25 2022] DELETE /identity/v3/projects/88c75fa1f65d426a95e3872d8092cabb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:25.846962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:25.848308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:25.855626 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303410c4-70ce-4415-9031-ac8961e4a4bc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:25.907574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d708b-017c-4eba-8c6a-87ae97a9943c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:25.908265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d708b-017c-4eba-8c6a-87ae97a9943c service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.908560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d708b-017c-4eba-8c6a-87ae97a9943c service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.908886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d708b-017c-4eba-8c6a-87ae97a9943c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.910765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6f6d708b-017c-4eba-8c6a-87ae97a9943c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:25.916886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2422f0-da69-4c61-8ebf-2fc8aa681a42 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:25.922205 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89310e-85e3-4ccd-9791-912064f3c7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:25.922983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89310e-85e3-4ccd-9791-912064f3c7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.923187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89310e-85e3-4ccd-9791-912064f3c7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.923408 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89310e-85e3-4ccd-9791-912064f3c7d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.924084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89310e-85e3-4ccd-9791-912064f3c7d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:25.925412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d708b-017c-4eba-8c6a-87ae97a9943c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:25.926044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89310e-85e3-4ccd-9791-912064f3c7d5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:25.926852 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d708b-017c-4eba-8c6a-87ae97a9943c service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:25.944347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 965/1915] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:25.946523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b84cc4-a0e2-480c-b2cd-f36ac098db3b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.947067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b84cc4-a0e2-480c-b2cd-f36ac098db3b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.947514 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b84cc4-a0e2-480c-b2cd-f36ac098db3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.950530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 951/1916] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:25 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:25.954530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89310e-85e3-4ccd-9791-912064f3c7d5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:25.966395 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89310e-85e3-4ccd-9791-912064f3c7d5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:25.972922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-89b84cc4-a0e2-480c-b2cd-f36ac098db3b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:25.974354 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-89b84cc4-a0e2-480c-b2cd-f36ac098db3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:25.974554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044f115-8297-4d25-bfeb-e6ec7dfdabeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:25.975210 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f115-8297-4d25-bfeb-e6ec7dfdabeb admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.975499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f115-8297-4d25-bfeb-e6ec7dfdabeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.975780 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f115-8297-4d25-bfeb-e6ec7dfdabeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:25.976520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044f115-8297-4d25-bfeb-e6ec7dfdabeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:25.978411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044f115-8297-4d25-bfeb-e6ec7dfdabeb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:25.985879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 966/1917] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:25.990090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 952/1918] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:25.994512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b84cc4-a0e2-480c-b2cd-f36ac098db3b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:25.995846 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79075e53-c1e6-4b91-93e8-f339be9c6396 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:25.996178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79075e53-c1e6-4b91-93e8-f339be9c6396 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:25.996474 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79075e53-c1e6-4b91-93e8-f339be9c6396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.006593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b84cc4-a0e2-480c-b2cd-f36ac098db3b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:26.011938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0cbf0-8af0-4fb2-b036-e6ea9d1ea1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:26.013208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0cbf0-8af0-4fb2-b036-e6ea9d1ea1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:26.013668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0cbf0-8af0-4fb2-b036-e6ea9d1ea1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:26.014057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0cbf0-8af0-4fb2-b036-e6ea9d1ea1b1 admin admin] PATH_INFO: `/v3/projects/e9eaeacde2be4306a8dae041adaa46b9/users/560e7464087448a7945d71a0705e522d/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.018971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-79075e53-c1e6-4b91-93e8-f339be9c6396 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:26.020177 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-79075e53-c1e6-4b91-93e8-f339be9c6396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:26.029687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 953/1919] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:26.034099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79075e53-c1e6-4b91-93e8-f339be9c6396 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:26.039294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0cbf0-8af0-4fb2-b036-e6ea9d1ea1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9eaeacde2be4306a8dae041adaa46b9, user_id=560e7464087448a7945d71a0705e522d, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:26.043207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0cbf0-8af0-4fb2-b036-e6ea9d1ea1b1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:26.045403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79075e53-c1e6-4b91-93e8-f339be9c6396 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:26.051822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170160c-a373-4c15-94aa-0c93a35b96b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:26.052713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170160c-a373-4c15-94aa-0c93a35b96b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:26.053931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170160c-a373-4c15-94aa-0c93a35b96b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:26.053931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170160c-a373-4c15-94aa-0c93a35b96b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.054451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170160c-a373-4c15-94aa-0c93a35b96b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:26.054832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170160c-a373-4c15-94aa-0c93a35b96b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:26.056695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170160c-a373-4c15-94aa-0c93a35b96b3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:26.069901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 967/1920] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:25 2022] PUT /identity/v3/projects/e9eaeacde2be4306a8dae041adaa46b9/users/560e7464087448a7945d71a0705e522d/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:26.073753 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0cbf0-8af0-4fb2-b036-e6ea9d1ea1b1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:26.079268 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 954/1921] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:54:26.080743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170160c-a373-4c15-94aa-0c93a35b96b3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:26.093574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170160c-a373-4c15-94aa-0c93a35b96b3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:26.094391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:26.179685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358684da-b925-473e-933f-4770300f4815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:26.180431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358684da-b925-473e-933f-4770300f4815 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:26.180731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358684da-b925-473e-933f-4770300f4815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:26.181015 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358684da-b925-473e-933f-4770300f4815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.181695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358684da-b925-473e-933f-4770300f4815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:26.184051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358684da-b925-473e-933f-4770300f4815 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:26.200495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0cbf0-8af0-4fb2-b036-e6ea9d1ea1b1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:26.229475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95794ab0-572d-410f-8b97-a23c41fabdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:26.230744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95794ab0-572d-410f-8b97-a23c41fabdaf admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:26.231262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95794ab0-572d-410f-8b97-a23c41fabdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:26.231895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95794ab0-572d-410f-8b97-a23c41fabdaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.232673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95794ab0-572d-410f-8b97-a23c41fabdaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:26.234989 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95794ab0-572d-410f-8b97-a23c41fabdaf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:26.261373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 968/1922] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:26.264802 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 955/1923] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:26 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:26.265875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95794ab0-572d-410f-8b97-a23c41fabdaf admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:26.266109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358684da-b925-473e-933f-4770300f4815 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:26.292875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95794ab0-572d-410f-8b97-a23c41fabdaf admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:26.316703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:26.405358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358684da-b925-473e-933f-4770300f4815 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:26.414056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba11b1-705f-4b4d-b96a-de87bf1843a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:26.414683 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba11b1-705f-4b4d-b96a-de87bf1843a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:26.415081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba11b1-705f-4b4d-b96a-de87bf1843a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:26.415526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba11b1-705f-4b4d-b96a-de87bf1843a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.416467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba11b1-705f-4b4d-b96a-de87bf1843a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:26.416961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988d78f-224b-4e79-9ec4-7f9a3c6437f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:26.417704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988d78f-224b-4e79-9ec4-7f9a3c6437f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:26.417975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988d78f-224b-4e79-9ec4-7f9a3c6437f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:26.418256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988d78f-224b-4e79-9ec4-7f9a3c6437f8 admin admin] PATH_INFO: `/v3/projects/e9eaeacde2be4306a8dae041adaa46b9/users/560e7464087448a7945d71a0705e522d/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.418429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba11b1-705f-4b4d-b96a-de87bf1843a0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:26.420712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988d78f-224b-4e79-9ec4-7f9a3c6437f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9eaeacde2be4306a8dae041adaa46b9, user_id=560e7464087448a7945d71a0705e522d, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:26.425727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988d78f-224b-4e79-9ec4-7f9a3c6437f8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:26.443978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 969/1924] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:26 2022] PUT /identity/v3/projects/e9eaeacde2be4306a8dae041adaa46b9/users/560e7464087448a7945d71a0705e522d/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:26.444963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988d78f-224b-4e79-9ec4-7f9a3c6437f8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:26.446594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9988d78f-224b-4e79-9ec4-7f9a3c6437f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:26.447158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 956/1925] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:26 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:26.454881 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba11b1-705f-4b4d-b96a-de87bf1843a0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:26.470805 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba11b1-705f-4b4d-b96a-de87bf1843a0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:26.580142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988d78f-224b-4e79-9ec4-7f9a3c6437f8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:26.585424 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:26.586951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:26.587237 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:26.587512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] PATH_INFO: `/v3/projects/fc18dc191bed4d5582d08eae7c0e44fe` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.588743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc18dc191bed4d5582d08eae7c0e44fe)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:26.590677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:26.626515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60481544-f896-4a3f-ad08-5a762a44e887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:26.629185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481544-f896-4a3f-ad08-5a762a44e887 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:26.630107 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481544-f896-4a3f-ad08-5a762a44e887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:26.631230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481544-f896-4a3f-ad08-5a762a44e887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.633536 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60481544-f896-4a3f-ad08-5a762a44e887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:26.638115 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60481544-f896-4a3f-ad08-5a762a44e887 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:26.649903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:26.653992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc18dc191bed4d5582d08eae7c0e44fe', 'request_id': 'req-2bfc0420-2857-48fa-a50a-d8f73e15bd75'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:26.663156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc18dc191bed4d5582d08eae7c0e44fe', 'request_id': 'req-2bfc0420-2857-48fa-a50a-d8f73e15bd75'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:26.668243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 957/1926] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:26.670714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5110d25-960d-469d-9b81-83bb9307dc04 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:26.671363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5110d25-960d-469d-9b81-83bb9307dc04 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:26.671863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5110d25-960d-469d-9b81-83bb9307dc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.674266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc18dc191bed4d5582d08eae7c0e44fe', 'request_id': 'req-2bfc0420-2857-48fa-a50a-d8f73e15bd75'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:26.691324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] The token cache is being invalidate because project fc18dc191bed4d5582d08eae7c0e44fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:26.691853 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:26.693103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:26.696075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 970/1927] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:26 2022] DELETE /identity/v3/projects/fc18dc191bed4d5582d08eae7c0e44fe => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:26.697212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:26.699742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:26.736345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d5110d25-960d-469d-9b81-83bb9307dc04 None None] MFA Rules not processed for user `560e7464087448a7945d71a0705e522d`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:26.738520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d5110d25-960d-469d-9b81-83bb9307dc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:26.862751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc0420-2857-48fa-a50a-d8f73e15bd75 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:26.879604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a810a-467c-4ead-a1e3-bb97d786ccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:26.881374 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a810a-467c-4ead-a1e3-bb97d786ccff admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:26.882526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a810a-467c-4ead-a1e3-bb97d786ccff admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:26.883126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a810a-467c-4ead-a1e3-bb97d786ccff admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.884028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a810a-467c-4ead-a1e3-bb97d786ccff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:26.886298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a810a-467c-4ead-a1e3-bb97d786ccff admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:26.902349 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 971/1928] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:26.903970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a810a-467c-4ead-a1e3-bb97d786ccff admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:26.910397 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 958/1929] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:26.910397 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5110d25-960d-469d-9b81-83bb9307dc04 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:26.916001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c32a810a-467c-4ead-a1e3-bb97d786ccff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:26.918695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5110d25-960d-469d-9b81-83bb9307dc04 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:26.925664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693b8d4-2581-4182-b71c-525ca9cf9db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:26.926584 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693b8d4-2581-4182-b71c-525ca9cf9db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:26.926934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693b8d4-2581-4182-b71c-525ca9cf9db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:26.927280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693b8d4-2581-4182-b71c-525ca9cf9db7 admin admin] PATH_INFO: `/v3/projects/51be8bd3af454e1b93bb27324ef97358/users/15ba3f045bf6458688defdce0d58a8b8/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.934785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a810a-467c-4ead-a1e3-bb97d786ccff admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:26.943238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ac628-6cc6-47b5-81de-47cfbffb9af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:26.944755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ac628-6cc6-47b5-81de-47cfbffb9af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:26.945149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ac628-6cc6-47b5-81de-47cfbffb9af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:26.945427 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ac628-6cc6-47b5-81de-47cfbffb9af6 admin admin] PATH_INFO: `/v3/users/9c30750853ab4147839280451b29c6fc` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:26.946046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693b8d4-2581-4182-b71c-525ca9cf9db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51be8bd3af454e1b93bb27324ef97358, user_id=15ba3f045bf6458688defdce0d58a8b8, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:26.947469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ac628-6cc6-47b5-81de-47cfbffb9af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c30750853ab4147839280451b29c6fc)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:26.949411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693b8d4-2581-4182-b71c-525ca9cf9db7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:26.950348 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ac628-6cc6-47b5-81de-47cfbffb9af6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:26.970337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 959/1930] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:26 2022] PUT /identity/v3/projects/51be8bd3af454e1b93bb27324ef97358/users/15ba3f045bf6458688defdce0d58a8b8/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:26.972077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693b8d4-2581-4182-b71c-525ca9cf9db7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:26.974944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1693b8d4-2581-4182-b71c-525ca9cf9db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:26.985547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:27.020636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0c6ac628-6cc6-47b5-81de-47cfbffb9af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c30750853ab4147839280451b29c6fc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.021688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0c6ac628-6cc6-47b5-81de-47cfbffb9af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c30750853ab4147839280451b29c6fc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.032499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0c6ac628-6cc6-47b5-81de-47cfbffb9af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c30750853ab4147839280451b29c6fc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.046003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0c6ac628-6cc6-47b5-81de-47cfbffb9af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c30750853ab4147839280451b29c6fc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.054494 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0c6ac628-6cc6-47b5-81de-47cfbffb9af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c30750853ab4147839280451b29c6fc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.061070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 972/1931] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:26 2022] DELETE /identity/v3/users/9c30750853ab4147839280451b29c6fc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:27.063042 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23b2af-67b6-47b0-bfd6-ab6a9062909f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:27.063360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23b2af-67b6-47b0-bfd6-ab6a9062909f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:27.063582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693b8d4-2581-4182-b71c-525ca9cf9db7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:27.063673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23b2af-67b6-47b0-bfd6-ab6a9062909f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:27.104091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8e23b2af-67b6-47b0-bfd6-ab6a9062909f None None] MFA Rules not processed for user `15ba3f045bf6458688defdce0d58a8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:27.105416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8e23b2af-67b6-47b0-bfd6-ab6a9062909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.119060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777f4fb-70e1-4b98-957a-a9a7f901a1b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:27.119852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777f4fb-70e1-4b98-957a-a9a7f901a1b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:27.120387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777f4fb-70e1-4b98-957a-a9a7f901a1b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:27.120753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777f4fb-70e1-4b98-957a-a9a7f901a1b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:27.122698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9777f4fb-70e1-4b98-957a-a9a7f901a1b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.138705 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:27.195289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 973/1932] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:27.201603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777f4fb-70e1-4b98-957a-a9a7f901a1b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:27.203640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777f4fb-70e1-4b98-957a-a9a7f901a1b7 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:27.209439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23b2af-67b6-47b0-bfd6-ab6a9062909f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:27.212697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8e23b2af-67b6-47b0-bfd6-ab6a9062909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.218740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 960/1933] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:27.225897 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23b2af-67b6-47b0-bfd6-ab6a9062909f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:27.230105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f60c4-3985-4e5f-bd04-1f28b2785048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:27.230876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f60c4-3985-4e5f-bd04-1f28b2785048 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:27.231168 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f60c4-3985-4e5f-bd04-1f28b2785048 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:27.231447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f60c4-3985-4e5f-bd04-1f28b2785048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:27.244043 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f60c4-3985-4e5f-bd04-1f28b2785048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:27.245535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f60c4-3985-4e5f-bd04-1f28b2785048 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:27.257516 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 974/1934] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:27.281471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777f4fb-70e1-4b98-957a-a9a7f901a1b7 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:27.283513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9777f4fb-70e1-4b98-957a-a9a7f901a1b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.329921 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f60c4-3985-4e5f-bd04-1f28b2785048 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:27.333486 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2e1f60c4-3985-4e5f-bd04-1f28b2785048 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.346293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f60c4-3985-4e5f-bd04-1f28b2785048 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:27.350274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b2622-cb24-42f5-9d29-71bed234ff90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:27.350935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b2622-cb24-42f5-9d29-71bed234ff90 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:27.351235 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b2622-cb24-42f5-9d29-71bed234ff90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:27.351521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b2622-cb24-42f5-9d29-71bed234ff90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:27.353399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-679b2622-cb24-42f5-9d29-71bed234ff90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.418536 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777f4fb-70e1-4b98-957a-a9a7f901a1b7 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:27.424520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a0857-3172-4b32-9d6b-d88613950deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:27.425194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a0857-3172-4b32-9d6b-d88613950deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:27.425496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a0857-3172-4b32-9d6b-d88613950deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:27.425767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a0857-3172-4b32-9d6b-d88613950deb admin admin] PATH_INFO: `/v3/users/15ba3f045bf6458688defdce0d58a8b8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:27.426990 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a0857-3172-4b32-9d6b-d88613950deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ba3f045bf6458688defdce0d58a8b8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:27.428997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a0857-3172-4b32-9d6b-d88613950deb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:27.436621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b2622-cb24-42f5-9d29-71bed234ff90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:27.438145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b2622-cb24-42f5-9d29-71bed234ff90 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:27.447872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:27.448526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 975/1935] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:27.449569 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b2622-cb24-42f5-9d29-71bed234ff90 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:27.451518 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-679b2622-cb24-42f5-9d29-71bed234ff90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.470024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b2622-cb24-42f5-9d29-71bed234ff90 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:27.476219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:27.476865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:27.477186 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:27.477459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] PATH_INFO: `/v3/projects/faf77496920c4578ad58feca560e79c3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:27.479103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf77496920c4578ad58feca560e79c3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:27.481359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:27.499915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5c2a0857-3172-4b32-9d6b-d88613950deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ba3f045bf6458688defdce0d58a8b8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.500980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5c2a0857-3172-4b32-9d6b-d88613950deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ba3f045bf6458688defdce0d58a8b8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.519242 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5c2a0857-3172-4b32-9d6b-d88613950deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ba3f045bf6458688defdce0d58a8b8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.528945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5c2a0857-3172-4b32-9d6b-d88613950deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ba3f045bf6458688defdce0d58a8b8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.538940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5c2a0857-3172-4b32-9d6b-d88613950deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ba3f045bf6458688defdce0d58a8b8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.542356 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf77496920c4578ad58feca560e79c3', 'request_id': 'req-a31d9e93-052c-457d-992f-0db14538000a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.548159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 961/1936] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:27 2022] DELETE /identity/v3/users/15ba3f045bf6458688defdce0d58a8b8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:27.549010 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf77496920c4578ad58feca560e79c3', 'request_id': 'req-a31d9e93-052c-457d-992f-0db14538000a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.556032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e9aff-1852-4d43-aadd-0ea59e30ad70 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:27.556499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e9aff-1852-4d43-aadd-0ea59e30ad70 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:27.556877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e9aff-1852-4d43-aadd-0ea59e30ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:27.560881 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf77496920c4578ad58feca560e79c3', 'request_id': 'req-a31d9e93-052c-457d-992f-0db14538000a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.580262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] The token cache is being invalidate because project faf77496920c4578ad58feca560e79c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:27.580540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.581522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.581662 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-be1e9aff-1852-4d43-aadd-0ea59e30ad70 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:27.583218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-be1e9aff-1852-4d43-aadd-0ea59e30ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.586630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 976/1937] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:27 2022] DELETE /identity/v3/projects/faf77496920c4578ad58feca560e79c3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:27.586630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:27.586630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.630500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:27.657136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 962/1938] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:27.657136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e9aff-1852-4d43-aadd-0ea59e30ad70 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:27.657136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-be1e9aff-1852-4d43-aadd-0ea59e30ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.670371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e9aff-1852-4d43-aadd-0ea59e30ad70 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:27.676404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d9e93-052c-457d-992f-0db14538000a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:27.677221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:27.678287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:27.678832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:27.679296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] PATH_INFO: `/v3/users/a386e697f2584f92982262336ebfb0e7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:27.680728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a386e697f2584f92982262336ebfb0e7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:27.683062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:27.684071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9434c5-b751-43b6-ba6e-2c17219db5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:27.685549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9434c5-b751-43b6-ba6e-2c17219db5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:27.685549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9434c5-b751-43b6-ba6e-2c17219db5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:27.685549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9434c5-b751-43b6-ba6e-2c17219db5d5 admin admin] PATH_INFO: `/v3/users/1acb9957bcb5428f820c4b1012119d15` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:27.687846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9434c5-b751-43b6-ba6e-2c17219db5d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1acb9957bcb5428f820c4b1012119d15)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:27.690024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9434c5-b751-43b6-ba6e-2c17219db5d5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:27.735354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a386e697f2584f92982262336ebfb0e7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.736132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a386e697f2584f92982262336ebfb0e7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.749287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a386e697f2584f92982262336ebfb0e7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.750562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4d9434c5-b751-43b6-ba6e-2c17219db5d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1acb9957bcb5428f820c4b1012119d15'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.752072 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4d9434c5-b751-43b6-ba6e-2c17219db5d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1acb9957bcb5428f820c4b1012119d15'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.760482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a386e697f2584f92982262336ebfb0e7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.762618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4d9434c5-b751-43b6-ba6e-2c17219db5d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1acb9957bcb5428f820c4b1012119d15'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.768753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a386e697f2584f92982262336ebfb0e7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.775739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 963/1939] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:27 2022] DELETE /identity/v3/users/a386e697f2584f92982262336ebfb0e7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:27.776696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:27.778070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4d9434c5-b751-43b6-ba6e-2c17219db5d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1acb9957bcb5428f820c4b1012119d15'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.778408 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.784794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:27.795456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4d9434c5-b751-43b6-ba6e-2c17219db5d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1acb9957bcb5428f820c4b1012119d15'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:27.812535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 977/1940] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:27 2022] DELETE /identity/v3/users/1acb9957bcb5428f820c4b1012119d15 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:27.818775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eed25-4615-42a7-870d-c630b61a22de None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:27.819032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eed25-4615-42a7-870d-c630b61a22de None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:27.819263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eed25-4615-42a7-870d-c630b61a22de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:27.853893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-122eed25-4615-42a7-870d-c630b61a22de None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:27.855393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-122eed25-4615-42a7-870d-c630b61a22de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.877940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d826af-ca59-4dac-ac7f-20f2d9c5409e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:27.941579 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8944540-4ddb-48ef-b0d6-04cfc14ecf2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:27.942642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8944540-4ddb-48ef-b0d6-04cfc14ecf2b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:27.943093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8944540-4ddb-48ef-b0d6-04cfc14ecf2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:27.943366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8944540-4ddb-48ef-b0d6-04cfc14ecf2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:27.945391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a8944540-4ddb-48ef-b0d6-04cfc14ecf2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.962674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 978/1941] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:27.976436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122eed25-4615-42a7-870d-c630b61a22de None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:27.979296 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-122eed25-4615-42a7-870d-c630b61a22de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:27.997368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122eed25-4615-42a7-870d-c630b61a22de None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:28.008410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf0169-4dee-4f2d-b1a0-be48702c2584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:28.009164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0169-4dee-4f2d-b1a0-be48702c2584 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:28.009933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0169-4dee-4f2d-b1a0-be48702c2584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:28.010322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0169-4dee-4f2d-b1a0-be48702c2584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:28.039625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf0169-4dee-4f2d-b1a0-be48702c2584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:28.041404 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf0169-4dee-4f2d-b1a0-be48702c2584 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:28.065852 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 979/1942] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:28.069772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8944540-4ddb-48ef-b0d6-04cfc14ecf2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:28.071522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8944540-4ddb-48ef-b0d6-04cfc14ecf2b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:28.108967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 964/1943] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:28.409649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf0169-4dee-4f2d-b1a0-be48702c2584 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:28.411691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9cbf0169-4dee-4f2d-b1a0-be48702c2584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:28.431148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf0169-4dee-4f2d-b1a0-be48702c2584 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:28.439560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97f7be-ebda-44db-a41f-7988e0d46cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:28.440467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97f7be-ebda-44db-a41f-7988e0d46cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:28.440858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97f7be-ebda-44db-a41f-7988e0d46cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:28.441775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97f7be-ebda-44db-a41f-7988e0d46cbe admin admin] PATH_INFO: `/v3/projects/c900c138688e4a15b3715e5487b3a639` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:28.443369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97f7be-ebda-44db-a41f-7988e0d46cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c900c138688e4a15b3715e5487b3a639)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:28.459593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97f7be-ebda-44db-a41f-7988e0d46cbe admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:28.571175 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:28.582935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aa97f7be-ebda-44db-a41f-7988e0d46cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c900c138688e4a15b3715e5487b3a639', 'request_id': 'req-aa97f7be-ebda-44db-a41f-7988e0d46cbe'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:28.590083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aa97f7be-ebda-44db-a41f-7988e0d46cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c900c138688e4a15b3715e5487b3a639', 'request_id': 'req-aa97f7be-ebda-44db-a41f-7988e0d46cbe'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:28.610074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aa97f7be-ebda-44db-a41f-7988e0d46cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c900c138688e4a15b3715e5487b3a639', 'request_id': 'req-aa97f7be-ebda-44db-a41f-7988e0d46cbe'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:28.630180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aa97f7be-ebda-44db-a41f-7988e0d46cbe admin admin] The token cache is being invalidate because project c900c138688e4a15b3715e5487b3a639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:28.630518 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aa97f7be-ebda-44db-a41f-7988e0d46cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:28.631378 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aa97f7be-ebda-44db-a41f-7988e0d46cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:28.638065 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 980/1944] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:28 2022] DELETE /identity/v3/projects/c900c138688e4a15b3715e5487b3a639 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:28.640774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab51a4-62ee-439c-8b3e-700dcdbd12cb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:28.641335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab51a4-62ee-439c-8b3e-700dcdbd12cb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:28.641945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab51a4-62ee-439c-8b3e-700dcdbd12cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:28.666646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cbab51a4-62ee-439c-8b3e-700dcdbd12cb None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:28.669370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cbab51a4-62ee-439c-8b3e-700dcdbd12cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:28.784659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 965/1945] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:28.793499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a10472-ed60-462b-bbf7-b825af5cb5fd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:28.793793 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a10472-ed60-462b-bbf7-b825af5cb5fd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:28.794071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a10472-ed60-462b-bbf7-b825af5cb5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:28.827752 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-16a10472-ed60-462b-bbf7-b825af5cb5fd None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:28.829047 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-16a10472-ed60-462b-bbf7-b825af5cb5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:28.837644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 981/1946] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:28.841862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab51a4-62ee-439c-8b3e-700dcdbd12cb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:28.853589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab51a4-62ee-439c-8b3e-700dcdbd12cb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:28.859540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528575c-2290-4e20-8c1b-9546a5fee9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:28.860113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528575c-2290-4e20-8c1b-9546a5fee9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:28.860435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528575c-2290-4e20-8c1b-9546a5fee9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:28.860711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528575c-2290-4e20-8c1b-9546a5fee9e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:28.861514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528575c-2290-4e20-8c1b-9546a5fee9e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:28.861723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528575c-2290-4e20-8c1b-9546a5fee9e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:28.863411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528575c-2290-4e20-8c1b-9546a5fee9e8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:28.867088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:28.879354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 966/1947] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:28.892095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a10472-ed60-462b-bbf7-b825af5cb5fd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:28.917985 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a10472-ed60-462b-bbf7-b825af5cb5fd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:28.934783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528575c-2290-4e20-8c1b-9546a5fee9e8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:28.938289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8528575c-2290-4e20-8c1b-9546a5fee9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:28.939846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a912754-a301-4043-9693-1f9d5977f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:28.941109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a912754-a301-4043-9693-1f9d5977f833 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:28.941109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a912754-a301-4043-9693-1f9d5977f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:28.942236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a912754-a301-4043-9693-1f9d5977f833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:28.942948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a912754-a301-4043-9693-1f9d5977f833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:28.945693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a912754-a301-4043-9693-1f9d5977f833 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:28.967829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528575c-2290-4e20-8c1b-9546a5fee9e8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:28.985769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:28.986325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:28.986616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:28.986894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] PATH_INFO: `/v3/projects/999aee331d47409fb71221912860ff07` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:28.988280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=999aee331d47409fb71221912860ff07)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:28.993063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:29.004214 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 982/1948] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:28 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:29.005850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a912754-a301-4043-9693-1f9d5977f833 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:29.011749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6a912754-a301-4043-9693-1f9d5977f833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:29.090303 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '999aee331d47409fb71221912860ff07', 'request_id': 'req-c84dbfef-8195-4aba-8af4-8078b06d6eba'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.102621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '999aee331d47409fb71221912860ff07', 'request_id': 'req-c84dbfef-8195-4aba-8af4-8078b06d6eba'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.112228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '999aee331d47409fb71221912860ff07', 'request_id': 'req-c84dbfef-8195-4aba-8af4-8078b06d6eba'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.141091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] The token cache is being invalidate because project 999aee331d47409fb71221912860ff07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:29.141705 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.142893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.144763 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 967/1949] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:28 2022] DELETE /identity/v3/projects/999aee331d47409fb71221912860ff07 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:29.147697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:29.147697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:29.245431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a912754-a301-4043-9693-1f9d5977f833 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:29.307622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dbfef-8195-4aba-8af4-8078b06d6eba admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:29.317506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3db39-d303-4416-b4fb-0e03194bbf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:29.318324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3db39-d303-4416-b4fb-0e03194bbf4c admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:29.318844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3db39-d303-4416-b4fb-0e03194bbf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:29.319154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3db39-d303-4416-b4fb-0e03194bbf4c admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:29.319950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3db39-d303-4416-b4fb-0e03194bbf4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:29.322246 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3db39-d303-4416-b4fb-0e03194bbf4c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:29.354992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:29.357213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:29.357722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:29.358298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] PATH_INFO: `/v3/projects/51be8bd3af454e1b93bb27324ef97358` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:29.361627 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51be8bd3af454e1b93bb27324ef97358)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:29.367193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:29.378920 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 968/1950] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:29 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:29.380419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3db39-d303-4416-b4fb-0e03194bbf4c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:29.382813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-20d3db39-d303-4416-b4fb-0e03194bbf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:29.430778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3db39-d303-4416-b4fb-0e03194bbf4c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:29.443442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e84e1-ab37-4abe-98e3-80aeb5049046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:29.444300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e84e1-ab37-4abe-98e3-80aeb5049046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:29.445529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e84e1-ab37-4abe-98e3-80aeb5049046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:29.446463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e84e1-ab37-4abe-98e3-80aeb5049046 admin admin] PATH_INFO: `/v3/users/8f1498fcfedb4fed96e0e085e2b1d287` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:29.450284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e84e1-ab37-4abe-98e3-80aeb5049046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1498fcfedb4fed96e0e085e2b1d287)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:29.455592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e84e1-ab37-4abe-98e3-80aeb5049046 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:29.496557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:29.502110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51be8bd3af454e1b93bb27324ef97358', 'request_id': 'req-97d3020c-1c58-4b05-b1d7-32242ee999e1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.511342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51be8bd3af454e1b93bb27324ef97358', 'request_id': 'req-97d3020c-1c58-4b05-b1d7-32242ee999e1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.525475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51be8bd3af454e1b93bb27324ef97358', 'request_id': 'req-97d3020c-1c58-4b05-b1d7-32242ee999e1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.542536 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] The token cache is being invalidate because project 51be8bd3af454e1b93bb27324ef97358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:29.543084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.543986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.556188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 983/1951] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:29 2022] DELETE /identity/v3/projects/51be8bd3af454e1b93bb27324ef97358 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:29.558140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:29.559905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:29.576189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-551e84e1-ab37-4abe-98e3-80aeb5049046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1498fcfedb4fed96e0e085e2b1d287'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.576189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-551e84e1-ab37-4abe-98e3-80aeb5049046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1498fcfedb4fed96e0e085e2b1d287'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.592400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:29.598514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-551e84e1-ab37-4abe-98e3-80aeb5049046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1498fcfedb4fed96e0e085e2b1d287'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.610281 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-551e84e1-ab37-4abe-98e3-80aeb5049046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1498fcfedb4fed96e0e085e2b1d287'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.626159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-551e84e1-ab37-4abe-98e3-80aeb5049046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1498fcfedb4fed96e0e085e2b1d287'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:29.636175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 969/1952] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:29 2022] DELETE /identity/v3/users/8f1498fcfedb4fed96e0e085e2b1d287 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:29.638914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74805b2a-6b8c-4601-95ff-d076e7b28bc3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:29.639500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74805b2a-6b8c-4601-95ff-d076e7b28bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:29.640538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74805b2a-6b8c-4601-95ff-d076e7b28bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:29.659291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3020c-1c58-4b05-b1d7-32242ee999e1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:29.666718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-74805b2a-6b8c-4601-95ff-d076e7b28bc3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:29.668075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-74805b2a-6b8c-4601-95ff-d076e7b28bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:29.739242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d2088-2241-4904-b60e-362c49e8fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:29.740564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d2088-2241-4904-b60e-362c49e8fa29 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:29.741185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d2088-2241-4904-b60e-362c49e8fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:29.741966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d2088-2241-4904-b60e-362c49e8fa29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:29.742455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 970/1953] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:29.743279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d2088-2241-4904-b60e-362c49e8fa29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:29.745362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d2088-2241-4904-b60e-362c49e8fa29 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:29.752040 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84573968-a29f-4ff8-85d9-083e08c877f2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:29.752572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84573968-a29f-4ff8-85d9-083e08c877f2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:29.752855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84573968-a29f-4ff8-85d9-083e08c877f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:29.762843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 984/1954] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:29.766928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d2088-2241-4904-b60e-362c49e8fa29 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:29.772897 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7c9d2088-2241-4904-b60e-362c49e8fa29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:29.787607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-84573968-a29f-4ff8-85d9-083e08c877f2 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:29.789671 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-84573968-a29f-4ff8-85d9-083e08c877f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:29.790803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d2088-2241-4904-b60e-362c49e8fa29 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:29.798028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278c20f-d908-4a95-8e2a-12a8c6619358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:29.802849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278c20f-d908-4a95-8e2a-12a8c6619358 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:29.802849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278c20f-d908-4a95-8e2a-12a8c6619358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:29.802849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278c20f-d908-4a95-8e2a-12a8c6619358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:29.802849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278c20f-d908-4a95-8e2a-12a8c6619358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:29.802849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278c20f-d908-4a95-8e2a-12a8c6619358 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:29.816144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 971/1955] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:29.817490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84573968-a29f-4ff8-85d9-083e08c877f2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:29.826255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 985/1956] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:29.829093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278c20f-d908-4a95-8e2a-12a8c6619358 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:29.833732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84573968-a29f-4ff8-85d9-083e08c877f2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:29.844168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40308ec5-3571-4824-bb97-d1dd68b98a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:29.845380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308ec5-3571-4824-bb97-d1dd68b98a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:29.847547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308ec5-3571-4824-bb97-d1dd68b98a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:29.848704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308ec5-3571-4824-bb97-d1dd68b98a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:29.850299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278c20f-d908-4a95-8e2a-12a8c6619358 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:29.851182 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40308ec5-3571-4824-bb97-d1dd68b98a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:29.852522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40308ec5-3571-4824-bb97-d1dd68b98a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:29.854406 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40308ec5-3571-4824-bb97-d1dd68b98a09 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:29.868224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868b240-d92f-454c-ae0d-9bfdb6bc0812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:29.868954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868b240-d92f-454c-ae0d-9bfdb6bc0812 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:29.871100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868b240-d92f-454c-ae0d-9bfdb6bc0812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:29.871397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868b240-d92f-454c-ae0d-9bfdb6bc0812 admin admin] PATH_INFO: `/v3/projects/97aa326ed9604385a5f24b0dda2818d7/users/1fe69c224ca24932ac2ca7062c966a62/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:29.894372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 972/1957] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:29.895478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40308ec5-3571-4824-bb97-d1dd68b98a09 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:29.909340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868b240-d92f-454c-ae0d-9bfdb6bc0812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97aa326ed9604385a5f24b0dda2818d7, user_id=1fe69c224ca24932ac2ca7062c966a62, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:29.912972 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868b240-d92f-454c-ae0d-9bfdb6bc0812 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:29.918712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40308ec5-3571-4824-bb97-d1dd68b98a09 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:29.931104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b04e86-4e52-4477-a575-dd8f63eb27d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:29.931759 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b04e86-4e52-4477-a575-dd8f63eb27d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:29.932051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b04e86-4e52-4477-a575-dd8f63eb27d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:29.932343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b04e86-4e52-4477-a575-dd8f63eb27d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:29.933044 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b04e86-4e52-4477-a575-dd8f63eb27d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:29.939470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b04e86-4e52-4477-a575-dd8f63eb27d9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:29.940367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 986/1958] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:29 2022] PUT /identity/v3/projects/97aa326ed9604385a5f24b0dda2818d7/users/1fe69c224ca24932ac2ca7062c966a62/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:29.951678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1805d-8cf8-48ed-afe3-63ed894373b4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:29.952222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1805d-8cf8-48ed-afe3-63ed894373b4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:29.952680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1805d-8cf8-48ed-afe3-63ed894373b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:29.993174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 973/1959] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:29 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:29.997155 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b04e86-4e52-4477-a575-dd8f63eb27d9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:30.013473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-55d1805d-8cf8-48ed-afe3-63ed894373b4 None None] MFA Rules not processed for user `1fe69c224ca24932ac2ca7062c966a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:30.014823 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-55d1805d-8cf8-48ed-afe3-63ed894373b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:30.074255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:30.104400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b04e86-4e52-4477-a575-dd8f63eb27d9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:30.109726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1edc-d16d-46e1-bc59-8a8e916e760a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:30.110368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1edc-d16d-46e1-bc59-8a8e916e760a admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:30.110660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1edc-d16d-46e1-bc59-8a8e916e760a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:30.111470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1edc-d16d-46e1-bc59-8a8e916e760a admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:30.112175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea1edc-d16d-46e1-bc59-8a8e916e760a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:30.114134 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea1edc-d16d-46e1-bc59-8a8e916e760a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:30.121885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 987/1960] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:30.125971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1805d-8cf8-48ed-afe3-63ed894373b4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:30.143762 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 974/1961] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:29 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:30.147739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1805d-8cf8-48ed-afe3-63ed894373b4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:30.148302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1edc-d16d-46e1-bc59-8a8e916e760a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:30.159158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26e5d7-881b-4d16-9c8d-5b3310a83446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:30.159813 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26e5d7-881b-4d16-9c8d-5b3310a83446 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:30.160104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26e5d7-881b-4d16-9c8d-5b3310a83446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:30.160410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26e5d7-881b-4d16-9c8d-5b3310a83446 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:30.161083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26e5d7-881b-4d16-9c8d-5b3310a83446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:30.163009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26e5d7-881b-4d16-9c8d-5b3310a83446 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:30.175098 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1edc-d16d-46e1-bc59-8a8e916e760a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:30.180523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601519a2-9f85-4045-b540-a0ed577621ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:30.181231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601519a2-9f85-4045-b540-a0ed577621ea admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:30.181572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601519a2-9f85-4045-b540-a0ed577621ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:30.181908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601519a2-9f85-4045-b540-a0ed577621ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:30.182682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601519a2-9f85-4045-b540-a0ed577621ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:30.184796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601519a2-9f85-4045-b540-a0ed577621ea admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:30.205089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 975/1962] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:30.212625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601519a2-9f85-4045-b540-a0ed577621ea admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:30.216187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-601519a2-9f85-4045-b540-a0ed577621ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:30.239163 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 988/1963] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:30 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:30.240303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26e5d7-881b-4d16-9c8d-5b3310a83446 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:30.246772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601519a2-9f85-4045-b540-a0ed577621ea admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:30.264148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:30.356640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26e5d7-881b-4d16-9c8d-5b3310a83446 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:30.368841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e3674-1646-44b8-9a93-4d5a64dbd204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:30.369482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e3674-1646-44b8-9a93-4d5a64dbd204 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:30.370165 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e3674-1646-44b8-9a93-4d5a64dbd204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:30.371075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e3674-1646-44b8-9a93-4d5a64dbd204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:30.372513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e3674-1646-44b8-9a93-4d5a64dbd204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:30.373285 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:30.374138 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:30.374452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:30.374725 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] PATH_INFO: `/v3/projects/4bce186313bd4ff693f4cf76d083da6b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:30.377038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e3674-1646-44b8-9a93-4d5a64dbd204 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:30.377944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bce186313bd4ff693f4cf76d083da6b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:30.381552 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:30.401372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 989/1964] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:30.403206 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e3674-1646-44b8-9a93-4d5a64dbd204 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:30.429096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e3674-1646-44b8-9a93-4d5a64dbd204 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:30.451772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4739d4e-101c-45e7-a151-f4f4e86fe03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:30.453934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739d4e-101c-45e7-a151-f4f4e86fe03c admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:30.454657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739d4e-101c-45e7-a151-f4f4e86fe03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:30.455510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739d4e-101c-45e7-a151-f4f4e86fe03c admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:30.460416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4739d4e-101c-45e7-a151-f4f4e86fe03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:30.464680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4739d4e-101c-45e7-a151-f4f4e86fe03c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:30.489927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bce186313bd4ff693f4cf76d083da6b', 'request_id': 'req-ebaffe49-a657-49d8-99f3-3bbfa84f892f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:30.510522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bce186313bd4ff693f4cf76d083da6b', 'request_id': 'req-ebaffe49-a657-49d8-99f3-3bbfa84f892f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:30.514384 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 990/1965] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:30 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:30.516403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4739d4e-101c-45e7-a151-f4f4e86fe03c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:30.530670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4739d4e-101c-45e7-a151-f4f4e86fe03c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:30.531642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bce186313bd4ff693f4cf76d083da6b', 'request_id': 'req-ebaffe49-a657-49d8-99f3-3bbfa84f892f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:30.579033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] The token cache is being invalidate because project 4bce186313bd4ff693f4cf76d083da6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:30.579362 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:30.582586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:30.591925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 976/1966] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:30 2022] DELETE /identity/v3/projects/4bce186313bd4ff693f4cf76d083da6b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:30.594032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:30.608358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:30.608541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a42ad-1d3f-4509-8a3e-ace855835c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:30.608997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a42ad-1d3f-4509-8a3e-ace855835c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:30.609287 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a42ad-1d3f-4509-8a3e-ace855835c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:30.609695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a42ad-1d3f-4509-8a3e-ace855835c7d admin admin] PATH_INFO: `/v3/projects/ce49be2678554e849d69b4ae99f43008/users/89265501b59243b48f679f99782385da/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:30.628097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a42ad-1d3f-4509-8a3e-ace855835c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce49be2678554e849d69b4ae99f43008, user_id=89265501b59243b48f679f99782385da, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:30.632535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a42ad-1d3f-4509-8a3e-ace855835c7d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:30.672392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 991/1967] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:30 2022] PUT /identity/v3/projects/ce49be2678554e849d69b4ae99f43008/users/89265501b59243b48f679f99782385da/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:30.672392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a92a10-e55e-4e2a-bc72-80aaf1ab668f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:30.672392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a92a10-e55e-4e2a-bc72-80aaf1ab668f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:30.672392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a92a10-e55e-4e2a-bc72-80aaf1ab668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:30.690465 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-13a92a10-e55e-4e2a-bc72-80aaf1ab668f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:30.691841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-13a92a10-e55e-4e2a-bc72-80aaf1ab668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:30.703011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:30.805234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 992/1968] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:30.805234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f41ee1-7061-49b8-8565-6169e9898f3f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:30.805234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f41ee1-7061-49b8-8565-6169e9898f3f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:30.805234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f41ee1-7061-49b8-8565-6169e9898f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:30.821448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaffe49-a657-49d8-99f3-3bbfa84f892f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:30.835279 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444ce75-a06c-4553-afdd-bec2f2960b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:30.835486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444ce75-a06c-4553-afdd-bec2f2960b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:30.835708 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444ce75-a06c-4553-afdd-bec2f2960b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:30.835896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444ce75-a06c-4553-afdd-bec2f2960b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:30.836635 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444ce75-a06c-4553-afdd-bec2f2960b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:30.838390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444ce75-a06c-4553-afdd-bec2f2960b0e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:30.850163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 977/1969] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:30.851476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67417e3-989c-4170-94d1-cfc128efd60b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:30.851763 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67417e3-989c-4170-94d1-cfc128efd60b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:30.852042 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67417e3-989c-4170-94d1-cfc128efd60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:30.866361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-75f41ee1-7061-49b8-8565-6169e9898f3f None None] MFA Rules not processed for user `89265501b59243b48f679f99782385da`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:30.867776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-75f41ee1-7061-49b8-8565-6169e9898f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:30.879144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d67417e3-989c-4170-94d1-cfc128efd60b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:30.880332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d67417e3-989c-4170-94d1-cfc128efd60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:30.895772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 978/1970] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:30.895772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67417e3-989c-4170-94d1-cfc128efd60b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:30.921224 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67417e3-989c-4170-94d1-cfc128efd60b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:30.928299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d4733-0bb7-4312-865b-2b434cf2d628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:30.928919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4733-0bb7-4312-865b-2b434cf2d628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:30.929266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4733-0bb7-4312-865b-2b434cf2d628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:30.929657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4733-0bb7-4312-865b-2b434cf2d628 admin admin] PATH_INFO: `/v3/projects/f41827c9daab441fadec5df1778c8f73/users/faac310995f54677abd994ae50df59f2/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:30.946145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d4733-0bb7-4312-865b-2b434cf2d628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41827c9daab441fadec5df1778c8f73, user_id=faac310995f54677abd994ae50df59f2, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:30.951323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 993/1971] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:30.951323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f41ee1-7061-49b8-8565-6169e9898f3f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:30.951547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d4733-0bb7-4312-865b-2b434cf2d628 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:30.965803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f41ee1-7061-49b8-8565-6169e9898f3f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:30.969826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 979/1972] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:30 2022] PUT /identity/v3/projects/f41827c9daab441fadec5df1778c8f73/users/faac310995f54677abd994ae50df59f2/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:30.969826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d4733-0bb7-4312-865b-2b434cf2d628 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:30.969826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ad4d4733-0bb7-4312-865b-2b434cf2d628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:30.985184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:31.037869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5a66e-919e-4929-ae39-ece86d20cb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.040850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a66e-919e-4929-ae39-ece86d20cb7f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.040850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a66e-919e-4929-ae39-ece86d20cb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.040850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a66e-919e-4929-ae39-ece86d20cb7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.042045 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5a66e-919e-4929-ae39-ece86d20cb7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:31.042480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5a66e-919e-4929-ae39-ece86d20cb7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.044386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5a66e-919e-4929-ae39-ece86d20cb7f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.046789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d4733-0bb7-4312-865b-2b434cf2d628 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.055330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097baf6e-5d7b-45ac-ba3a-3ef4b6b46173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.055975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097baf6e-5d7b-45ac-ba3a-3ef4b6b46173 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.056285 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097baf6e-5d7b-45ac-ba3a-3ef4b6b46173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.056565 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097baf6e-5d7b-45ac-ba3a-3ef4b6b46173 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.057234 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097baf6e-5d7b-45ac-ba3a-3ef4b6b46173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.059238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 994/1973] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:31.060530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5a66e-919e-4929-ae39-ece86d20cb7f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.060652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097baf6e-5d7b-45ac-ba3a-3ef4b6b46173 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.072581 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5a66e-919e-4929-ae39-ece86d20cb7f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.078241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c1191-3271-480c-ae33-fa68298c6ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.079076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c1191-3271-480c-ae33-fa68298c6ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.079463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c1191-3271-480c-ae33-fa68298c6ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.079866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c1191-3271-480c-ae33-fa68298c6ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.080713 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c1191-3271-480c-ae33-fa68298c6ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.082436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c1191-3271-480c-ae33-fa68298c6ea9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.096951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 995/1974] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:31.101498 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c1191-3271-480c-ae33-fa68298c6ea9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.111006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 980/1975] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:30 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:31.111847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097baf6e-5d7b-45ac-ba3a-3ef4b6b46173 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.116585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c1191-3271-480c-ae33-fa68298c6ea9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.145523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:31.195707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097baf6e-5d7b-45ac-ba3a-3ef4b6b46173 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.197292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccabcf-c13f-4658-b745-73191d5af9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.199176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccabcf-c13f-4658-b745-73191d5af9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.199574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccabcf-c13f-4658-b745-73191d5af9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.199993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccabcf-c13f-4658-b745-73191d5af9e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.201372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddccabcf-c13f-4658-b745-73191d5af9e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.204434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddccabcf-c13f-4658-b745-73191d5af9e9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.205070 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c56c46-dec0-4b46-b0f8-a9f4ce14affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.206075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c56c46-dec0-4b46-b0f8-a9f4ce14affa admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.206519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c56c46-dec0-4b46-b0f8-a9f4ce14affa admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.206907 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c56c46-dec0-4b46-b0f8-a9f4ce14affa admin admin] PATH_INFO: `/v3/projects/f41827c9daab441fadec5df1778c8f73/users/faac310995f54677abd994ae50df59f2/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.209414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c56c46-dec0-4b46-b0f8-a9f4ce14affa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41827c9daab441fadec5df1778c8f73, user_id=faac310995f54677abd994ae50df59f2, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.213297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c56c46-dec0-4b46-b0f8-a9f4ce14affa admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.237093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 981/1976] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:31 2022] PUT /identity/v3/projects/f41827c9daab441fadec5df1778c8f73/users/faac310995f54677abd994ae50df59f2/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:31.237093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c56c46-dec0-4b46-b0f8-a9f4ce14affa admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.249215 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 996/1977] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:31 2022] POST /identity/v3/projects => generated 409 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:31.251231 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aec54f-d424-4488-b8b2-4ede50b47043 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.251529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aec54f-d424-4488-b8b2-4ede50b47043 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.251809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aec54f-d424-4488-b8b2-4ede50b47043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.288414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-23aec54f-d424-4488-b8b2-4ede50b47043 None None] MFA Rules not processed for user `faac310995f54677abd994ae50df59f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:31.289807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-23aec54f-d424-4488-b8b2-4ede50b47043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:31.323106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c56c46-dec0-4b46-b0f8-a9f4ce14affa admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.379551 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 997/1978] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:31.380674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aec54f-d424-4488-b8b2-4ede50b47043 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.385242 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:31.420644 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb7ee8-83eb-48d5-8337-89a876e8a098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.421464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7ee8-83eb-48d5-8337-89a876e8a098 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.421726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7ee8-83eb-48d5-8337-89a876e8a098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.422003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7ee8-83eb-48d5-8337-89a876e8a098 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.422682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb7ee8-83eb-48d5-8337-89a876e8a098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.424736 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb7ee8-83eb-48d5-8337-89a876e8a098 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.458966 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 982/1979] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:31 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:31.460382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb7ee8-83eb-48d5-8337-89a876e8a098 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.462229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b7cb7ee8-83eb-48d5-8337-89a876e8a098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:31.484866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aec54f-d424-4488-b8b2-4ede50b47043 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.494717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bf285-5639-4d12-94f8-ebc41e90831a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.495409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bf285-5639-4d12-94f8-ebc41e90831a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.495650 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bf285-5639-4d12-94f8-ebc41e90831a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.495914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bf285-5639-4d12-94f8-ebc41e90831a admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.496644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bf285-5639-4d12-94f8-ebc41e90831a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.498654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bf285-5639-4d12-94f8-ebc41e90831a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.523941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 998/1980] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:31 2022] POST /identity/v3/users => generated 305 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:31.524822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bf285-5639-4d12-94f8-ebc41e90831a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.530390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb7ee8-83eb-48d5-8337-89a876e8a098 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.534110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9181e8-3c2c-4876-a492-de584735e7a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.534657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bf285-5639-4d12-94f8-ebc41e90831a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.534910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9181e8-3c2c-4876-a492-de584735e7a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.535264 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9181e8-3c2c-4876-a492-de584735e7a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.535538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9181e8-3c2c-4876-a492-de584735e7a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.537284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8d9181e8-3c2c-4876-a492-de584735e7a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:31.539590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6d659-0181-49f9-9445-7eb0356c5171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.540246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6d659-0181-49f9-9445-7eb0356c5171 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.540530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6d659-0181-49f9-9445-7eb0356c5171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.540811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6d659-0181-49f9-9445-7eb0356c5171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.541621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6d659-0181-49f9-9445-7eb0356c5171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.543438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6d659-0181-49f9-9445-7eb0356c5171 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.556132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 999/1981] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:31.557089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6d659-0181-49f9-9445-7eb0356c5171 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.567687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6d659-0181-49f9-9445-7eb0356c5171 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.572576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ce672-8700-475b-9179-21a1b1271ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.573205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ce672-8700-475b-9179-21a1b1271ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.573492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ce672-8700-475b-9179-21a1b1271ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.573770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ce672-8700-475b-9179-21a1b1271ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.574475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ce672-8700-475b-9179-21a1b1271ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.576259 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ce672-8700-475b-9179-21a1b1271ec6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.588751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1000/1982] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:31.592815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ce672-8700-475b-9179-21a1b1271ec6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.600690 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:31.607161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ce672-8700-475b-9179-21a1b1271ec6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.609327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9181e8-3c2c-4876-a492-de584735e7a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.610963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9181e8-3c2c-4876-a492-de584735e7a8 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.615066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b536d-a56e-431c-9ba6-ca87adac1b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.615781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b536d-a56e-431c-9ba6-ca87adac1b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.617071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b536d-a56e-431c-9ba6-ca87adac1b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.617071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b536d-a56e-431c-9ba6-ca87adac1b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.617287 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b536d-a56e-431c-9ba6-ca87adac1b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.619120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b536d-a56e-431c-9ba6-ca87adac1b59 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.622829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 983/1983] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:31.623744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9181e8-3c2c-4876-a492-de584735e7a8 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.636632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1001/1984] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:31.641608 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b536d-a56e-431c-9ba6-ca87adac1b59 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.647176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9181e8-3c2c-4876-a492-de584735e7a8 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.653950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fbecf-0444-433e-a2fc-7a65e6cca64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.654599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fbecf-0444-433e-a2fc-7a65e6cca64d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.654935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fbecf-0444-433e-a2fc-7a65e6cca64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.655290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fbecf-0444-433e-a2fc-7a65e6cca64d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.656112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fbecf-0444-433e-a2fc-7a65e6cca64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.657719 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b536d-a56e-431c-9ba6-ca87adac1b59 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.657852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fbecf-0444-433e-a2fc-7a65e6cca64d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.664326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423cfcd-c018-4beb-aa7b-1e2bbb376d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.665322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423cfcd-c018-4beb-aa7b-1e2bbb376d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.665961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423cfcd-c018-4beb-aa7b-1e2bbb376d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.666430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423cfcd-c018-4beb-aa7b-1e2bbb376d98 admin admin] PATH_INFO: `/v3/projects/fa58637c9e6f4af181e0efde7e5822a1/users/32ef6c6856cf4eabaf6586e67e7dfa50/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.673886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 984/1985] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:31.676318 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fbecf-0444-433e-a2fc-7a65e6cca64d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.690420 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fbecf-0444-433e-a2fc-7a65e6cca64d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:31.692216 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423cfcd-c018-4beb-aa7b-1e2bbb376d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa58637c9e6f4af181e0efde7e5822a1, user_id=32ef6c6856cf4eabaf6586e67e7dfa50, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.695271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423cfcd-c018-4beb-aa7b-1e2bbb376d98 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.699724 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313e5e-ee70-4889-ab5a-facb6922d841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:31.700832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313e5e-ee70-4889-ab5a-facb6922d841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.701776 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313e5e-ee70-4889-ab5a-facb6922d841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.702099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313e5e-ee70-4889-ab5a-facb6922d841 admin admin] PATH_INFO: `/v3/projects/3a3a4e07c5bf4c3fb413aa4ff117e6c2/users/dd340fef8cf44c2aba2d0bb9cb88840f/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.716348 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1002/1986] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:31 2022] PUT /identity/v3/projects/fa58637c9e6f4af181e0efde7e5822a1/users/32ef6c6856cf4eabaf6586e67e7dfa50/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:31.722214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313e5e-ee70-4889-ab5a-facb6922d841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3a4e07c5bf4c3fb413aa4ff117e6c2, user_id=dd340fef8cf44c2aba2d0bb9cb88840f, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:31.724997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313e5e-ee70-4889-ab5a-facb6922d841 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:31.727522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e357418-e579-47c3-913e-e9b762051017 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.727819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e357418-e579-47c3-913e-e9b762051017 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.728134 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e357418-e579-47c3-913e-e9b762051017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.753685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 985/1987] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:31 2022] PUT /identity/v3/projects/3a3a4e07c5bf4c3fb413aa4ff117e6c2/users/dd340fef8cf44c2aba2d0bb9cb88840f/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:31.766126 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d82b4-5d30-4bbe-805d-853f40bb5f3d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:31.766686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d82b4-5d30-4bbe-805d-853f40bb5f3d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:31.767166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d82b4-5d30-4bbe-805d-853f40bb5f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:31.780043 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0e357418-e579-47c3-913e-e9b762051017 None None] MFA Rules not processed for user `32ef6c6856cf4eabaf6586e67e7dfa50`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:31.781372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0e357418-e579-47c3-913e-e9b762051017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:31.819254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-904d82b4-5d30-4bbe-805d-853f40bb5f3d None None] MFA Rules not processed for user `dd340fef8cf44c2aba2d0bb9cb88840f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:31.820736 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-904d82b4-5d30-4bbe-805d-853f40bb5f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:31.902113 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1003/1988] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:31.903051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:31.907176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e357418-e579-47c3-913e-e9b762051017 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:31.942019 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 986/1989] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:31 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:31.946902 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d82b4-5d30-4bbe-805d-853f40bb5f3d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.056149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e357418-e579-47c3-913e-e9b762051017 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.056149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc71ab0-b2d6-4803-bfa5-de92d8d70ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.056149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc71ab0-b2d6-4803-bfa5-de92d8d70ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.056149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc71ab0-b2d6-4803-bfa5-de92d8d70ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.057117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc71ab0-b2d6-4803-bfa5-de92d8d70ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.057117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc71ab0-b2d6-4803-bfa5-de92d8d70ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.057368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d82b4-5d30-4bbe-805d-853f40bb5f3d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.057509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc71ab0-b2d6-4803-bfa5-de92d8d70ebe admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.071728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963efda-4b35-4d34-97a8-951a5f9549b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.072690 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963efda-4b35-4d34-97a8-951a5f9549b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.072920 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963efda-4b35-4d34-97a8-951a5f9549b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.073379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963efda-4b35-4d34-97a8-951a5f9549b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.074223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963efda-4b35-4d34-97a8-951a5f9549b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.076657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963efda-4b35-4d34-97a8-951a5f9549b3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.104173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1004/1990] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:31 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:32.108182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc71ab0-b2d6-4803-bfa5-de92d8d70ebe admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.113253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 987/1991] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:31 2022] POST /identity/v3/projects => generated 409 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:32.117139 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963efda-4b35-4d34-97a8-951a5f9549b3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.166337 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:32.194884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc71ab0-b2d6-4803-bfa5-de92d8d70ebe admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.251739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963efda-4b35-4d34-97a8-951a5f9549b3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.259534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec066752-a3e6-44e9-8ade-a10b637d52bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.260537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec066752-a3e6-44e9-8ade-a10b637d52bb admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.261017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec066752-a3e6-44e9-8ade-a10b637d52bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.261443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec066752-a3e6-44e9-8ade-a10b637d52bb admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.263130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec066752-a3e6-44e9-8ade-a10b637d52bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.264460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec066752-a3e6-44e9-8ade-a10b637d52bb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.305460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 988/1992] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:32 2022] POST /identity/v3/users => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:32.307949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec066752-a3e6-44e9-8ade-a10b637d52bb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.322194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aeba7-e520-47a9-b272-e520228bc946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.322933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aeba7-e520-47a9-b272-e520228bc946 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.323341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aeba7-e520-47a9-b272-e520228bc946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.324173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aeba7-e520-47a9-b272-e520228bc946 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.325143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5aeba7-e520-47a9-b272-e520228bc946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.327215 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5aeba7-e520-47a9-b272-e520228bc946 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.341698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec066752-a3e6-44e9-8ade-a10b637d52bb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.350471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d985a0-29bd-4ed1-a449-09707eccaec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.352105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d985a0-29bd-4ed1-a449-09707eccaec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.352622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d985a0-29bd-4ed1-a449-09707eccaec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.353041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d985a0-29bd-4ed1-a449-09707eccaec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.354423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d985a0-29bd-4ed1-a449-09707eccaec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.358212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d985a0-29bd-4ed1-a449-09707eccaec8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.368432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1005/1993] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:32 2022] POST /identity/v3/users => generated 295 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:32.370241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aeba7-e520-47a9-b272-e520228bc946 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.378333 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 989/1994] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:32.383373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d985a0-29bd-4ed1-a449-09707eccaec8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.395234 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d985a0-29bd-4ed1-a449-09707eccaec8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.395809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aeba7-e520-47a9-b272-e520228bc946 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.402618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aa3ba-3bff-41e9-b4ff-c7d7d40e8f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.403495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aa3ba-3bff-41e9-b4ff-c7d7d40e8f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.403786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aa3ba-3bff-41e9-b4ff-c7d7d40e8f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.404073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aa3ba-3bff-41e9-b4ff-c7d7d40e8f3e admin admin] PATH_INFO: `/v3/projects/04a2efa1a43c475eaf322602d4327253/users/3963a8d62bda438298052c8d08b107d6/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.406246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66800ce-f74e-459d-9981-2e993f815537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.406982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66800ce-f74e-459d-9981-2e993f815537 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.407181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66800ce-f74e-459d-9981-2e993f815537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.407469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66800ce-f74e-459d-9981-2e993f815537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.408270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66800ce-f74e-459d-9981-2e993f815537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.410126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66800ce-f74e-459d-9981-2e993f815537 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.432067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aa3ba-3bff-41e9-b4ff-c7d7d40e8f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a2efa1a43c475eaf322602d4327253, user_id=3963a8d62bda438298052c8d08b107d6, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.433518 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1006/1995] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:32.434711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66800ce-f74e-459d-9981-2e993f815537 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.435702 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aa3ba-3bff-41e9-b4ff-c7d7d40e8f3e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.451017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66800ce-f74e-459d-9981-2e993f815537 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.453251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 990/1996] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:32 2022] PUT /identity/v3/projects/04a2efa1a43c475eaf322602d4327253/users/3963a8d62bda438298052c8d08b107d6/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:32.460850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aa3ba-3bff-41e9-b4ff-c7d7d40e8f3e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.488036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:32.553770 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aa3ba-3bff-41e9-b4ff-c7d7d40e8f3e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.570273 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a718c44-1dbe-4307-a39e-9c6b2632eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.570729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b11d40-df54-4cdb-b1be-a82d6f3b36c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.571146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a718c44-1dbe-4307-a39e-9c6b2632eb47 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.571534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a718c44-1dbe-4307-a39e-9c6b2632eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.571914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a718c44-1dbe-4307-a39e-9c6b2632eb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.572208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b11d40-df54-4cdb-b1be-a82d6f3b36c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.572869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a718c44-1dbe-4307-a39e-9c6b2632eb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.573156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b11d40-df54-4cdb-b1be-a82d6f3b36c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.573581 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b11d40-df54-4cdb-b1be-a82d6f3b36c9 admin admin] PATH_INFO: `/v3/projects/abd53bbbdebc46d5aa8f6ba94c2aa783/users/9882c450e2274886acac5168527585e8/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.574769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a718c44-1dbe-4307-a39e-9c6b2632eb47 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.594417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 991/1997] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:32.596442 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a718c44-1dbe-4307-a39e-9c6b2632eb47 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.599108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b11d40-df54-4cdb-b1be-a82d6f3b36c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd53bbbdebc46d5aa8f6ba94c2aa783, user_id=9882c450e2274886acac5168527585e8, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.604633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b11d40-df54-4cdb-b1be-a82d6f3b36c9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.615217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a718c44-1dbe-4307-a39e-9c6b2632eb47 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.621432 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3784c-0acf-4636-8175-c2ed939916df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.622508 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3784c-0acf-4636-8175-c2ed939916df admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.623050 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3784c-0acf-4636-8175-c2ed939916df admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.623471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3784c-0acf-4636-8175-c2ed939916df admin admin] PATH_INFO: `/v3/projects/04a2efa1a43c475eaf322602d4327253/users/3963a8d62bda438298052c8d08b107d6/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.626021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1007/1998] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:32 2022] PUT /identity/v3/projects/abd53bbbdebc46d5aa8f6ba94c2aa783/users/9882c450e2274886acac5168527585e8/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:32.626655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3784c-0acf-4636-8175-c2ed939916df admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a2efa1a43c475eaf322602d4327253, user_id=3963a8d62bda438298052c8d08b107d6, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.629367 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3784c-0acf-4636-8175-c2ed939916df admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.629725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b11d40-df54-4cdb-b1be-a82d6f3b36c9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.640873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 992/1999] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:32 2022] PUT /identity/v3/projects/04a2efa1a43c475eaf322602d4327253/users/3963a8d62bda438298052c8d08b107d6/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:32.653198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea101c9d-9a8a-470c-9245-911bb284ad44 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.653736 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea101c9d-9a8a-470c-9245-911bb284ad44 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.654114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea101c9d-9a8a-470c-9245-911bb284ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.692181 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ea101c9d-9a8a-470c-9245-911bb284ad44 None None] MFA Rules not processed for user `3963a8d62bda438298052c8d08b107d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:32.693541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ea101c9d-9a8a-470c-9245-911bb284ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:32.699556 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:32.713663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b11d40-df54-4cdb-b1be-a82d6f3b36c9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.768358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 993/2000] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:32 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:32.775104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af64336-8ad1-4548-a0e9-a2c272879c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.775757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af64336-8ad1-4548-a0e9-a2c272879c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.776045 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af64336-8ad1-4548-a0e9-a2c272879c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.776379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af64336-8ad1-4548-a0e9-a2c272879c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.777088 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af64336-8ad1-4548-a0e9-a2c272879c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.778803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af64336-8ad1-4548-a0e9-a2c272879c14 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.779262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea101c9d-9a8a-470c-9245-911bb284ad44 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.781330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ea101c9d-9a8a-470c-9245-911bb284ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:32.792572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1008/2001] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:32.793720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af64336-8ad1-4548-a0e9-a2c272879c14 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.805528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af64336-8ad1-4548-a0e9-a2c272879c14 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.811369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1ec39-9109-499e-acbe-b6fdb5b289c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.812024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1ec39-9109-499e-acbe-b6fdb5b289c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.812559 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1ec39-9109-499e-acbe-b6fdb5b289c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.812843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1ec39-9109-499e-acbe-b6fdb5b289c7 admin admin] PATH_INFO: `/v3/projects/abd53bbbdebc46d5aa8f6ba94c2aa783/users/9882c450e2274886acac5168527585e8/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.814821 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1ec39-9109-499e-acbe-b6fdb5b289c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd53bbbdebc46d5aa8f6ba94c2aa783, user_id=9882c450e2274886acac5168527585e8, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.817501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1ec39-9109-499e-acbe-b6fdb5b289c7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.828192 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1009/2002] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:32 2022] PUT /identity/v3/projects/abd53bbbdebc46d5aa8f6ba94c2aa783/users/9882c450e2274886acac5168527585e8/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:32.838363 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a348-59bd-48de-8fbf-b41bbb726e38 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.838653 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a348-59bd-48de-8fbf-b41bbb726e38 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.838928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a348-59bd-48de-8fbf-b41bbb726e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.841811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea101c9d-9a8a-470c-9245-911bb284ad44 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.867533 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5482a348-59bd-48de-8fbf-b41bbb726e38 None None] MFA Rules not processed for user `9882c450e2274886acac5168527585e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:32.868769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5482a348-59bd-48de-8fbf-b41bbb726e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:32.882475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:32.893720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bb8cc-8ff0-4cff-a776-4f53100352a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.894335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bb8cc-8ff0-4cff-a776-4f53100352a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.894625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bb8cc-8ff0-4cff-a776-4f53100352a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.894954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bb8cc-8ff0-4cff-a776-4f53100352a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:32.947148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1010/2003] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:32.961023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482a348-59bd-48de-8fbf-b41bbb726e38 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:32.962673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bb8cc-8ff0-4cff-a776-4f53100352a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:32.964136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bb8cc-8ff0-4cff-a776-4f53100352a7 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:32.972587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482a348-59bd-48de-8fbf-b41bbb726e38 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:32.976394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 994/2004] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:32 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:32.976562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026e549-46a2-4032-9fe1-f245b708fc2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:32.977097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026e549-46a2-4032-9fe1-f245b708fc2f service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:32.977445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026e549-46a2-4032-9fe1-f245b708fc2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:32.977720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026e549-46a2-4032-9fe1-f245b708fc2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:33.044877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026e549-46a2-4032-9fe1-f245b708fc2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:33.047444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026e549-46a2-4032-9fe1-f245b708fc2f service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:33.065911 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1011/2005] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:33.158368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bb8cc-8ff0-4cff-a776-4f53100352a7 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:33.167597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bb8cc-8ff0-4cff-a776-4f53100352a7 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:33.172344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9680f-7ab2-42dc-867e-975c139316c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:33.172992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9680f-7ab2-42dc-867e-975c139316c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:33.173307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9680f-7ab2-42dc-867e-975c139316c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:33.173582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9680f-7ab2-42dc-867e-975c139316c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:33.252803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9680f-7ab2-42dc-867e-975c139316c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:33.254505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9680f-7ab2-42dc-867e-975c139316c8 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:33.265482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 995/2006] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:33 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:38.965376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026e549-46a2-4032-9fe1-f245b708fc2f service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:38.981657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026e549-46a2-4032-9fe1-f245b708fc2f service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:38.981657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39164927-2192-4a99-96dd-7a3815c39cce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:38.981657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164927-2192-4a99-96dd-7a3815c39cce service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:38.981657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164927-2192-4a99-96dd-7a3815c39cce service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:38.981968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164927-2192-4a99-96dd-7a3815c39cce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:38.985369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:39.063989 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39164927-2192-4a99-96dd-7a3815c39cce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:39.064344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39164927-2192-4a99-96dd-7a3815c39cce service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:39.079646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1012/2007] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:40.012897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9680f-7ab2-42dc-867e-975c139316c8 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:40.026065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9680f-7ab2-42dc-867e-975c139316c8 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:40.031917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2958e-37b3-4712-b9f6-a0f696373cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:40.032670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2958e-37b3-4712-b9f6-a0f696373cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:40.032955 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2958e-37b3-4712-b9f6-a0f696373cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:40.033231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2958e-37b3-4712-b9f6-a0f696373cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:40.045739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2958e-37b3-4712-b9f6-a0f696373cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:40.047938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2958e-37b3-4712-b9f6-a0f696373cd3 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:40.059106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 996/2008] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:46.041816 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39164927-2192-4a99-96dd-7a3815c39cce service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:46.057378 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39164927-2192-4a99-96dd-7a3815c39cce service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:46.063060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585f670-6353-4284-a386-00ba3b5f16e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:46.063710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f670-6353-4284-a386-00ba3b5f16e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:46.064000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f670-6353-4284-a386-00ba3b5f16e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:46.064310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f670-6353-4284-a386-00ba3b5f16e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:46.133688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585f670-6353-4284-a386-00ba3b5f16e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:46.135576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585f670-6353-4284-a386-00ba3b5f16e8 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:46.147111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1013/2009] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:47.666939 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2958e-37b3-4712-b9f6-a0f696373cd3 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:47.735158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2958e-37b3-4712-b9f6-a0f696373cd3 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:47.739892 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:47.740511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:47.740796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:47.741072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] PATH_INFO: `/v3/users/dd340fef8cf44c2aba2d0bb9cb88840f` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:47.742238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd340fef8cf44c2aba2d0bb9cb88840f)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:47.744185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:47.767728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:47.797561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd340fef8cf44c2aba2d0bb9cb88840f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:47.798734 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd340fef8cf44c2aba2d0bb9cb88840f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:47.813612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd340fef8cf44c2aba2d0bb9cb88840f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:47.822191 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd340fef8cf44c2aba2d0bb9cb88840f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:47.830537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd340fef8cf44c2aba2d0bb9cb88840f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:47.837595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 997/2010] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:47 2022] DELETE /identity/v3/users/dd340fef8cf44c2aba2d0bb9cb88840f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:47.842344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0c3a2-7ed7-4d29-bb84-be19feb14688 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:47.842876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0c3a2-7ed7-4d29-bb84-be19feb14688 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:47.843044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0c3a2-7ed7-4d29-bb84-be19feb14688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:47.867949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8db0c3a2-7ed7-4d29-bb84-be19feb14688 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:47.869196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8db0c3a2-7ed7-4d29-bb84-be19feb14688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:47.938118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1014/2011] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:47.949837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:47.952279 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:48.041322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e1fae-244c-4805-a0f5-70561b524cad admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:48.045026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c97a3b-e31e-4e61-9594-be46ad4cea24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:48.045863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c97a3b-e31e-4e61-9594-be46ad4cea24 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:48.046171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c97a3b-e31e-4e61-9594-be46ad4cea24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:48.046454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c97a3b-e31e-4e61-9594-be46ad4cea24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:48.056927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c97a3b-e31e-4e61-9594-be46ad4cea24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:48.058591 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c97a3b-e31e-4e61-9594-be46ad4cea24 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:48.070110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 998/2012] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:48.393116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0c3a2-7ed7-4d29-bb84-be19feb14688 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:48.395201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8db0c3a2-7ed7-4d29-bb84-be19feb14688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:48.407658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0c3a2-7ed7-4d29-bb84-be19feb14688 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:48.414288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:48.415289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:48.415699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:48.416173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] PATH_INFO: `/v3/projects/3a3a4e07c5bf4c3fb413aa4ff117e6c2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:48.417597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3a4e07c5bf4c3fb413aa4ff117e6c2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:48.419546 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:48.461822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:48.472628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3a4e07c5bf4c3fb413aa4ff117e6c2', 'request_id': 'req-9c251495-1120-46bd-bdd9-2816edb757d0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:48.478406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3a4e07c5bf4c3fb413aa4ff117e6c2', 'request_id': 'req-9c251495-1120-46bd-bdd9-2816edb757d0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:48.486304 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3a4e07c5bf4c3fb413aa4ff117e6c2', 'request_id': 'req-9c251495-1120-46bd-bdd9-2816edb757d0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:48.498122 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] The token cache is being invalidate because project 3a3a4e07c5bf4c3fb413aa4ff117e6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:48.498352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:48.499131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:48.501198 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1015/2013] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:48 2022] DELETE /identity/v3/projects/3a3a4e07c5bf4c3fb413aa4ff117e6c2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:48.505267 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c97a3b-e31e-4e61-9594-be46ad4cea24 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:48.515511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c97a3b-e31e-4e61-9594-be46ad4cea24 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:48.572961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3502480-b3e0-4b78-9685-82bf866c4449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:48.573614 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502480-b3e0-4b78-9685-82bf866c4449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:48.574017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502480-b3e0-4b78-9685-82bf866c4449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:48.574185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502480-b3e0-4b78-9685-82bf866c4449 admin admin] PATH_INFO: `/v3/users/3963a8d62bda438298052c8d08b107d6` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:48.575544 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3502480-b3e0-4b78-9685-82bf866c4449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3963a8d62bda438298052c8d08b107d6)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:48.577827 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3502480-b3e0-4b78-9685-82bf866c4449 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:48.626104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:48.637792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d3502480-b3e0-4b78-9685-82bf866c4449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3963a8d62bda438298052c8d08b107d6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:48.638692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d3502480-b3e0-4b78-9685-82bf866c4449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3963a8d62bda438298052c8d08b107d6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:48.654892 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d3502480-b3e0-4b78-9685-82bf866c4449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3963a8d62bda438298052c8d08b107d6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:48.673969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d3502480-b3e0-4b78-9685-82bf866c4449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3963a8d62bda438298052c8d08b107d6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:48.681759 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d3502480-b3e0-4b78-9685-82bf866c4449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3963a8d62bda438298052c8d08b107d6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:48.688523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 999/2014] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:48 2022] DELETE /identity/v3/users/3963a8d62bda438298052c8d08b107d6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:49.001567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:49.004403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:49.028242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c251495-1120-46bd-bdd9-2816edb757d0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:49.129444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4398d46-c627-4396-92d1-c8aadf526505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:49.130118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4398d46-c627-4396-92d1-c8aadf526505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.130402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4398d46-c627-4396-92d1-c8aadf526505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.130678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4398d46-c627-4396-92d1-c8aadf526505 admin admin] PATH_INFO: `/v3/projects/04a2efa1a43c475eaf322602d4327253` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.131972 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4398d46-c627-4396-92d1-c8aadf526505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a2efa1a43c475eaf322602d4327253)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:49.134139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4398d46-c627-4396-92d1-c8aadf526505 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:49.204645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b4398d46-c627-4396-92d1-c8aadf526505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a2efa1a43c475eaf322602d4327253', 'request_id': 'req-b4398d46-c627-4396-92d1-c8aadf526505'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:49.225489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b4398d46-c627-4396-92d1-c8aadf526505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a2efa1a43c475eaf322602d4327253', 'request_id': 'req-b4398d46-c627-4396-92d1-c8aadf526505'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:49.236041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b4398d46-c627-4396-92d1-c8aadf526505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a2efa1a43c475eaf322602d4327253', 'request_id': 'req-b4398d46-c627-4396-92d1-c8aadf526505'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:49.252936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b4398d46-c627-4396-92d1-c8aadf526505 admin admin] The token cache is being invalidate because project 04a2efa1a43c475eaf322602d4327253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:49.253269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b4398d46-c627-4396-92d1-c8aadf526505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:49.253946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b4398d46-c627-4396-92d1-c8aadf526505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:49.255749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1016/2015] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:49 2022] DELETE /identity/v3/projects/04a2efa1a43c475eaf322602d4327253 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:49.260783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63ea1-ba1d-405c-9e70-53f7ccdbbdb2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.261035 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63ea1-ba1d-405c-9e70-53f7ccdbbdb2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.261363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63ea1-ba1d-405c-9e70-53f7ccdbbdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.284644 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b6a63ea1-ba1d-405c-9e70-53f7ccdbbdb2 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:49.285693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b6a63ea1-ba1d-405c-9e70-53f7ccdbbdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:49.382904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1000/2016] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:49.392118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fe7a1-a20d-40e4-b694-7d1f22a9b930 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.392402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fe7a1-a20d-40e4-b694-7d1f22a9b930 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.392847 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fe7a1-a20d-40e4-b694-7d1f22a9b930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.408494 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63ea1-ba1d-405c-9e70-53f7ccdbbdb2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:49.409937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b6a63ea1-ba1d-405c-9e70-53f7ccdbbdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:49.417632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3b9fe7a1-a20d-40e4-b694-7d1f22a9b930 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:49.419719 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3b9fe7a1-a20d-40e4-b694-7d1f22a9b930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:49.423754 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63ea1-ba1d-405c-9e70-53f7ccdbbdb2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:49.428791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6928e5-81a8-4986-a2f1-13226fe416a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:49.432209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1017/2017] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:49.432358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6928e5-81a8-4986-a2f1-13226fe416a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.432358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6928e5-81a8-4986-a2f1-13226fe416a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.432358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6928e5-81a8-4986-a2f1-13226fe416a7 admin admin] PATH_INFO: `/v3/users/1a7c15945c564467b5c13327b167f7ad` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.432358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6928e5-81a8-4986-a2f1-13226fe416a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7c15945c564467b5c13327b167f7ad)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:49.433321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fe7a1-a20d-40e4-b694-7d1f22a9b930 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:49.434006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6928e5-81a8-4986-a2f1-13226fe416a7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:49.444169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fe7a1-a20d-40e4-b694-7d1f22a9b930 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:49.448923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485300-d8cc-422a-84e9-be4e3f61fa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:49.449541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485300-d8cc-422a-84e9-be4e3f61fa81 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.450025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485300-d8cc-422a-84e9-be4e3f61fa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.450307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485300-d8cc-422a-84e9-be4e3f61fa81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.451020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485300-d8cc-422a-84e9-be4e3f61fa81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:49.451301 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485300-d8cc-422a-84e9-be4e3f61fa81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:49.453562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485300-d8cc-422a-84e9-be4e3f61fa81 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:49.470565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1018/2018] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:49.471555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485300-d8cc-422a-84e9-be4e3f61fa81 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:49.483739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485300-d8cc-422a-84e9-be4e3f61fa81 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:49.496340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d931a9-dae5-4201-90ae-51a72b8fc09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:49.496340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d931a9-dae5-4201-90ae-51a72b8fc09b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.496340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d931a9-dae5-4201-90ae-51a72b8fc09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.496340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d931a9-dae5-4201-90ae-51a72b8fc09b admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.496679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d931a9-dae5-4201-90ae-51a72b8fc09b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:49.496679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d931a9-dae5-4201-90ae-51a72b8fc09b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:49.496835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ce6928e5-81a8-4986-a2f1-13226fe416a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7c15945c564467b5c13327b167f7ad'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:49.496835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ce6928e5-81a8-4986-a2f1-13226fe416a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7c15945c564467b5c13327b167f7ad'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:49.511029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ce6928e5-81a8-4986-a2f1-13226fe416a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7c15945c564467b5c13327b167f7ad'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:49.520928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ce6928e5-81a8-4986-a2f1-13226fe416a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7c15945c564467b5c13327b167f7ad'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:49.529166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ce6928e5-81a8-4986-a2f1-13226fe416a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7c15945c564467b5c13327b167f7ad'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:49.536800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1001/2019] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:49 2022] DELETE /identity/v3/users/1a7c15945c564467b5c13327b167f7ad => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:49.539941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1019/2020] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:49 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:49.543783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24432ab4-8d72-46d1-91a2-3613cfb0b2b8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.544073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24432ab4-8d72-46d1-91a2-3613cfb0b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.544935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24432ab4-8d72-46d1-91a2-3613cfb0b2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.545330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d931a9-dae5-4201-90ae-51a72b8fc09b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:49.547224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-77d931a9-dae5-4201-90ae-51a72b8fc09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:49.562639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:49.567188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-24432ab4-8d72-46d1-91a2-3613cfb0b2b8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:49.568991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-24432ab4-8d72-46d1-91a2-3613cfb0b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:49.602367 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:49.644864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1002/2021] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:49.650678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d931a9-dae5-4201-90ae-51a72b8fc09b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:49.656094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa82ee4-92a5-4b8c-9ee6-2fba5f627701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:49.656523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24432ab4-8d72-46d1-91a2-3613cfb0b2b8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:49.656911 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa82ee4-92a5-4b8c-9ee6-2fba5f627701 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.657866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa82ee4-92a5-4b8c-9ee6-2fba5f627701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.658275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa82ee4-92a5-4b8c-9ee6-2fba5f627701 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.658752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-24432ab4-8d72-46d1-91a2-3613cfb0b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:49.659063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa82ee4-92a5-4b8c-9ee6-2fba5f627701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:49.661502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa82ee4-92a5-4b8c-9ee6-2fba5f627701 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:49.691512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1020/2022] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:49 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:49.695687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa82ee4-92a5-4b8c-9ee6-2fba5f627701 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:49.709933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa82ee4-92a5-4b8c-9ee6-2fba5f627701 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:49.714767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3402b6-0e3e-40f9-9f5e-c2085ca71596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:49.715387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3402b6-0e3e-40f9-9f5e-c2085ca71596 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.715677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3402b6-0e3e-40f9-9f5e-c2085ca71596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.715945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3402b6-0e3e-40f9-9f5e-c2085ca71596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.716686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3402b6-0e3e-40f9-9f5e-c2085ca71596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:49.718328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3402b6-0e3e-40f9-9f5e-c2085ca71596 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:49.723967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24432ab4-8d72-46d1-91a2-3613cfb0b2b8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:49.728004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597eb32-2d3c-459a-8869-28f593cf0f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:49.728418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597eb32-2d3c-459a-8869-28f593cf0f86 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.728682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597eb32-2d3c-459a-8869-28f593cf0f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.728964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597eb32-2d3c-459a-8869-28f593cf0f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.729796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1021/2023] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:49.736141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3402b6-0e3e-40f9-9f5e-c2085ca71596 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:49.739850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597eb32-2d3c-459a-8869-28f593cf0f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:49.741331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597eb32-2d3c-459a-8869-28f593cf0f86 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:49.746875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3402b6-0e3e-40f9-9f5e-c2085ca71596 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:49.752240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1003/2024] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:49.753298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6752ee-89cf-460e-91af-ec9179e0b7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:49.753911 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6752ee-89cf-460e-91af-ec9179e0b7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.754194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6752ee-89cf-460e-91af-ec9179e0b7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.754468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6752ee-89cf-460e-91af-ec9179e0b7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.755184 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6752ee-89cf-460e-91af-ec9179e0b7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:49.756776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6752ee-89cf-460e-91af-ec9179e0b7a1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:49.771304 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1022/2025] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:49.773061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597eb32-2d3c-459a-8869-28f593cf0f86 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:49.782968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597eb32-2d3c-459a-8869-28f593cf0f86 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:49.787654 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d7e17-099e-4b0e-922d-250ff058ab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:49.788365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d7e17-099e-4b0e-922d-250ff058ab08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.788652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d7e17-099e-4b0e-922d-250ff058ab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.788932 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d7e17-099e-4b0e-922d-250ff058ab08 admin admin] PATH_INFO: `/v3/projects/711410e08cc341a4b63f00f0aad433fb/users/45d7a153d79e4e458ea29138161d0947/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.807259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d7e17-099e-4b0e-922d-250ff058ab08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711410e08cc341a4b63f00f0aad433fb, user_id=45d7a153d79e4e458ea29138161d0947, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:49.810160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d7e17-099e-4b0e-922d-250ff058ab08 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:49.826283 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1004/2026] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:49 2022] PUT /identity/v3/projects/711410e08cc341a4b63f00f0aad433fb/users/45d7a153d79e4e458ea29138161d0947/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:49.838654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cfb27-ee61-4aee-9e5b-b9b312f08e20 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:49.838950 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cfb27-ee61-4aee-9e5b-b9b312f08e20 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:49.839236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cfb27-ee61-4aee-9e5b-b9b312f08e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:49.870824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-255cfb27-ee61-4aee-9e5b-b9b312f08e20 None None] MFA Rules not processed for user `45d7a153d79e4e458ea29138161d0947`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:49.872061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-255cfb27-ee61-4aee-9e5b-b9b312f08e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:49.962062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1023/2027] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:49.966683 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d7e17-099e-4b0e-922d-250ff058ab08 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:50.033481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d7e17-099e-4b0e-922d-250ff058ab08 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:50.038746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b83e-4d6f-40dd-a0ea-87a416718a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:50.039390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b83e-4d6f-40dd-a0ea-87a416718a85 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.039762 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b83e-4d6f-40dd-a0ea-87a416718a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.039962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b83e-4d6f-40dd-a0ea-87a416718a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.040998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3b83e-4d6f-40dd-a0ea-87a416718a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:50.042574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3b83e-4d6f-40dd-a0ea-87a416718a85 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:50.048661 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cfb27-ee61-4aee-9e5b-b9b312f08e20 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:50.050176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-255cfb27-ee61-4aee-9e5b-b9b312f08e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:50.066576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cfb27-ee61-4aee-9e5b-b9b312f08e20 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:50.075074 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1005/2028] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:49 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:50.077006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:50.077712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.077993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.078266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] PATH_INFO: `/v3/projects/5c7af47d6ef542e7a9a1668200693d44` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.079265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b83e-4d6f-40dd-a0ea-87a416718a85 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:50.079450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7af47d6ef542e7a9a1668200693d44)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:50.081685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:50.124162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:50.131101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7af47d6ef542e7a9a1668200693d44', 'request_id': 'req-512f849e-f8e1-4488-916d-352d80ae7a91'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.137694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7af47d6ef542e7a9a1668200693d44', 'request_id': 'req-512f849e-f8e1-4488-916d-352d80ae7a91'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.142345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:50.147138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7af47d6ef542e7a9a1668200693d44', 'request_id': 'req-512f849e-f8e1-4488-916d-352d80ae7a91'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.156668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b83e-4d6f-40dd-a0ea-87a416718a85 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:50.163152 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] The token cache is being invalidate because project 5c7af47d6ef542e7a9a1668200693d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:50.163454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.164147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.165730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1024/2029] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:50 2022] DELETE /identity/v3/projects/5c7af47d6ef542e7a9a1668200693d44 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:50.169542 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:50.170877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:50.217057 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bc622-1cea-4a72-982a-499be73b33f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:50.217691 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bc622-1cea-4a72-982a-499be73b33f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.218008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bc622-1cea-4a72-982a-499be73b33f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.218292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bc622-1cea-4a72-982a-499be73b33f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.219005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bc622-1cea-4a72-982a-499be73b33f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:50.221291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bc622-1cea-4a72-982a-499be73b33f1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:50.240085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f849e-f8e1-4488-916d-352d80ae7a91 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:50.243116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1006/2030] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:50 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:50.245360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5a7fe-8265-4043-9308-20fee54c7f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:50.246482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5a7fe-8265-4043-9308-20fee54c7f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.246770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5a7fe-8265-4043-9308-20fee54c7f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.247053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5a7fe-8265-4043-9308-20fee54c7f20 admin admin] PATH_INFO: `/v3/users/560e7464087448a7945d71a0705e522d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.247262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bc622-1cea-4a72-982a-499be73b33f1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:50.248332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5a7fe-8265-4043-9308-20fee54c7f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=560e7464087448a7945d71a0705e522d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:50.248923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-865bc622-1cea-4a72-982a-499be73b33f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:50.250971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5a7fe-8265-4043-9308-20fee54c7f20 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:50.260987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bc622-1cea-4a72-982a-499be73b33f1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:50.265928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e618-0c0a-4e30-8c73-4f81649ea9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:50.266541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e618-0c0a-4e30-8c73-4f81649ea9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.266824 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e618-0c0a-4e30-8c73-4f81649ea9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.267133 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e618-0c0a-4e30-8c73-4f81649ea9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.267862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1e618-0c0a-4e30-8c73-4f81649ea9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:50.269534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1e618-0c0a-4e30-8c73-4f81649ea9ba admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:50.283274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1007/2031] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:50.284365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e618-0c0a-4e30-8c73-4f81649ea9ba admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:50.298466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e618-0c0a-4e30-8c73-4f81649ea9ba admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:50.307380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235dd5f-006a-4815-b1d2-74028a6396d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:50.307380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235dd5f-006a-4815-b1d2-74028a6396d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.307380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235dd5f-006a-4815-b1d2-74028a6396d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.307380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235dd5f-006a-4815-b1d2-74028a6396d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.307759 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235dd5f-006a-4815-b1d2-74028a6396d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:50.309547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235dd5f-006a-4815-b1d2-74028a6396d4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:50.313798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6cb5a7fe-8265-4043-9308-20fee54c7f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560e7464087448a7945d71a0705e522d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.314625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6cb5a7fe-8265-4043-9308-20fee54c7f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560e7464087448a7945d71a0705e522d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.322167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1008/2032] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:50.326235 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6cb5a7fe-8265-4043-9308-20fee54c7f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560e7464087448a7945d71a0705e522d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.326869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235dd5f-006a-4815-b1d2-74028a6396d4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:50.339762 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235dd5f-006a-4815-b1d2-74028a6396d4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:50.341291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6cb5a7fe-8265-4043-9308-20fee54c7f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560e7464087448a7945d71a0705e522d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.346140 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4085a-56ff-4c66-a164-8cf24b3c61f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:50.347232 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4085a-56ff-4c66-a164-8cf24b3c61f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.347737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4085a-56ff-4c66-a164-8cf24b3c61f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.348308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4085a-56ff-4c66-a164-8cf24b3c61f1 admin admin] PATH_INFO: `/v3/projects/5e6aa56c389b45f1b63b3a2b4008de8d/users/a6590e2953474c96b7cad32e32dd75f4/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.350726 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6cb5a7fe-8265-4043-9308-20fee54c7f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560e7464087448a7945d71a0705e522d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.358421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1025/2033] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:50 2022] DELETE /identity/v3/users/560e7464087448a7945d71a0705e522d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:50.369799 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4085a-56ff-4c66-a164-8cf24b3c61f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6aa56c389b45f1b63b3a2b4008de8d, user_id=a6590e2953474c96b7cad32e32dd75f4, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:50.372695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4085a-56ff-4c66-a164-8cf24b3c61f1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:50.405338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1009/2034] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:50 2022] PUT /identity/v3/projects/5e6aa56c389b45f1b63b3a2b4008de8d/users/a6590e2953474c96b7cad32e32dd75f4/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:50.408101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae8ee1-8c1d-4a1e-b489-d9c8dd32b069 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.408420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae8ee1-8c1d-4a1e-b489-d9c8dd32b069 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.408706 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae8ee1-8c1d-4a1e-b489-d9c8dd32b069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.447108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-12ae8ee1-8c1d-4a1e-b489-d9c8dd32b069 None None] MFA Rules not processed for user `a6590e2953474c96b7cad32e32dd75f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:50.448637 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-12ae8ee1-8c1d-4a1e-b489-d9c8dd32b069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:50.517730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:50.526494 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1026/2035] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:50.527883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4085a-56ff-4c66-a164-8cf24b3c61f1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:50.530221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2ce4085a-56ff-4c66-a164-8cf24b3c61f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:50.615813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4085a-56ff-4c66-a164-8cf24b3c61f1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:50.621761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528d2c1-3933-4654-b3b8-a660a6ec9229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:50.622486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528d2c1-3933-4654-b3b8-a660a6ec9229 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.622688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528d2c1-3933-4654-b3b8-a660a6ec9229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.622957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528d2c1-3933-4654-b3b8-a660a6ec9229 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.636435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528d2c1-3933-4654-b3b8-a660a6ec9229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:50.636435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528d2c1-3933-4654-b3b8-a660a6ec9229 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:50.665446 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1010/2036] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:50 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:50.666660 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae8ee1-8c1d-4a1e-b489-d9c8dd32b069 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:50.681591 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae8ee1-8c1d-4a1e-b489-d9c8dd32b069 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:50.733748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528d2c1-3933-4654-b3b8-a660a6ec9229 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:50.735699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6528d2c1-3933-4654-b3b8-a660a6ec9229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:50.762274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ad0ac-fc1f-41bd-8a44-0a8aaea81140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:50.762789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:50.763657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ad0ac-fc1f-41bd-8a44-0a8aaea81140 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.764091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ad0ac-fc1f-41bd-8a44-0a8aaea81140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.764586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ad0ac-fc1f-41bd-8a44-0a8aaea81140 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.767624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ad0ac-fc1f-41bd-8a44-0a8aaea81140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:50.770505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ad0ac-fc1f-41bd-8a44-0a8aaea81140 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:50.804153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1027/2037] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:50 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:50.805126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ad0ac-fc1f-41bd-8a44-0a8aaea81140 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:50.810308 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c66ad0ac-fc1f-41bd-8a44-0a8aaea81140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:50.823668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ad0ac-fc1f-41bd-8a44-0a8aaea81140 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:50.828680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:50.829323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.829593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.829866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] PATH_INFO: `/v3/projects/e9eaeacde2be4306a8dae041adaa46b9` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.831289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9eaeacde2be4306a8dae041adaa46b9)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:50.833876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:50.844898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528d2c1-3933-4654-b3b8-a660a6ec9229 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:50.849747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5110735-0656-42b1-85a3-f3812b5b4f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:50.850398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5110735-0656-42b1-85a3-f3812b5b4f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.850679 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5110735-0656-42b1-85a3-f3812b5b4f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.850953 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5110735-0656-42b1-85a3-f3812b5b4f29 admin admin] PATH_INFO: `/v3/users/89265501b59243b48f679f99782385da` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.852131 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5110735-0656-42b1-85a3-f3812b5b4f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89265501b59243b48f679f99782385da)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:50.854111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5110735-0656-42b1-85a3-f3812b5b4f29 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:50.887214 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9eaeacde2be4306a8dae041adaa46b9', 'request_id': 'req-dc48ad10-4f08-4ab4-b800-9b253da351ee'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.894578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9eaeacde2be4306a8dae041adaa46b9', 'request_id': 'req-dc48ad10-4f08-4ab4-b800-9b253da351ee'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.902479 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9eaeacde2be4306a8dae041adaa46b9', 'request_id': 'req-dc48ad10-4f08-4ab4-b800-9b253da351ee'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.905856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e5110735-0656-42b1-85a3-f3812b5b4f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89265501b59243b48f679f99782385da'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.906585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e5110735-0656-42b1-85a3-f3812b5b4f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89265501b59243b48f679f99782385da'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.916915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] The token cache is being invalidate because project e9eaeacde2be4306a8dae041adaa46b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:50.917212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.918202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.919236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e5110735-0656-42b1-85a3-f3812b5b4f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89265501b59243b48f679f99782385da'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.919974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1028/2038] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:50 2022] DELETE /identity/v3/projects/e9eaeacde2be4306a8dae041adaa46b9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:50.920865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:50.922704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:50.928590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e5110735-0656-42b1-85a3-f3812b5b4f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89265501b59243b48f679f99782385da'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.935934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e5110735-0656-42b1-85a3-f3812b5b4f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89265501b59243b48f679f99782385da'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:50.942872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1011/2039] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:50 2022] DELETE /identity/v3/users/89265501b59243b48f679f99782385da => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:50.946641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74966cf-f1f2-4997-8f17-9b9dd642b443 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:50.947127 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74966cf-f1f2-4997-8f17-9b9dd642b443 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:50.948199 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74966cf-f1f2-4997-8f17-9b9dd642b443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:50.969029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d74966cf-f1f2-4997-8f17-9b9dd642b443 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:50.970300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d74966cf-f1f2-4997-8f17-9b9dd642b443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:50.997581 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48ad10-4f08-4ab4-b800-9b253da351ee admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.022658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:51.045287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1012/2040] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:51.054171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15f7a-0c50-4cac-b85b-e5d3f3c2cad7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.054171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15f7a-0c50-4cac-b85b-e5d3f3c2cad7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.054171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15f7a-0c50-4cac-b85b-e5d3f3c2cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.070989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a0a15f7a-0c50-4cac-b85b-e5d3f3c2cad7 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:51.072080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b01dd-bcdf-4b76-97bb-7f6cd3a720fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.072586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a0a15f7a-0c50-4cac-b85b-e5d3f3c2cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.072733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b01dd-bcdf-4b76-97bb-7f6cd3a720fe admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.073013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b01dd-bcdf-4b76-97bb-7f6cd3a720fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.073282 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b01dd-bcdf-4b76-97bb-7f6cd3a720fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.073974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b01dd-bcdf-4b76-97bb-7f6cd3a720fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.075553 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b01dd-bcdf-4b76-97bb-7f6cd3a720fe admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.080535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1013/2041] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:51.081736 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ce2f2-2cbf-4961-81b4-aba5db8bf381 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.082045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ce2f2-2cbf-4961-81b4-aba5db8bf381 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.082325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ce2f2-2cbf-4961-81b4-aba5db8bf381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.089273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1029/2042] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:51.092208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b01dd-bcdf-4b76-97bb-7f6cd3a720fe admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.094640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-246b01dd-bcdf-4b76-97bb-7f6cd3a720fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.102419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b97ce2f2-2cbf-4961-81b4-aba5db8bf381 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:51.103680 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b97ce2f2-2cbf-4961-81b4-aba5db8bf381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.112652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1014/2043] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:51.116519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ce2f2-2cbf-4961-81b4-aba5db8bf381 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.117839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b97ce2f2-2cbf-4961-81b4-aba5db8bf381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.129452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ce2f2-2cbf-4961-81b4-aba5db8bf381 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.134297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b3afe-4bfa-4f34-87aa-f1e4b82b68f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.134960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b3afe-4bfa-4f34-87aa-f1e4b82b68f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.135238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b3afe-4bfa-4f34-87aa-f1e4b82b68f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.135530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b3afe-4bfa-4f34-87aa-f1e4b82b68f3 admin admin] PATH_INFO: `/v3/projects/a023c191ddb54a90832dc823a421ac2d/users/23ed0f7b9ddd4bea915865d1b4be077e/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.150462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b3afe-4bfa-4f34-87aa-f1e4b82b68f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a023c191ddb54a90832dc823a421ac2d, user_id=23ed0f7b9ddd4bea915865d1b4be077e, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.151432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b01dd-bcdf-4b76-97bb-7f6cd3a720fe admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.153136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b3afe-4bfa-4f34-87aa-f1e4b82b68f3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.155106 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999b72-268e-4080-ae44-a8f3312dd210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.156211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:51.156357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999b72-268e-4080-ae44-a8f3312dd210 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.156580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999b72-268e-4080-ae44-a8f3312dd210 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.156848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999b72-268e-4080-ae44-a8f3312dd210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.167242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76999b72-268e-4080-ae44-a8f3312dd210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.168747 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76999b72-268e-4080-ae44-a8f3312dd210 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.170848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1015/2044] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:51 2022] PUT /identity/v3/projects/a023c191ddb54a90832dc823a421ac2d/users/23ed0f7b9ddd4bea915865d1b4be077e/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:51.171823 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b3afe-4bfa-4f34-87aa-f1e4b82b68f3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.178740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1030/2045] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:51.179565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999b72-268e-4080-ae44-a8f3312dd210 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.189796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999b72-268e-4080-ae44-a8f3312dd210 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.248870 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b3afe-4bfa-4f34-87aa-f1e4b82b68f3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.255696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72061cb9-6ad4-4a9c-8ae3-c626978719ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.256744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72061cb9-6ad4-4a9c-8ae3-c626978719ef admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.257034 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72061cb9-6ad4-4a9c-8ae3-c626978719ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.257337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72061cb9-6ad4-4a9c-8ae3-c626978719ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.258018 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72061cb9-6ad4-4a9c-8ae3-c626978719ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:51.258355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72061cb9-6ad4-4a9c-8ae3-c626978719ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.259325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a820e5-6812-4dd8-95db-32633671e8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.259949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a820e5-6812-4dd8-95db-32633671e8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.260139 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72061cb9-6ad4-4a9c-8ae3-c626978719ef admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.260254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a820e5-6812-4dd8-95db-32633671e8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.260541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a820e5-6812-4dd8-95db-32633671e8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.261677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a820e5-6812-4dd8-95db-32633671e8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.263394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a820e5-6812-4dd8-95db-32633671e8c2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.277303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1031/2046] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:51.277490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1016/2047] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:51.278641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a820e5-6812-4dd8-95db-32633671e8c2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.278804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72061cb9-6ad4-4a9c-8ae3-c626978719ef admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.290170 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72061cb9-6ad4-4a9c-8ae3-c626978719ef admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.291233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a820e5-6812-4dd8-95db-32633671e8c2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.295045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde7fc7-fe27-41eb-8cb0-23076dcf15f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.295789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde7fc7-fe27-41eb-8cb0-23076dcf15f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.295947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde7fc7-fe27-41eb-8cb0-23076dcf15f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.296312 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde7fc7-fe27-41eb-8cb0-23076dcf15f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.297012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde7fc7-fe27-41eb-8cb0-23076dcf15f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.297671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cfeb0-3585-43c8-a38b-356961cd4146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.298517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cfeb0-3585-43c8-a38b-356961cd4146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.298925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde7fc7-fe27-41eb-8cb0-23076dcf15f5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.299094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cfeb0-3585-43c8-a38b-356961cd4146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.300044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cfeb0-3585-43c8-a38b-356961cd4146 admin admin] PATH_INFO: `/v3/projects/a023c191ddb54a90832dc823a421ac2d/users/23ed0f7b9ddd4bea915865d1b4be077e/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.303110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cfeb0-3585-43c8-a38b-356961cd4146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a023c191ddb54a90832dc823a421ac2d, user_id=23ed0f7b9ddd4bea915865d1b4be077e, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.306826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cfeb0-3585-43c8-a38b-356961cd4146 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.320497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1032/2048] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:51 2022] PUT /identity/v3/projects/a023c191ddb54a90832dc823a421ac2d/users/23ed0f7b9ddd4bea915865d1b4be077e/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:51.334034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90291c60-4a04-4c04-b150-035d70ef7275 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.334320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90291c60-4a04-4c04-b150-035d70ef7275 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.334764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90291c60-4a04-4c04-b150-035d70ef7275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.335667 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1017/2049] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:51 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:51.339609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde7fc7-fe27-41eb-8cb0-23076dcf15f5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.377691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-90291c60-4a04-4c04-b150-035d70ef7275 None None] MFA Rules not processed for user `23ed0f7b9ddd4bea915865d1b4be077e`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:51.379274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-90291c60-4a04-4c04-b150-035d70ef7275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.414595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:51.419194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde7fc7-fe27-41eb-8cb0-23076dcf15f5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.426128 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bcd01-45bc-4469-bfb4-e6e21bae7423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.426771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bcd01-45bc-4469-bfb4-e6e21bae7423 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.427058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bcd01-45bc-4469-bfb4-e6e21bae7423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.427338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bcd01-45bc-4469-bfb4-e6e21bae7423 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.428079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bcd01-45bc-4469-bfb4-e6e21bae7423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.430055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bcd01-45bc-4469-bfb4-e6e21bae7423 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.462568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1018/2050] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:51 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:51.466781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bcd01-45bc-4469-bfb4-e6e21bae7423 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.473369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1033/2051] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:51.474340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90291c60-4a04-4c04-b150-035d70ef7275 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.475856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-90291c60-4a04-4c04-b150-035d70ef7275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.490414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90291c60-4a04-4c04-b150-035d70ef7275 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.491126 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bcd01-45bc-4469-bfb4-e6e21bae7423 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.495106 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.495937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.496261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.496543 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] PATH_INFO: `/v3/users/1fe69c224ca24932ac2ca7062c966a62` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.496839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d5899-1cd8-481c-8300-db674ac20e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.497303 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d5899-1cd8-481c-8300-db674ac20e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.497717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d5899-1cd8-481c-8300-db674ac20e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.497815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe69c224ca24932ac2ca7062c966a62)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.498008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d5899-1cd8-481c-8300-db674ac20e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.498715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d5899-1cd8-481c-8300-db674ac20e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.500844 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.501301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d5899-1cd8-481c-8300-db674ac20e16 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.518147 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1019/2052] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:51.519192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d5899-1cd8-481c-8300-db674ac20e16 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.521068 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-840d5899-1cd8-481c-8300-db674ac20e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.534569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d5899-1cd8-481c-8300-db674ac20e16 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.540293 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.540826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.541409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.541409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] PATH_INFO: `/v3/projects/ce49be2678554e849d69b4ae99f43008` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.542555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce49be2678554e849d69b4ae99f43008)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.544512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.553554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe69c224ca24932ac2ca7062c966a62'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.554180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe69c224ca24932ac2ca7062c966a62'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.563039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe69c224ca24932ac2ca7062c966a62'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.575791 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe69c224ca24932ac2ca7062c966a62'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.583457 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe69c224ca24932ac2ca7062c966a62'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.586845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=5,keystone:SELECT=92,keystone:DELETE=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:51.590034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1034/2053] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:51 2022] DELETE /identity/v3/users/1fe69c224ca24932ac2ca7062c966a62 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:51.593054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.593054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.594086 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce49be2678554e849d69b4ae99f43008', 'request_id': 'req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.601812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce49be2678554e849d69b4ae99f43008', 'request_id': 'req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.609862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce49be2678554e849d69b4ae99f43008', 'request_id': 'req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.622773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] The token cache is being invalidate because project ce49be2678554e849d69b4ae99f43008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:51.623090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.623784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.628750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1020/2054] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:51 2022] DELETE /identity/v3/projects/ce49be2678554e849d69b4ae99f43008 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:51.629316 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.630787 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.656195 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ef84e-5878-4e7f-8e09-14566832d0a6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.660179 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455347a-c1db-4369-85e9-6d54f7a18447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.660809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455347a-c1db-4369-85e9-6d54f7a18447 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.662485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455347a-c1db-4369-85e9-6d54f7a18447 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.662805 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455347a-c1db-4369-85e9-6d54f7a18447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.664787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9455347a-c1db-4369-85e9-6d54f7a18447 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.707354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f235a-d687-4a24-b1a2-cd38c0f3705a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.732826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:51.749872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455347a-c1db-4369-85e9-6d54f7a18447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.751458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455347a-c1db-4369-85e9-6d54f7a18447 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.763861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1035/2055] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:51.766162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86c017-e0df-4537-8651-fed4825c4ee8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.766550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86c017-e0df-4537-8651-fed4825c4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.766842 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86c017-e0df-4537-8651-fed4825c4ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.771494 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750216b9-cbdc-4608-8dc7-5b76d37c5903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.771935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750216b9-cbdc-4608-8dc7-5b76d37c5903 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.771935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750216b9-cbdc-4608-8dc7-5b76d37c5903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.772135 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750216b9-cbdc-4608-8dc7-5b76d37c5903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.772855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750216b9-cbdc-4608-8dc7-5b76d37c5903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.774455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750216b9-cbdc-4608-8dc7-5b76d37c5903 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.788375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6b86c017-e0df-4537-8651-fed4825c4ee8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:51.789703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6b86c017-e0df-4537-8651-fed4825c4ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.791865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1021/2056] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:51.792884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750216b9-cbdc-4608-8dc7-5b76d37c5903 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.794773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-750216b9-cbdc-4608-8dc7-5b76d37c5903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.816479 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1036/2057] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:51.820546 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86c017-e0df-4537-8651-fed4825c4ee8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.826668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750216b9-cbdc-4608-8dc7-5b76d37c5903 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.832009 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.833153 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.833602 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.833888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] PATH_INFO: `/v3/users/32ef6c6856cf4eabaf6586e67e7dfa50` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.835076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ef6c6856cf4eabaf6586e67e7dfa50)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.837029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.844340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86c017-e0df-4537-8651-fed4825c4ee8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.850855 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c041ec-a8a6-4751-9906-aba39a5bce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:51.851800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c041ec-a8a6-4751-9906-aba39a5bce9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:51.852100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c041ec-a8a6-4751-9906-aba39a5bce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:51.852842 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c041ec-a8a6-4751-9906-aba39a5bce9e admin admin] PATH_INFO: `/v3/projects/f7a472f7485241448abce8275884b3e5/users/ad1a585f569f41e5ae17d9877444fd41/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:51.875673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c041ec-a8a6-4751-9906-aba39a5bce9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a472f7485241448abce8275884b3e5, user_id=ad1a585f569f41e5ae17d9877444fd41, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:51.878466 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c041ec-a8a6-4751-9906-aba39a5bce9e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:51.892578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ef6c6856cf4eabaf6586e67e7dfa50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.893229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ef6c6856cf4eabaf6586e67e7dfa50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.893456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1037/2058] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:51 2022] PUT /identity/v3/projects/f7a472f7485241448abce8275884b3e5/users/ad1a585f569f41e5ae17d9877444fd41/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:51.894268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c041ec-a8a6-4751-9906-aba39a5bce9e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.897671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-98c041ec-a8a6-4751-9906-aba39a5bce9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.906731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ef6c6856cf4eabaf6586e67e7dfa50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.908502 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:51.914813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ef6c6856cf4eabaf6586e67e7dfa50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.923721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ef6c6856cf4eabaf6586e67e7dfa50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:51.929998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1022/2059] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:51 2022] DELETE /identity/v3/users/32ef6c6856cf4eabaf6586e67e7dfa50 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:51.930935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:51.932408 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:51.969244 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c041ec-a8a6-4751-9906-aba39a5bce9e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.995060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554984-3170-4fd8-9aee-15ac26b921c1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:51.999060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedfaf2-48f6-4ed2-966c-fcc3d1cc65b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:52.000526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedfaf2-48f6-4ed2-966c-fcc3d1cc65b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:52.000913 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedfaf2-48f6-4ed2-966c-fcc3d1cc65b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:52.001031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedfaf2-48f6-4ed2-966c-fcc3d1cc65b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:52.002854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9aedfaf2-48f6-4ed2-966c-fcc3d1cc65b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:52.027957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfafb70-73b2-4b64-b4b4-d1661eb851f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:52.028742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfafb70-73b2-4b64-b4b4-d1661eb851f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:52.029094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfafb70-73b2-4b64-b4b4-d1661eb851f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:52.029439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfafb70-73b2-4b64-b4b4-d1661eb851f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:52.031618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dbfafb70-73b2-4b64-b4b4-d1661eb851f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:52.075555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedfaf2-48f6-4ed2-966c-fcc3d1cc65b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:52.077202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedfaf2-48f6-4ed2-966c-fcc3d1cc65b6 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:52.091812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1023/2060] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:52.093614 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4dd92-a556-45e0-bd6d-5f95c319e35d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:52.093982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4dd92-a556-45e0-bd6d-5f95c319e35d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:52.094330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4dd92-a556-45e0-bd6d-5f95c319e35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:52.113219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfafb70-73b2-4b64-b4b4-d1661eb851f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:52.115081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfafb70-73b2-4b64-b4b4-d1661eb851f9 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:52.132025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7af4dd92-a556-45e0-bd6d-5f95c319e35d None None] MFA Rules not processed for user `ad1a585f569f41e5ae17d9877444fd41`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:52.133498 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7af4dd92-a556-45e0-bd6d-5f95c319e35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:52.141328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1038/2061] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:52.228780 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1024/2062] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:52.229485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfafb70-73b2-4b64-b4b4-d1661eb851f9 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:52.231200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dbfafb70-73b2-4b64-b4b4-d1661eb851f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:52.252172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4dd92-a556-45e0-bd6d-5f95c319e35d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:52.253690 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7af4dd92-a556-45e0-bd6d-5f95c319e35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:52.255177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfafb70-73b2-4b64-b4b4-d1661eb851f9 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:52.262027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2f6ff-b222-4062-9a25-54bc491d395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:52.264670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2f6ff-b222-4062-9a25-54bc491d395c admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:52.266884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2f6ff-b222-4062-9a25-54bc491d395c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:52.267262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2f6ff-b222-4062-9a25-54bc491d395c admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:52.268217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2f6ff-b222-4062-9a25-54bc491d395c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:52.271154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2f6ff-b222-4062-9a25-54bc491d395c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:52.282615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4dd92-a556-45e0-bd6d-5f95c319e35d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:52.289678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:52.290469 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:52.290848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:52.291239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] PATH_INFO: `/v3/projects/fa58637c9e6f4af181e0efde7e5822a1` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:52.292703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa58637c9e6f4af181e0efde7e5822a1)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:52.295500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:52.318201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1039/2063] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:52 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:52.323652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2f6ff-b222-4062-9a25-54bc491d395c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:52.331747 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:52.340893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:52.388668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa58637c9e6f4af181e0efde7e5822a1', 'request_id': 'req-a8f784d2-bbab-4cdd-9afa-b8162316b250'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.399936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa58637c9e6f4af181e0efde7e5822a1', 'request_id': 'req-a8f784d2-bbab-4cdd-9afa-b8162316b250'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.410482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa58637c9e6f4af181e0efde7e5822a1', 'request_id': 'req-a8f784d2-bbab-4cdd-9afa-b8162316b250'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.434666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] The token cache is being invalidate because project fa58637c9e6f4af181e0efde7e5822a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:52.435263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.436307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.438045 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2f6ff-b222-4062-9a25-54bc491d395c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:52.438285 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1025/2064] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:52 2022] DELETE /identity/v3/projects/fa58637c9e6f4af181e0efde7e5822a1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:52.442852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:52.445630 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:52.542100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f784d2-bbab-4cdd-9afa-b8162316b250 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:52.547737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:52.548423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:52.548712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:52.548989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] PATH_INFO: `/v3/users/9882c450e2274886acac5168527585e8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:52.549680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe74a9-b3cc-4bf9-a181-4fcf176747a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:52.550871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe74a9-b3cc-4bf9-a181-4fcf176747a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:52.551165 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe74a9-b3cc-4bf9-a181-4fcf176747a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:52.551525 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe74a9-b3cc-4bf9-a181-4fcf176747a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:52.552317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe74a9-b3cc-4bf9-a181-4fcf176747a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:52.553163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9882c450e2274886acac5168527585e8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:52.555480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe74a9-b3cc-4bf9-a181-4fcf176747a4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:52.555751 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:52.590689 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1040/2065] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:52 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:52.591190 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe74a9-b3cc-4bf9-a181-4fcf176747a4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:52.595968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c2fe74a9-b3cc-4bf9-a181-4fcf176747a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:52.610900 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe74a9-b3cc-4bf9-a181-4fcf176747a4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:52.618460 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:52.619219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:52.619514 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:52.619839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] PATH_INFO: `/v3/projects/97aa326ed9604385a5f24b0dda2818d7` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:52.621137 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97aa326ed9604385a5f24b0dda2818d7)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:52.623735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:52.641125 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9882c450e2274886acac5168527585e8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.642048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9882c450e2274886acac5168527585e8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.659103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9882c450e2274886acac5168527585e8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.666767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9882c450e2274886acac5168527585e8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.674207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9882c450e2274886acac5168527585e8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.677648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97aa326ed9604385a5f24b0dda2818d7', 'request_id': 'req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.682053 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1026/2066] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:52 2022] DELETE /identity/v3/users/9882c450e2274886acac5168527585e8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:52.682927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:52.684336 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:52.689327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97aa326ed9604385a5f24b0dda2818d7', 'request_id': 'req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.697652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97aa326ed9604385a5f24b0dda2818d7', 'request_id': 'req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.711974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] The token cache is being invalidate because project 97aa326ed9604385a5f24b0dda2818d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:52.712375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.713187 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.716235 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1041/2067] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:52 2022] DELETE /identity/v3/projects/97aa326ed9604385a5f24b0dda2818d7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:52.719485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:52.721212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:52.723814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:52.754357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:52.776673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9b93c-446b-4739-9388-7f2e180b694a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:52.782446 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876c0eb-c89a-4936-aa59-fd9e7d6732fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:52.783079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876c0eb-c89a-4936-aa59-fd9e7d6732fe admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:52.783643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876c0eb-c89a-4936-aa59-fd9e7d6732fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:52.783643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876c0eb-c89a-4936-aa59-fd9e7d6732fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:52.784363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876c0eb-c89a-4936-aa59-fd9e7d6732fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:52.785985 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876c0eb-c89a-4936-aa59-fd9e7d6732fe admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:52.796912 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1027/2068] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:52.802425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876c0eb-c89a-4936-aa59-fd9e7d6732fe admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:52.807789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d876c0eb-c89a-4936-aa59-fd9e7d6732fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:52.810764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5a056-20bc-4e4e-a5a0-1a1d2c74c9d9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:52.816976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:52.817691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:52.817979 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:52.818395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] PATH_INFO: `/v3/users/faac310995f54677abd994ae50df59f2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:52.819775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faac310995f54677abd994ae50df59f2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:52.821945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:52.827263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876c0eb-c89a-4936-aa59-fd9e7d6732fe admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:52.848449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a5c97-9c7a-48d4-a172-f1d47f9da95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:52.849023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a5c97-9c7a-48d4-a172-f1d47f9da95d admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:52.849548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a5c97-9c7a-48d4-a172-f1d47f9da95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:52.849666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a5c97-9c7a-48d4-a172-f1d47f9da95d admin admin] PATH_INFO: `/v3/projects/fb5b2808aeb746588089ae65685c22ae/users/181cfb9b25d940c98f2a3c50c3abe712/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:52.869069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a5c97-9c7a-48d4-a172-f1d47f9da95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5b2808aeb746588089ae65685c22ae, user_id=181cfb9b25d940c98f2a3c50c3abe712, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:52.872110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a5c97-9c7a-48d4-a172-f1d47f9da95d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:52.894029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1028/2069] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:52 2022] PUT /identity/v3/projects/fb5b2808aeb746588089ae65685c22ae/users/181cfb9b25d940c98f2a3c50c3abe712/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:52.901513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a5c97-9c7a-48d4-a172-f1d47f9da95d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:52.914019 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faac310995f54677abd994ae50df59f2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.915068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faac310995f54677abd994ae50df59f2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.924181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faac310995f54677abd994ae50df59f2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.950655 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faac310995f54677abd994ae50df59f2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.964540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faac310995f54677abd994ae50df59f2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:52.973968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1042/2070] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:52 2022] DELETE /identity/v3/users/faac310995f54677abd994ae50df59f2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:52.990973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a5c97-9c7a-48d4-a172-f1d47f9da95d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:53.064999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10c752-b15d-4ac3-92aa-6eb5f5aa3c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:53.065906 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10c752-b15d-4ac3-92aa-6eb5f5aa3c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.066162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10c752-b15d-4ac3-92aa-6eb5f5aa3c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.066477 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10c752-b15d-4ac3-92aa-6eb5f5aa3c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.067157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10c752-b15d-4ac3-92aa-6eb5f5aa3c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:53.068838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10c752-b15d-4ac3-92aa-6eb5f5aa3c9f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:53.080938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1029/2071] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:53.088709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:53.092918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:53.109361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ed311-c3b1-404a-8c2c-d11b1fa987a1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:53.110556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10c752-b15d-4ac3-92aa-6eb5f5aa3c9f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:53.114423 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3d10c752-b15d-4ac3-92aa-6eb5f5aa3c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:53.115500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67d527-14ef-4d3a-afc6-63f1a5c6bc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:53.116482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67d527-14ef-4d3a-afc6-63f1a5c6bc2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.116862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67d527-14ef-4d3a-afc6-63f1a5c6bc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.117254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67d527-14ef-4d3a-afc6-63f1a5c6bc2a admin admin] PATH_INFO: `/v3/projects/fb5b2808aeb746588089ae65685c22ae/users/181cfb9b25d940c98f2a3c50c3abe712/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.119593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67d527-14ef-4d3a-afc6-63f1a5c6bc2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5b2808aeb746588089ae65685c22ae, user_id=181cfb9b25d940c98f2a3c50c3abe712, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:53.123294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67d527-14ef-4d3a-afc6-63f1a5c6bc2a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:53.132921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10c752-b15d-4ac3-92aa-6eb5f5aa3c9f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:53.135992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1043/2072] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:53 2022] PUT /identity/v3/projects/fb5b2808aeb746588089ae65685c22ae/users/181cfb9b25d940c98f2a3c50c3abe712/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:53.146634 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8dbb8-1366-43f7-95c8-5f46d3031725 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.147065 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8dbb8-1366-43f7-95c8-5f46d3031725 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.147428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8dbb8-1366-43f7-95c8-5f46d3031725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.182015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-18d8dbb8-1366-43f7-95c8-5f46d3031725 None None] MFA Rules not processed for user `181cfb9b25d940c98f2a3c50c3abe712`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:53.183421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-18d8dbb8-1366-43f7-95c8-5f46d3031725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:53.187365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:53.204791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:53.205467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.205750 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.206027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] PATH_INFO: `/v3/projects/abd53bbbdebc46d5aa8f6ba94c2aa783` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.207268 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd53bbbdebc46d5aa8f6ba94c2aa783)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:53.209409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:53.262972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd53bbbdebc46d5aa8f6ba94c2aa783', 'request_id': 'req-2de27213-4c21-4114-a95e-ef278259bf9f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:53.274563 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1044/2073] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:53.274744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd53bbbdebc46d5aa8f6ba94c2aa783', 'request_id': 'req-2de27213-4c21-4114-a95e-ef278259bf9f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:53.280130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd53bbbdebc46d5aa8f6ba94c2aa783', 'request_id': 'req-2de27213-4c21-4114-a95e-ef278259bf9f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:53.284254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8dbb8-1366-43f7-95c8-5f46d3031725 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:53.285762 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-18d8dbb8-1366-43f7-95c8-5f46d3031725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:53.294581 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] The token cache is being invalidate because project abd53bbbdebc46d5aa8f6ba94c2aa783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:53.295278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:53.297018 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:53.299026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1030/2074] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:53 2022] DELETE /identity/v3/projects/abd53bbbdebc46d5aa8f6ba94c2aa783 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:53.303999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:53.304678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:53.305655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:53.359624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8dbb8-1366-43f7-95c8-5f46d3031725 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:53.379738 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de27213-4c21-4114-a95e-ef278259bf9f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:53.384374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b0346-c16b-4e14-8998-abb03b0c718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:53.385025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b0346-c16b-4e14-8998-abb03b0c718c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.385429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b0346-c16b-4e14-8998-abb03b0c718c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.385716 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b0346-c16b-4e14-8998-abb03b0c718c admin admin] PATH_INFO: `/v3/projects/f41827c9daab441fadec5df1778c8f73` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.386873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b0346-c16b-4e14-8998-abb03b0c718c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41827c9daab441fadec5df1778c8f73)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:53.388817 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b0346-c16b-4e14-8998-abb03b0c718c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:53.410176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732e082-ca0b-4222-b404-42b316d9bbd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:53.410965 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732e082-ca0b-4222-b404-42b316d9bbd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.411131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732e082-ca0b-4222-b404-42b316d9bbd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.411706 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732e082-ca0b-4222-b404-42b316d9bbd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.413574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8732e082-ca0b-4222-b404-42b316d9bbd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:53.436170 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-651b0346-c16b-4e14-8998-abb03b0c718c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41827c9daab441fadec5df1778c8f73', 'request_id': 'req-651b0346-c16b-4e14-8998-abb03b0c718c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:53.442185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-651b0346-c16b-4e14-8998-abb03b0c718c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41827c9daab441fadec5df1778c8f73', 'request_id': 'req-651b0346-c16b-4e14-8998-abb03b0c718c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:53.448593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-651b0346-c16b-4e14-8998-abb03b0c718c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41827c9daab441fadec5df1778c8f73', 'request_id': 'req-651b0346-c16b-4e14-8998-abb03b0c718c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:53.462300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-651b0346-c16b-4e14-8998-abb03b0c718c admin admin] The token cache is being invalidate because project f41827c9daab441fadec5df1778c8f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:53.462592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-651b0346-c16b-4e14-8998-abb03b0c718c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:53.463234 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-651b0346-c16b-4e14-8998-abb03b0c718c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:53.464991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1031/2075] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:53 2022] DELETE /identity/v3/projects/f41827c9daab441fadec5df1778c8f73 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:53.465949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c44a14-0b95-4726-9ee7-70ddc05a834c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.466226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c44a14-0b95-4726-9ee7-70ddc05a834c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.466500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c44a14-0b95-4726-9ee7-70ddc05a834c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.475688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:53.484521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732e082-ca0b-4222-b404-42b316d9bbd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:53.486131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732e082-ca0b-4222-b404-42b316d9bbd7 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:53.487641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b0c44a14-0b95-4726-9ee7-70ddc05a834c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:53.489471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b0c44a14-0b95-4726-9ee7-70ddc05a834c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:53.496151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1045/2076] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:53.497474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf0ed1-99a6-4df2-8837-5cd95f5c8631 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.497764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf0ed1-99a6-4df2-8837-5cd95f5c8631 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.498077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf0ed1-99a6-4df2-8837-5cd95f5c8631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.521212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a2cf0ed1-99a6-4df2-8837-5cd95f5c8631 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:53.522596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a2cf0ed1-99a6-4df2-8837-5cd95f5c8631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:53.561147 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1032/2077] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:53.569462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c5b23-daa2-4307-aab0-dd4641082e07 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.569821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c5b23-daa2-4307-aab0-dd4641082e07 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.570148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c5b23-daa2-4307-aab0-dd4641082e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.595372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1e0c5b23-daa2-4307-aab0-dd4641082e07 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:53.596876 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1e0c5b23-daa2-4307-aab0-dd4641082e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:53.604653 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1046/2078] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:53.611651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1033/2079] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:53.613149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791affa-a53f-448b-ba2c-ca094e48b904 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.613442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791affa-a53f-448b-ba2c-ca094e48b904 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.613658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c5b23-daa2-4307-aab0-dd4641082e07 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:53.613843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791affa-a53f-448b-ba2c-ca094e48b904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.625145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c5b23-daa2-4307-aab0-dd4641082e07 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:53.631024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6329d3-3413-4f30-841e-b19ba4e1f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:53.631914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6329d3-3413-4f30-841e-b19ba4e1f407 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.632314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6329d3-3413-4f30-841e-b19ba4e1f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.632596 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6329d3-3413-4f30-841e-b19ba4e1f407 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.633432 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6329d3-3413-4f30-841e-b19ba4e1f407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:53.633761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6329d3-3413-4f30-841e-b19ba4e1f407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:53.635361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6329d3-3413-4f30-841e-b19ba4e1f407 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:53.635894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5791affa-a53f-448b-ba2c-ca094e48b904 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:53.637141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5791affa-a53f-448b-ba2c-ca094e48b904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:53.647837 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1047/2080] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:53.651699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791affa-a53f-448b-ba2c-ca094e48b904 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:53.661492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791affa-a53f-448b-ba2c-ca094e48b904 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:53.666654 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1034/2081] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:54:53.666934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13376243-12d9-4489-9d0f-091e921c204c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:53.667485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13376243-12d9-4489-9d0f-091e921c204c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.667648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13376243-12d9-4489-9d0f-091e921c204c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.667745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6329d3-3413-4f30-841e-b19ba4e1f407 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:53.667918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13376243-12d9-4489-9d0f-091e921c204c admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.668798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13376243-12d9-4489-9d0f-091e921c204c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:53.669096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13376243-12d9-4489-9d0f-091e921c204c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:53.670704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13376243-12d9-4489-9d0f-091e921c204c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:53.678923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6329d3-3413-4f30-841e-b19ba4e1f407 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:53.680044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:53.684801 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d506f6-83ad-44fb-afae-f46a079845f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:53.685432 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d506f6-83ad-44fb-afae-f46a079845f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.685859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d506f6-83ad-44fb-afae-f46a079845f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.686251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d506f6-83ad-44fb-afae-f46a079845f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.687566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d506f6-83ad-44fb-afae-f46a079845f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:53.690042 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d506f6-83ad-44fb-afae-f46a079845f6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:53.692306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1048/2082] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:54:53.693359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13376243-12d9-4489-9d0f-091e921c204c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:53.715580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13376243-12d9-4489-9d0f-091e921c204c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:53.731093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7efc3d-d2ea-4ad5-a5fe-94efb6b802d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:53.731895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7efc3d-d2ea-4ad5-a5fe-94efb6b802d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.732326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7efc3d-d2ea-4ad5-a5fe-94efb6b802d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.733049 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7efc3d-d2ea-4ad5-a5fe-94efb6b802d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.736140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7efc3d-d2ea-4ad5-a5fe-94efb6b802d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:53.738270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7efc3d-d2ea-4ad5-a5fe-94efb6b802d9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:53.747404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1035/2083] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:53 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:53.752235 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d506f6-83ad-44fb-afae-f46a079845f6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:53.799730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1049/2084] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:53 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:53.805351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7efc3d-d2ea-4ad5-a5fe-94efb6b802d9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:53.876419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d506f6-83ad-44fb-afae-f46a079845f6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:53.898324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7efc3d-d2ea-4ad5-a5fe-94efb6b802d9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:53.903915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b188b-e2bc-4378-8f33-c070a19e63ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:53.904677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b188b-e2bc-4378-8f33-c070a19e63ef admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.905039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b188b-e2bc-4378-8f33-c070a19e63ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.905328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b188b-e2bc-4378-8f33-c070a19e63ef admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.906243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b188b-e2bc-4378-8f33-c070a19e63ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:53.908447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b188b-e2bc-4378-8f33-c070a19e63ef admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:53.949823 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1050/2085] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:53 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:53.951960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b188b-e2bc-4378-8f33-c070a19e63ef admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:53.965560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b188b-e2bc-4378-8f33-c070a19e63ef admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:53.971142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d59c6-d57c-47a5-a23b-c1a83ae8e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:53.971802 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d59c6-d57c-47a5-a23b-c1a83ae8e41f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.972112 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d59c6-d57c-47a5-a23b-c1a83ae8e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.972420 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d59c6-d57c-47a5-a23b-c1a83ae8e41f admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.972768 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20b24f-8c81-4d7d-8c2e-fd48567b1d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:53.973098 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d59c6-d57c-47a5-a23b-c1a83ae8e41f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:53.973599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20b24f-8c81-4d7d-8c2e-fd48567b1d9f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:53.973977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20b24f-8c81-4d7d-8c2e-fd48567b1d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:53.974435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20b24f-8c81-4d7d-8c2e-fd48567b1d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:53.975071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d59c6-d57c-47a5-a23b-c1a83ae8e41f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:53.975461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20b24f-8c81-4d7d-8c2e-fd48567b1d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:53.977213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20b24f-8c81-4d7d-8c2e-fd48567b1d9f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:53.992221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1051/2086] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:53.992221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20b24f-8c81-4d7d-8c2e-fd48567b1d9f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:53.992221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2c20b24f-8c81-4d7d-8c2e-fd48567b1d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:53.998743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:54.009547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1036/2087] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:53 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:54.010477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20b24f-8c81-4d7d-8c2e-fd48567b1d9f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:54.011001 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d59c6-d57c-47a5-a23b-c1a83ae8e41f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:54.016984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:54.018093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:54.018633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:54.019800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] PATH_INFO: `/v3/users/ad1a585f569f41e5ae17d9877444fd41` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:54.023752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d59c6-d57c-47a5-a23b-c1a83ae8e41f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:54.028709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1a585f569f41e5ae17d9877444fd41)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:54.031188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:54.033379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657940e-b6b4-4fac-bb1c-7b71b8d4e685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:54.034420 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657940e-b6b4-4fac-bb1c-7b71b8d4e685 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:54.034707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657940e-b6b4-4fac-bb1c-7b71b8d4e685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:54.035092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657940e-b6b4-4fac-bb1c-7b71b8d4e685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:54.035680 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657940e-b6b4-4fac-bb1c-7b71b8d4e685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:54.038103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657940e-b6b4-4fac-bb1c-7b71b8d4e685 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:54.050048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1037/2088] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:54.060680 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657940e-b6b4-4fac-bb1c-7b71b8d4e685 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:54.073783 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657940e-b6b4-4fac-bb1c-7b71b8d4e685 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:54.081209 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0305a0-0c5c-4793-aba3-c1b1c23a14df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:54.081838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0305a0-0c5c-4793-aba3-c1b1c23a14df admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:54.082123 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0305a0-0c5c-4793-aba3-c1b1c23a14df admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:54.082403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0305a0-0c5c-4793-aba3-c1b1c23a14df admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:54.083467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0305a0-0c5c-4793-aba3-c1b1c23a14df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:54.084765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1a585f569f41e5ae17d9877444fd41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:54.085116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0305a0-0c5c-4793-aba3-c1b1c23a14df admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:54.085596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1a585f569f41e5ae17d9877444fd41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:54.095517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1a585f569f41e5ae17d9877444fd41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:54.100241 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1038/2089] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:54.101225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0305a0-0c5c-4793-aba3-c1b1c23a14df admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:54.114842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0305a0-0c5c-4793-aba3-c1b1c23a14df admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:54.116488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1a585f569f41e5ae17d9877444fd41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:54.125955 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb7e18-674e-47c1-ae84-534593080e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:54.126185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1a585f569f41e5ae17d9877444fd41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:54.126965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb7e18-674e-47c1-ae84-534593080e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:54.128256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb7e18-674e-47c1-ae84-534593080e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:54.128256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb7e18-674e-47c1-ae84-534593080e50 admin admin] PATH_INFO: `/v3/projects/0330f99cccfd43fbb15a2c942d222a88/users/4bd92ed9460741aaa133488e75e45e39/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:54.135712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1052/2090] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:53 2022] DELETE /identity/v3/users/ad1a585f569f41e5ae17d9877444fd41 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:54.136493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:54.137966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:54.160430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb7e18-674e-47c1-ae84-534593080e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0330f99cccfd43fbb15a2c942d222a88, user_id=4bd92ed9460741aaa133488e75e45e39, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:54.163139 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb7e18-674e-47c1-ae84-534593080e50 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:54.181426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:54.187723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1039/2091] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:54 2022] PUT /identity/v3/projects/0330f99cccfd43fbb15a2c942d222a88/users/4bd92ed9460741aaa133488e75e45e39/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:54.190478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c8cf3-8adb-4206-9816-1812cd7ffc44 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:54.190778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c8cf3-8adb-4206-9816-1812cd7ffc44 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:54.191066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c8cf3-8adb-4206-9816-1812cd7ffc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:54.238833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-277c8cf3-8adb-4206-9816-1812cd7ffc44 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:54.240427 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-277c8cf3-8adb-4206-9816-1812cd7ffc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:54.244060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c0694-97c3-464d-a41b-bdf12477737f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:54.322851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70ee40-92dc-42be-b2f6-6e7b3e6c7296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:54.323204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1040/2092] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:54.324178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70ee40-92dc-42be-b2f6-6e7b3e6c7296 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:54.324178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70ee40-92dc-42be-b2f6-6e7b3e6c7296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:54.324376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70ee40-92dc-42be-b2f6-6e7b3e6c7296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:54.324552 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57a00-905b-430d-bffc-37dc68e5d5cf None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:54.324796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57a00-905b-430d-bffc-37dc68e5d5cf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:54.325077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57a00-905b-430d-bffc-37dc68e5d5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:54.325277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70ee40-92dc-42be-b2f6-6e7b3e6c7296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:54.327313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70ee40-92dc-42be-b2f6-6e7b3e6c7296 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:54.338441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1053/2093] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:54.339264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70ee40-92dc-42be-b2f6-6e7b3e6c7296 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:54.340998 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4a70ee40-92dc-42be-b2f6-6e7b3e6c7296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:54.356024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c1f57a00-905b-430d-bffc-37dc68e5d5cf None None] MFA Rules not processed for user `4bd92ed9460741aaa133488e75e45e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:54.357266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c1f57a00-905b-430d-bffc-37dc68e5d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:54.399396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70ee40-92dc-42be-b2f6-6e7b3e6c7296 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:54.403315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdac5a-a5cb-4934-b226-48eb174c4a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:54.403958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdac5a-a5cb-4934-b226-48eb174c4a5f service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:54.404278 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdac5a-a5cb-4934-b226-48eb174c4a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:54.404574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdac5a-a5cb-4934-b226-48eb174c4a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:54.417556 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdac5a-a5cb-4934-b226-48eb174c4a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:54.419024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdac5a-a5cb-4934-b226-48eb174c4a5f service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:54.425309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1041/2094] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:54.425309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f57a00-905b-430d-bffc-37dc68e5d5cf None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:54.430480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1054/2095] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:54.436757 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdac5a-a5cb-4934-b226-48eb174c4a5f service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:54.437358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f57a00-905b-430d-bffc-37dc68e5d5cf None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:54.438311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b1cdac5a-a5cb-4934-b226-48eb174c4a5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:54.442207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5eaaa8-dcd0-4aea-917e-471957f0b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:54.442884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eaaa8-dcd0-4aea-917e-471957f0b2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:54.443168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eaaa8-dcd0-4aea-917e-471957f0b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:54.443448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eaaa8-dcd0-4aea-917e-471957f0b2e8 admin admin] PATH_INFO: `/v3/projects/f73ecd5771a04d0fbf61b5792d93a31f/users/9f387e66cb964282b2dfb2de377451f3/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:54.460280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5eaaa8-dcd0-4aea-917e-471957f0b2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73ecd5771a04d0fbf61b5792d93a31f, user_id=9f387e66cb964282b2dfb2de377451f3, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:54.463220 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5eaaa8-dcd0-4aea-917e-471957f0b2e8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:54.480756 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1042/2096] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:54 2022] PUT /identity/v3/projects/f73ecd5771a04d0fbf61b5792d93a31f/users/9f387e66cb964282b2dfb2de377451f3/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:54.493452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ef405-4f04-4149-866c-74376bc772d4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:54.494061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ef405-4f04-4149-866c-74376bc772d4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:54.494852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ef405-4f04-4149-866c-74376bc772d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:54.510791 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdac5a-a5cb-4934-b226-48eb174c4a5f service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:54.528411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b60ef405-4f04-4149-866c-74376bc772d4 None None] MFA Rules not processed for user `9f387e66cb964282b2dfb2de377451f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:54.530021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b60ef405-4f04-4149-866c-74376bc772d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:54.540943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:54.546471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:54.570463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138d446-840b-4884-8cb8-b5aa476d78a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:54.571094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138d446-840b-4884-8cb8-b5aa476d78a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:54.571377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138d446-840b-4884-8cb8-b5aa476d78a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:54.571654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138d446-840b-4884-8cb8-b5aa476d78a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:54.632172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1043/2097] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:54.643355 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ef405-4f04-4149-866c-74376bc772d4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:54.645144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b60ef405-4f04-4149-866c-74376bc772d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:54.659230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ef405-4f04-4149-866c-74376bc772d4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:54.660907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138d446-840b-4884-8cb8-b5aa476d78a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:54.662586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138d446-840b-4884-8cb8-b5aa476d78a2 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:54.663285 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99611c-7e44-4b0d-bd44-13dc925b31aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:54.664179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99611c-7e44-4b0d-bd44-13dc925b31aa service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:54.664913 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99611c-7e44-4b0d-bd44-13dc925b31aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:54.665347 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99611c-7e44-4b0d-bd44-13dc925b31aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:54.674793 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1055/2098] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:54.686295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99611c-7e44-4b0d-bd44-13dc925b31aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:54.688002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99611c-7e44-4b0d-bd44-13dc925b31aa service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:54.698900 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1044/2099] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:54.945523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138d446-840b-4884-8cb8-b5aa476d78a2 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:54.947584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4138d446-840b-4884-8cb8-b5aa476d78a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:55.063976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138d446-840b-4884-8cb8-b5aa476d78a2 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:55.083891 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:55.084692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:55.085133 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:55.085462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] PATH_INFO: `/v3/projects/f7a472f7485241448abce8275884b3e5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:55.086907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a472f7485241448abce8275884b3e5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:55.089239 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:55.152406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a472f7485241448abce8275884b3e5', 'request_id': 'req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.158788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a472f7485241448abce8275884b3e5', 'request_id': 'req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.176009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a472f7485241448abce8275884b3e5', 'request_id': 'req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.191714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] The token cache is being invalidate because project f7a472f7485241448abce8275884b3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:55.192026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.192778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.198005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1056/2100] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:54 2022] DELETE /identity/v3/projects/f7a472f7485241448abce8275884b3e5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:55.202075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99611c-7e44-4b0d-bd44-13dc925b31aa service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:55.216221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99611c-7e44-4b0d-bd44-13dc925b31aa service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:55.288802 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f82e4c-b77b-4c8b-a7a5-82d444d30cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:55.289630 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f82e4c-b77b-4c8b-a7a5-82d444d30cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:55.289988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f82e4c-b77b-4c8b-a7a5-82d444d30cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:55.290503 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f82e4c-b77b-4c8b-a7a5-82d444d30cc3 admin admin] PATH_INFO: `/v3/users/181cfb9b25d940c98f2a3c50c3abe712` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:55.291755 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f82e4c-b77b-4c8b-a7a5-82d444d30cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181cfb9b25d940c98f2a3c50c3abe712)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:55.293811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f82e4c-b77b-4c8b-a7a5-82d444d30cc3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:55.363206 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:55.365456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:55.383408 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a8f82e4c-b77b-4c8b-a7a5-82d444d30cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181cfb9b25d940c98f2a3c50c3abe712'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.384958 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a8f82e4c-b77b-4c8b-a7a5-82d444d30cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181cfb9b25d940c98f2a3c50c3abe712'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.385474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec42e47-d2d0-4065-b1f2-9f7d8bcc7f7b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:55.392164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:55.392164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:55.392428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:55.392626 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] PATH_INFO: `/v3/users/45d7a153d79e4e458ea29138161d0947` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:55.393913 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d7a153d79e4e458ea29138161d0947)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:55.396094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:55.402961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a8f82e4c-b77b-4c8b-a7a5-82d444d30cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181cfb9b25d940c98f2a3c50c3abe712'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.410376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:55.433171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a8f82e4c-b77b-4c8b-a7a5-82d444d30cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181cfb9b25d940c98f2a3c50c3abe712'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.452785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a8f82e4c-b77b-4c8b-a7a5-82d444d30cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181cfb9b25d940c98f2a3c50c3abe712'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.463866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d7a153d79e4e458ea29138161d0947'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.464572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d7a153d79e4e458ea29138161d0947'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.466458 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1045/2101] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:55 2022] DELETE /identity/v3/users/181cfb9b25d940c98f2a3c50c3abe712 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:55.474102 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d7a153d79e4e458ea29138161d0947'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.489097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d7a153d79e4e458ea29138161d0947'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.504588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d7a153d79e4e458ea29138161d0947'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.518840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1057/2102] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:55 2022] DELETE /identity/v3/users/45d7a153d79e4e458ea29138161d0947 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:55.523772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a7f24-2e0f-4484-be5b-24630aafb848 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:55.524458 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a7f24-2e0f-4484-be5b-24630aafb848 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:55.524571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a7f24-2e0f-4484-be5b-24630aafb848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:55.548449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d06a7f24-2e0f-4484-be5b-24630aafb848 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:55.550430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d06a7f24-2e0f-4484-be5b-24630aafb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:55.566651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:55.650928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1046/2103] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:55.661051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:55.662520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:55.723702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ac17e-242a-4eb9-9817-93c5d5ac7f9e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:55.727447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fed55c-d272-416e-9f87-d5025d2dc4cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:55.728070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fed55c-d272-416e-9f87-d5025d2dc4cc service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:55.728385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fed55c-d272-416e-9f87-d5025d2dc4cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:55.728665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fed55c-d272-416e-9f87-d5025d2dc4cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:55.738416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fed55c-d272-416e-9f87-d5025d2dc4cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:55.740207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fed55c-d272-416e-9f87-d5025d2dc4cc service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:55.749558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1058/2104] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:55.766589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a7f24-2e0f-4484-be5b-24630aafb848 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:55.768331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d06a7f24-2e0f-4484-be5b-24630aafb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:55.783689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a7f24-2e0f-4484-be5b-24630aafb848 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:55.789530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbe670-55d1-4328-9aa7-594810532242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:55.791051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbe670-55d1-4328-9aa7-594810532242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:55.791424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbe670-55d1-4328-9aa7-594810532242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:55.792229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbe670-55d1-4328-9aa7-594810532242 admin admin] PATH_INFO: `/v3/projects/fb5b2808aeb746588089ae65685c22ae` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:55.793737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbe670-55d1-4328-9aa7-594810532242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5b2808aeb746588089ae65685c22ae)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:55.796882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbe670-55d1-4328-9aa7-594810532242 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:55.855138 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4bdbe670-55d1-4328-9aa7-594810532242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5b2808aeb746588089ae65685c22ae', 'request_id': 'req-4bdbe670-55d1-4328-9aa7-594810532242'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.861814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4bdbe670-55d1-4328-9aa7-594810532242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5b2808aeb746588089ae65685c22ae', 'request_id': 'req-4bdbe670-55d1-4328-9aa7-594810532242'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.868647 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4bdbe670-55d1-4328-9aa7-594810532242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5b2808aeb746588089ae65685c22ae', 'request_id': 'req-4bdbe670-55d1-4328-9aa7-594810532242'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.881512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4bdbe670-55d1-4328-9aa7-594810532242 admin admin] The token cache is being invalidate because project fb5b2808aeb746588089ae65685c22ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:55.881804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4bdbe670-55d1-4328-9aa7-594810532242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.882451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4bdbe670-55d1-4328-9aa7-594810532242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:55.883996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1047/2105] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:55 2022] DELETE /identity/v3/projects/fb5b2808aeb746588089ae65685c22ae => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:55.888895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200003-94f1-4fa5-876e-254f49c73ce3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:55.889375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200003-94f1-4fa5-876e-254f49c73ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:55.889699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200003-94f1-4fa5-876e-254f49c73ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:55.922395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5b200003-94f1-4fa5-876e-254f49c73ce3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:55.923629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5b200003-94f1-4fa5-876e-254f49c73ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:55.985761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1059/2106] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:55.994621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085d44e-8ccb-4e60-98e3-8b7835cbb100 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:55.994917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085d44e-8ccb-4e60-98e3-8b7835cbb100 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:55.995199 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085d44e-8ccb-4e60-98e3-8b7835cbb100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.015368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b085d44e-8ccb-4e60-98e3-8b7835cbb100 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:56.016676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b085d44e-8ccb-4e60-98e3-8b7835cbb100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:56.025085 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1048/2107] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:56.029624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b200003-94f1-4fa5-876e-254f49c73ce3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.037102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085d44e-8ccb-4e60-98e3-8b7835cbb100 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.038559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b085d44e-8ccb-4e60-98e3-8b7835cbb100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:56.040566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b200003-94f1-4fa5-876e-254f49c73ce3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.045525 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a475ff8-fa0f-4808-a3ac-927c969921e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.046155 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475ff8-fa0f-4808-a3ac-927c969921e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.046674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475ff8-fa0f-4808-a3ac-927c969921e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.047018 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475ff8-fa0f-4808-a3ac-927c969921e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.048810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a475ff8-fa0f-4808-a3ac-927c969921e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:56.048984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a475ff8-fa0f-4808-a3ac-927c969921e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.050670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a475ff8-fa0f-4808-a3ac-927c969921e1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.052422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085d44e-8ccb-4e60-98e3-8b7835cbb100 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.057961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.058703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.059051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.059448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] PATH_INFO: `/v3/projects/711410e08cc341a4b63f00f0aad433fb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.061089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=711410e08cc341a4b63f00f0aad433fb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.063249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.068739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1060/2108] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:56.070232 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a475ff8-fa0f-4808-a3ac-927c969921e1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.080889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a475ff8-fa0f-4808-a3ac-927c969921e1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.085971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb33344-ce66-41ad-9e28-8d127d8c8028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.086629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb33344-ce66-41ad-9e28-8d127d8c8028 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.086859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb33344-ce66-41ad-9e28-8d127d8c8028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.087145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb33344-ce66-41ad-9e28-8d127d8c8028 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.087777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb33344-ce66-41ad-9e28-8d127d8c8028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.089737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb33344-ce66-41ad-9e28-8d127d8c8028 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.107759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:56.119600 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711410e08cc341a4b63f00f0aad433fb', 'request_id': 'req-ab9dbf28-4417-4cac-8635-ed0df224e8e6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.124812 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1061/2109] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:56 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:56.126024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711410e08cc341a4b63f00f0aad433fb', 'request_id': 'req-ab9dbf28-4417-4cac-8635-ed0df224e8e6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.129002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb33344-ce66-41ad-9e28-8d127d8c8028 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.133399 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711410e08cc341a4b63f00f0aad433fb', 'request_id': 'req-ab9dbf28-4417-4cac-8635-ed0df224e8e6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.146676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] The token cache is being invalidate because project 711410e08cc341a4b63f00f0aad433fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:56.147053 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.147794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.149745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1049/2110] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:56 2022] DELETE /identity/v3/projects/711410e08cc341a4b63f00f0aad433fb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:56.153268 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.154674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:56.176516 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:56.199345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb33344-ce66-41ad-9e28-8d127d8c8028 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.204773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d95e5f-5239-4a8b-ba6e-814b646c7ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.205399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d95e5f-5239-4a8b-ba6e-814b646c7ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.205683 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d95e5f-5239-4a8b-ba6e-814b646c7ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.205958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d95e5f-5239-4a8b-ba6e-814b646c7ddc admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.206792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d95e5f-5239-4a8b-ba6e-814b646c7ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.208944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d95e5f-5239-4a8b-ba6e-814b646c7ddc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.231422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dbf28-4417-4cac-8635-ed0df224e8e6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.231924 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1062/2111] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:56 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:56.235532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d95e5f-5239-4a8b-ba6e-814b646c7ddc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.236590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5cc55-3a9d-4514-87d2-c09e32322a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.237305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5cc55-3a9d-4514-87d2-c09e32322a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.237426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-76d95e5f-5239-4a8b-ba6e-814b646c7ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:56.237700 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5cc55-3a9d-4514-87d2-c09e32322a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.238039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5cc55-3a9d-4514-87d2-c09e32322a36 admin admin] PATH_INFO: `/v3/users/a6590e2953474c96b7cad32e32dd75f4` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.239260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5cc55-3a9d-4514-87d2-c09e32322a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6590e2953474c96b7cad32e32dd75f4)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.241479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5cc55-3a9d-4514-87d2-c09e32322a36 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.249524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d95e5f-5239-4a8b-ba6e-814b646c7ddc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.254383 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fafba-0ec3-4b7a-9dcd-08b14377399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.255000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fafba-0ec3-4b7a-9dcd-08b14377399e admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.255289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fafba-0ec3-4b7a-9dcd-08b14377399e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.255571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fafba-0ec3-4b7a-9dcd-08b14377399e admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.256336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fafba-0ec3-4b7a-9dcd-08b14377399e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.258009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fafba-0ec3-4b7a-9dcd-08b14377399e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.268846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1063/2112] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:56.273047 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fafba-0ec3-4b7a-9dcd-08b14377399e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.284332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fafba-0ec3-4b7a-9dcd-08b14377399e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.289207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93440bec-1fb1-4894-8da4-c514b47ab452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.289845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93440bec-1fb1-4894-8da4-c514b47ab452 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.290136 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93440bec-1fb1-4894-8da4-c514b47ab452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.290419 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93440bec-1fb1-4894-8da4-c514b47ab452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.291110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93440bec-1fb1-4894-8da4-c514b47ab452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.292321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2da5cc55-3a9d-4514-87d2-c09e32322a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6590e2953474c96b7cad32e32dd75f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.292745 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93440bec-1fb1-4894-8da4-c514b47ab452 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.293004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2da5cc55-3a9d-4514-87d2-c09e32322a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6590e2953474c96b7cad32e32dd75f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.303832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1064/2113] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:56.307859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93440bec-1fb1-4894-8da4-c514b47ab452 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.308435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2da5cc55-3a9d-4514-87d2-c09e32322a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6590e2953474c96b7cad32e32dd75f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.316671 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2da5cc55-3a9d-4514-87d2-c09e32322a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6590e2953474c96b7cad32e32dd75f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.318987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93440bec-1fb1-4894-8da4-c514b47ab452 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.323954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a4b5d-7386-4205-af9c-685dbc45bce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.324113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2da5cc55-3a9d-4514-87d2-c09e32322a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6590e2953474c96b7cad32e32dd75f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.324653 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a4b5d-7386-4205-af9c-685dbc45bce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.324941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a4b5d-7386-4205-af9c-685dbc45bce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.325224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a4b5d-7386-4205-af9c-685dbc45bce4 admin admin] PATH_INFO: `/v3/projects/6327f85548ef4223a81fe902806f02f5/users/d6bddca4ae0a44679def7ee2a24e0d50/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.330897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1050/2114] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:56 2022] DELETE /identity/v3/users/a6590e2953474c96b7cad32e32dd75f4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:56.343890 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a4b5d-7386-4205-af9c-685dbc45bce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6327f85548ef4223a81fe902806f02f5, user_id=d6bddca4ae0a44679def7ee2a24e0d50, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.346533 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a4b5d-7386-4205-af9c-685dbc45bce4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.360733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1065/2115] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:56 2022] PUT /identity/v3/projects/6327f85548ef4223a81fe902806f02f5/users/d6bddca4ae0a44679def7ee2a24e0d50/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:56.371038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aa31c-6299-49af-8ce1-9612de3675ba None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.371702 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aa31c-6299-49af-8ce1-9612de3675ba None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.372093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aa31c-6299-49af-8ce1-9612de3675ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.402035 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-405aa31c-6299-49af-8ce1-9612de3675ba None None] MFA Rules not processed for user `d6bddca4ae0a44679def7ee2a24e0d50`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:56.403374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-405aa31c-6299-49af-8ce1-9612de3675ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:56.475708 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1051/2116] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:56.479846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a4b5d-7386-4205-af9c-685dbc45bce4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.481755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-680a4b5d-7386-4205-af9c-685dbc45bce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:56.551814 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a4b5d-7386-4205-af9c-685dbc45bce4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.556885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594020e-c3fb-4bbe-9c27-0d561fb80bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.557512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594020e-c3fb-4bbe-9c27-0d561fb80bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.557789 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594020e-c3fb-4bbe-9c27-0d561fb80bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.558073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594020e-c3fb-4bbe-9c27-0d561fb80bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.558749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594020e-c3fb-4bbe-9c27-0d561fb80bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.560702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594020e-c3fb-4bbe-9c27-0d561fb80bfd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.590385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1066/2117] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:56 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:56.594522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405aa31c-6299-49af-8ce1-9612de3675ba None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.605637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405aa31c-6299-49af-8ce1-9612de3675ba None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.629872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:56.666241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594020e-c3fb-4bbe-9c27-0d561fb80bfd admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.670734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1594020e-c3fb-4bbe-9c27-0d561fb80bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:56.694359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61aba0-bb55-4b2a-9717-7a74db084f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.695258 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61aba0-bb55-4b2a-9717-7a74db084f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.695786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61aba0-bb55-4b2a-9717-7a74db084f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.696195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61aba0-bb55-4b2a-9717-7a74db084f01 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.696975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61aba0-bb55-4b2a-9717-7a74db084f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.699506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61aba0-bb55-4b2a-9717-7a74db084f01 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.728071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:56.752672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1052/2118] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:56 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:56.758516 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61aba0-bb55-4b2a-9717-7a74db084f01 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.769284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61aba0-bb55-4b2a-9717-7a74db084f01 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.774202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153d0b0-edba-42d5-acd7-c6c945470867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.774932 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153d0b0-edba-42d5-acd7-c6c945470867 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.775284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153d0b0-edba-42d5-acd7-c6c945470867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.775643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153d0b0-edba-42d5-acd7-c6c945470867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.776568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153d0b0-edba-42d5-acd7-c6c945470867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.776722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594020e-c3fb-4bbe-9c27-0d561fb80bfd admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.778333 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153d0b0-edba-42d5-acd7-c6c945470867 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.782668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.783397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.783994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.784382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] PATH_INFO: `/v3/projects/5e6aa56c389b45f1b63b3a2b4008de8d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.786731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6aa56c389b45f1b63b3a2b4008de8d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.788832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1053/2119] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:56.792055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.793031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153d0b0-edba-42d5-acd7-c6c945470867 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.806106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153d0b0-edba-42d5-acd7-c6c945470867 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.818211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f1696-beb5-490e-b51b-e1737a672dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.819404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f1696-beb5-490e-b51b-e1737a672dba admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.819857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f1696-beb5-490e-b51b-e1737a672dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.820391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f1696-beb5-490e-b51b-e1737a672dba admin admin] PATH_INFO: `/v3/projects/8f7adb90bc594c7eb4519e7592c7207a/users/7cdaf8738a2e4a16918ac38dca55a46f/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.840035 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f1696-beb5-490e-b51b-e1737a672dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7adb90bc594c7eb4519e7592c7207a, user_id=7cdaf8738a2e4a16918ac38dca55a46f, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.843724 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f1696-beb5-490e-b51b-e1737a672dba admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.847465 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6aa56c389b45f1b63b3a2b4008de8d', 'request_id': 'req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.855876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6aa56c389b45f1b63b3a2b4008de8d', 'request_id': 'req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.860906 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1054/2120] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:56 2022] PUT /identity/v3/projects/8f7adb90bc594c7eb4519e7592c7207a/users/7cdaf8738a2e4a16918ac38dca55a46f/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:56.864732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f1696-beb5-490e-b51b-e1737a672dba admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.873898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6aa56c389b45f1b63b3a2b4008de8d', 'request_id': 'req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.887144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] The token cache is being invalidate because project 5e6aa56c389b45f1b63b3a2b4008de8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:56.887435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.888220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:56.889772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1067/2121] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:56 2022] DELETE /identity/v3/projects/5e6aa56c389b45f1b63b3a2b4008de8d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:56.893766 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.895096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:56.932787 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f1696-beb5-490e-b51b-e1737a672dba admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.938250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58562d-707b-4776-aac1-26f2af8d31cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.939073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58562d-707b-4776-aac1-26f2af8d31cd admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.939360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58562d-707b-4776-aac1-26f2af8d31cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.939636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58562d-707b-4776-aac1-26f2af8d31cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.940889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58562d-707b-4776-aac1-26f2af8d31cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.942855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58562d-707b-4776-aac1-26f2af8d31cd admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.953413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1055/2122] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:56.957915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58562d-707b-4776-aac1-26f2af8d31cd admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:56.959547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5f58562d-707b-4776-aac1-26f2af8d31cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:56.963699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fde17-4fe8-430a-97ce-bd1a425eb5a1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.969046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.969719 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.970028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.970281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] PATH_INFO: `/v3/users/23ed0f7b9ddd4bea915865d1b4be077e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.971463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ed0f7b9ddd4bea915865d1b4be077e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.972011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58562d-707b-4776-aac1-26f2af8d31cd admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:56.973436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.977818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf59ad1-167e-4767-bdf8-8d1cd95b9189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:56.978647 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf59ad1-167e-4767-bdf8-8d1cd95b9189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:56.978759 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf59ad1-167e-4767-bdf8-8d1cd95b9189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:56.979036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf59ad1-167e-4767-bdf8-8d1cd95b9189 admin admin] PATH_INFO: `/v3/projects/8f7adb90bc594c7eb4519e7592c7207a/users/7cdaf8738a2e4a16918ac38dca55a46f/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:56.981253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf59ad1-167e-4767-bdf8-8d1cd95b9189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7adb90bc594c7eb4519e7592c7207a, user_id=7cdaf8738a2e4a16918ac38dca55a46f, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:56.984451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf59ad1-167e-4767-bdf8-8d1cd95b9189 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:56.995031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1056/2123] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:56 2022] PUT /identity/v3/projects/8f7adb90bc594c7eb4519e7592c7207a/users/7cdaf8738a2e4a16918ac38dca55a46f/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:57.006813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda549c3-6c00-4798-9f08-2df7182095b8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:57.007142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda549c3-6c00-4798-9f08-2df7182095b8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:57.007439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda549c3-6c00-4798-9f08-2df7182095b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:57.027236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ed0f7b9ddd4bea915865d1b4be077e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:57.028642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ed0f7b9ddd4bea915865d1b4be077e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:57.036514 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ed0f7b9ddd4bea915865d1b4be077e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:57.037080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cda549c3-6c00-4798-9f08-2df7182095b8 None None] MFA Rules not processed for user `7cdaf8738a2e4a16918ac38dca55a46f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:57.038288 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cda549c3-6c00-4798-9f08-2df7182095b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:57.039017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:57.053095 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ed0f7b9ddd4bea915865d1b4be077e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:57.060390 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ed0f7b9ddd4bea915865d1b4be077e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:57.067043 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1068/2124] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:56 2022] DELETE /identity/v3/users/23ed0f7b9ddd4bea915865d1b4be077e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:57.099443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:57.127733 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1057/2125] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:57.139415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:57.141127 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:57.216625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e4352-14aa-47a0-94e4-626a2b806d37 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:57.226034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59febe-2b18-40f4-8396-a607afd0893d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:57.226730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59febe-2b18-40f4-8396-a607afd0893d service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:57.226960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59febe-2b18-40f4-8396-a607afd0893d service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:57.227236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59febe-2b18-40f4-8396-a607afd0893d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:57.310861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59febe-2b18-40f4-8396-a607afd0893d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:57.313122 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59febe-2b18-40f4-8396-a607afd0893d service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:57.335885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1069/2126] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:57.373023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda549c3-6c00-4798-9f08-2df7182095b8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:57.375335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cda549c3-6c00-4798-9f08-2df7182095b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:57.469526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda549c3-6c00-4798-9f08-2df7182095b8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:57.508236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59febe-2b18-40f4-8396-a607afd0893d service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:57.521666 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59febe-2b18-40f4-8396-a607afd0893d service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:57.526333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c862e1-4375-4186-9f5a-66b235d68107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:57.527017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c862e1-4375-4186-9f5a-66b235d68107 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:57.527370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c862e1-4375-4186-9f5a-66b235d68107 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:57.527714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c862e1-4375-4186-9f5a-66b235d68107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:57.529595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e5c862e1-4375-4186-9f5a-66b235d68107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:57.539687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9aa099-de22-4be2-a921-8548c41d806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:57.540375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9aa099-de22-4be2-a921-8548c41d806d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:57.540663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9aa099-de22-4be2-a921-8548c41d806d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:57.540946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9aa099-de22-4be2-a921-8548c41d806d admin admin] PATH_INFO: `/v3/projects/a023c191ddb54a90832dc823a421ac2d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:57.542111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9aa099-de22-4be2-a921-8548c41d806d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a023c191ddb54a90832dc823a421ac2d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:57.544114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9aa099-de22-4be2-a921-8548c41d806d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:57.605804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c862e1-4375-4186-9f5a-66b235d68107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:57.607312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c862e1-4375-4186-9f5a-66b235d68107 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:57.614709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fc9aa099-de22-4be2-a921-8548c41d806d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a023c191ddb54a90832dc823a421ac2d', 'request_id': 'req-fc9aa099-de22-4be2-a921-8548c41d806d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:57.618167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1070/2127] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:57.620534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fc9aa099-de22-4be2-a921-8548c41d806d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a023c191ddb54a90832dc823a421ac2d', 'request_id': 'req-fc9aa099-de22-4be2-a921-8548c41d806d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:57.627301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fc9aa099-de22-4be2-a921-8548c41d806d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a023c191ddb54a90832dc823a421ac2d', 'request_id': 'req-fc9aa099-de22-4be2-a921-8548c41d806d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:57.641263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fc9aa099-de22-4be2-a921-8548c41d806d admin admin] The token cache is being invalidate because project a023c191ddb54a90832dc823a421ac2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:57.641452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fc9aa099-de22-4be2-a921-8548c41d806d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:57.642194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fc9aa099-de22-4be2-a921-8548c41d806d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:57.643949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1058/2128] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:57 2022] DELETE /identity/v3/projects/a023c191ddb54a90832dc823a421ac2d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:57.649926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31a4fc-292c-4056-b9cd-724f2fba881a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:57.650335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31a4fc-292c-4056-b9cd-724f2fba881a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:57.650621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31a4fc-292c-4056-b9cd-724f2fba881a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:57.673289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4d31a4fc-292c-4056-b9cd-724f2fba881a None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:57.674501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4d31a4fc-292c-4056-b9cd-724f2fba881a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:57.696146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:57.752491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1071/2129] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:57.762159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3de7c-6a72-4ece-ba0a-6d20eab08ed5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:57.762428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3de7c-6a72-4ece-ba0a-6d20eab08ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:57.762718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3de7c-6a72-4ece-ba0a-6d20eab08ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:57.783846 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0fd3de7c-6a72-4ece-ba0a-6d20eab08ed5 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:57.785305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0fd3de7c-6a72-4ece-ba0a-6d20eab08ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:57.796961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1059/2130] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:57.807007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31a4fc-292c-4056-b9cd-724f2fba881a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:57.823876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31a4fc-292c-4056-b9cd-724f2fba881a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:57.831363 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98632d7-0b64-4083-ab12-136a3efbc6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:57.832018 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98632d7-0b64-4083-ab12-136a3efbc6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:57.832336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98632d7-0b64-4083-ab12-136a3efbc6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:57.832885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98632d7-0b64-4083-ab12-136a3efbc6e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:57.833597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98632d7-0b64-4083-ab12-136a3efbc6e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:54:57.833915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98632d7-0b64-4083-ab12-136a3efbc6e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:57.835712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98632d7-0b64-4083-ab12-136a3efbc6e8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:57.855677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1072/2131] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:54:57.861022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3de7c-6a72-4ece-ba0a-6d20eab08ed5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:57.878980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3de7c-6a72-4ece-ba0a-6d20eab08ed5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:57.883992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80a66-1557-413a-8555-19c668efb231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:57.884751 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80a66-1557-413a-8555-19c668efb231 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:57.885127 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80a66-1557-413a-8555-19c668efb231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:57.885502 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80a66-1557-413a-8555-19c668efb231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:57.886391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c80a66-1557-413a-8555-19c668efb231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:57.888826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c80a66-1557-413a-8555-19c668efb231 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:57.920145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:57.930460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1060/2132] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:57 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:57.934691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98632d7-0b64-4083-ab12-136a3efbc6e8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:57.945963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98632d7-0b64-4083-ab12-136a3efbc6e8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:57.972175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80a66-1557-413a-8555-19c668efb231 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:57.973960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f2c80a66-1557-413a-8555-19c668efb231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:58.023060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a288381-80c8-4404-ad40-1bbc1ba74f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.023510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a288381-80c8-4404-ad40-1bbc1ba74f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.023804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a288381-80c8-4404-ad40-1bbc1ba74f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.024102 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a288381-80c8-4404-ad40-1bbc1ba74f8d admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.024746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a288381-80c8-4404-ad40-1bbc1ba74f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.026725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a288381-80c8-4404-ad40-1bbc1ba74f8d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.044892 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80a66-1557-413a-8555-19c668efb231 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.049650 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1073/2133] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:57 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:54:58.049843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9b38a-6739-4029-a81f-c6a5127d1394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.050607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9b38a-6739-4029-a81f-c6a5127d1394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.051011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9b38a-6739-4029-a81f-c6a5127d1394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.051299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9b38a-6739-4029-a81f-c6a5127d1394 admin admin] PATH_INFO: `/v3/users/d6bddca4ae0a44679def7ee2a24e0d50` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.052535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9b38a-6739-4029-a81f-c6a5127d1394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bddca4ae0a44679def7ee2a24e0d50)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.053884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a288381-80c8-4404-ad40-1bbc1ba74f8d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.058521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9b38a-6739-4029-a81f-c6a5127d1394 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.066810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a288381-80c8-4404-ad40-1bbc1ba74f8d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.072512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b844bde-d682-4bdd-9591-d1a49848720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.073129 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b844bde-d682-4bdd-9591-d1a49848720f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.073431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b844bde-d682-4bdd-9591-d1a49848720f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.074244 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b844bde-d682-4bdd-9591-d1a49848720f admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.074513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b844bde-d682-4bdd-9591-d1a49848720f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.076003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b844bde-d682-4bdd-9591-d1a49848720f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.088112 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1074/2134] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:58.092247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b844bde-d682-4bdd-9591-d1a49848720f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.102869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b844bde-d682-4bdd-9591-d1a49848720f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.107543 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12341237-cc5d-4f0e-8cb6-fa9fb46de4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.108160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12341237-cc5d-4f0e-8cb6-fa9fb46de4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.108572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12341237-cc5d-4f0e-8cb6-fa9fb46de4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.109089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12341237-cc5d-4f0e-8cb6-fa9fb46de4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.109649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12341237-cc5d-4f0e-8cb6-fa9fb46de4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.111339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12341237-cc5d-4f0e-8cb6-fa9fb46de4ad admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.114459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-11a9b38a-6739-4029-a81f-c6a5127d1394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bddca4ae0a44679def7ee2a24e0d50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.115217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-11a9b38a-6739-4029-a81f-c6a5127d1394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bddca4ae0a44679def7ee2a24e0d50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.121327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1075/2135] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:54:58.125827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12341237-cc5d-4f0e-8cb6-fa9fb46de4ad admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.128201 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-11a9b38a-6739-4029-a81f-c6a5127d1394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bddca4ae0a44679def7ee2a24e0d50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.136422 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12341237-cc5d-4f0e-8cb6-fa9fb46de4ad admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.137968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-11a9b38a-6739-4029-a81f-c6a5127d1394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bddca4ae0a44679def7ee2a24e0d50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.142288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d0b38-859c-422e-8b08-f432da4fd366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.143018 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d0b38-859c-422e-8b08-f432da4fd366 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.143374 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d0b38-859c-422e-8b08-f432da4fd366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.143721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d0b38-859c-422e-8b08-f432da4fd366 admin admin] PATH_INFO: `/v3/projects/7a96d5b91988426cad508d60a4e7cc8b/users/6a482dbf453c466680229d5c837a8f52/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.145833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-11a9b38a-6739-4029-a81f-c6a5127d1394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bddca4ae0a44679def7ee2a24e0d50'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.151758 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1061/2136] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:57 2022] DELETE /identity/v3/users/d6bddca4ae0a44679def7ee2a24e0d50 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:58.156102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc38dd1-a7b9-4524-89a3-9574c6ca5a36 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.156426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc38dd1-a7b9-4524-89a3-9574c6ca5a36 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.156706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc38dd1-a7b9-4524-89a3-9574c6ca5a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.160585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d0b38-859c-422e-8b08-f432da4fd366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a96d5b91988426cad508d60a4e7cc8b, user_id=6a482dbf453c466680229d5c837a8f52, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.163324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d0b38-859c-422e-8b08-f432da4fd366 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.176553 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bbc38dd1-a7b9-4524-89a3-9574c6ca5a36 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:58.177473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1076/2137] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:58 2022] PUT /identity/v3/projects/7a96d5b91988426cad508d60a4e7cc8b/users/6a482dbf453c466680229d5c837a8f52/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:58.177743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bbc38dd1-a7b9-4524-89a3-9574c6ca5a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:58.189119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3a4d-fe16-4578-b356-72af2c403990 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.189407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3a4d-fe16-4578-b356-72af2c403990 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.189689 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3a4d-fe16-4578-b356-72af2c403990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.217478 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-163f3a4d-fe16-4578-b356-72af2c403990 None None] MFA Rules not processed for user `6a482dbf453c466680229d5c837a8f52`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:58.218714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-163f3a4d-fe16-4578-b356-72af2c403990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:58.238505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1062/2138] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:58.248811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc38dd1-a7b9-4524-89a3-9574c6ca5a36 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.250848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bbc38dd1-a7b9-4524-89a3-9574c6ca5a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:58.261082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:58.270164 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:58.288377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1077/2139] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:54:58.292528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f3a4d-fe16-4578-b356-72af2c403990 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.294192 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-163f3a4d-fe16-4578-b356-72af2c403990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:58.310745 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f3a4d-fe16-4578-b356-72af2c403990 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.317559 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff334a77-77d0-459a-b7c7-7f58d5013950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.318266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334a77-77d0-459a-b7c7-7f58d5013950 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.318619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334a77-77d0-459a-b7c7-7f58d5013950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.318998 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334a77-77d0-459a-b7c7-7f58d5013950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.319721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334a77-77d0-459a-b7c7-7f58d5013950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.320306 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc38dd1-a7b9-4524-89a3-9574c6ca5a36 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.321859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334a77-77d0-459a-b7c7-7f58d5013950 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.323956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5333a-0377-46d5-a1a0-9fa2aed20f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.324676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5333a-0377-46d5-a1a0-9fa2aed20f05 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.324956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5333a-0377-46d5-a1a0-9fa2aed20f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.325231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5333a-0377-46d5-a1a0-9fa2aed20f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.335184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5333a-0377-46d5-a1a0-9fa2aed20f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.336694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5333a-0377-46d5-a1a0-9fa2aed20f05 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.347069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1063/2140] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:54:58.349997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1078/2141] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:54:58 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:58.353864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5333a-0377-46d5-a1a0-9fa2aed20f05 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.364023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5333a-0377-46d5-a1a0-9fa2aed20f05 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.429008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1e50e-a9db-45e6-ae56-ecfc4ccac7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.429008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1e50e-a9db-45e6-ae56-ecfc4ccac7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.429008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1e50e-a9db-45e6-ae56-ecfc4ccac7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.430029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1e50e-a9db-45e6-ae56-ecfc4ccac7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.430829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1e50e-a9db-45e6-ae56-ecfc4ccac7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.434201 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1e50e-a9db-45e6-ae56-ecfc4ccac7d2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.466253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1064/2142] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:54:58 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:54:58.468265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff334a77-77d0-459a-b7c7-7f58d5013950 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.480957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff334a77-77d0-459a-b7c7-7f58d5013950 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.485818 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e854c-0500-43cb-a4a6-febd18391b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.486442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e854c-0500-43cb-a4a6-febd18391b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.486722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e854c-0500-43cb-a4a6-febd18391b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.487242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e854c-0500-43cb-a4a6-febd18391b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.487690 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e854c-0500-43cb-a4a6-febd18391b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.489568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e854c-0500-43cb-a4a6-febd18391b42 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.505441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1e50e-a9db-45e6-ae56-ecfc4ccac7d2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.507364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-56b1e50e-a9db-45e6-ae56-ecfc4ccac7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:58.517602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1079/2143] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:58.519473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e854c-0500-43cb-a4a6-febd18391b42 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.523036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1e50e-a9db-45e6-ae56-ecfc4ccac7d2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.527930 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.528617 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.528908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.529186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] PATH_INFO: `/v3/users/9f387e66cb964282b2dfb2de377451f3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.531271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f387e66cb964282b2dfb2de377451f3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.532724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e854c-0500-43cb-a4a6-febd18391b42 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.535178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.537800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdbfc1-b9cc-456e-a15c-2ad89c98449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.538623 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdbfc1-b9cc-456e-a15c-2ad89c98449e admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.538912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdbfc1-b9cc-456e-a15c-2ad89c98449e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.539526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdbfc1-b9cc-456e-a15c-2ad89c98449e admin admin] PATH_INFO: `/v3/projects/83360f71cda24f26a7d7f6aa34f425f9/users/4186ade9500e46f3a175ea5fc064ed9e/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.557048 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdbfc1-b9cc-456e-a15c-2ad89c98449e admin admin] RBAC: Authorizing `identity:create_grant(project_id=83360f71cda24f26a7d7f6aa34f425f9, user_id=4186ade9500e46f3a175ea5fc064ed9e, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.563459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdbfc1-b9cc-456e-a15c-2ad89c98449e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.580812 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1080/2144] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:58 2022] PUT /identity/v3/projects/83360f71cda24f26a7d7f6aa34f425f9/users/4186ade9500e46f3a175ea5fc064ed9e/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:58.584914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdbfc1-b9cc-456e-a15c-2ad89c98449e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.591623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f387e66cb964282b2dfb2de377451f3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.592531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f387e66cb964282b2dfb2de377451f3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.606937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f387e66cb964282b2dfb2de377451f3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.623204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f387e66cb964282b2dfb2de377451f3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.637046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f387e66cb964282b2dfb2de377451f3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.648379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1065/2145] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:58 2022] DELETE /identity/v3/users/9f387e66cb964282b2dfb2de377451f3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:58.649562 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.651212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:58.662890 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdbfc1-b9cc-456e-a15c-2ad89c98449e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.676036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:58.727761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71593faa-49aa-47c0-ab0a-f2be9a2f63ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.728421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71593faa-49aa-47c0-ab0a-f2be9a2f63ff admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.728634 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03494e1-9ddc-4e2c-bd2f-4c645a338de6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.728734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71593faa-49aa-47c0-ab0a-f2be9a2f63ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.728984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71593faa-49aa-47c0-ab0a-f2be9a2f63ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.729685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71593faa-49aa-47c0-ab0a-f2be9a2f63ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.731297 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71593faa-49aa-47c0-ab0a-f2be9a2f63ff admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.733629 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.734453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.735185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.735366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] PATH_INFO: `/v3/projects/6327f85548ef4223a81fe902806f02f5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.736563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6327f85548ef4223a81fe902806f02f5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.738468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.743104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1081/2146] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:54:58.744613 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0387013-1812-4150-bcc6-f65b870d292e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.744896 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0387013-1812-4150-bcc6-f65b870d292e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.745184 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0387013-1812-4150-bcc6-f65b870d292e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.765782 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c0387013-1812-4150-bcc6-f65b870d292e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:58.767020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c0387013-1812-4150-bcc6-f65b870d292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:58.778666 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1082/2147] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:58.779646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0387013-1812-4150-bcc6-f65b870d292e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.781098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c0387013-1812-4150-bcc6-f65b870d292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:58.793755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0387013-1812-4150-bcc6-f65b870d292e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.807913 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6327f85548ef4223a81fe902806f02f5', 'request_id': 'req-f3e6c652-766d-4595-a67c-ea49f543b9a5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.813970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:58.817824 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6327f85548ef4223a81fe902806f02f5', 'request_id': 'req-f3e6c652-766d-4595-a67c-ea49f543b9a5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.825463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6327f85548ef4223a81fe902806f02f5', 'request_id': 'req-f3e6c652-766d-4595-a67c-ea49f543b9a5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.839910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] The token cache is being invalidate because project 6327f85548ef4223a81fe902806f02f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:58.840231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.840967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:58.842589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1066/2148] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:58 2022] DELETE /identity/v3/projects/6327f85548ef4223a81fe902806f02f5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:58.843417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.844770 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:58.858846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ab6bf-c72b-4e9e-b552-7f47278c5268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.859539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ab6bf-c72b-4e9e-b552-7f47278c5268 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.859948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ab6bf-c72b-4e9e-b552-7f47278c5268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.860259 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ab6bf-c72b-4e9e-b552-7f47278c5268 admin admin] PATH_INFO: `/v3/projects/83360f71cda24f26a7d7f6aa34f425f9/users/4186ade9500e46f3a175ea5fc064ed9e/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.862248 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ab6bf-c72b-4e9e-b552-7f47278c5268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83360f71cda24f26a7d7f6aa34f425f9, user_id=4186ade9500e46f3a175ea5fc064ed9e, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:58.865054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ab6bf-c72b-4e9e-b552-7f47278c5268 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:58.876025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1083/2149] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:54:58 2022] PUT /identity/v3/projects/83360f71cda24f26a7d7f6aa34f425f9/users/4186ade9500e46f3a175ea5fc064ed9e/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:58.876938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ab6bf-c72b-4e9e-b552-7f47278c5268 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:58.890597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cd1ab6bf-c72b-4e9e-b552-7f47278c5268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:58.905142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6c652-766d-4595-a67c-ea49f543b9a5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.965935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fc7e7-694c-43ba-9e2c-236d1ea2d1cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.966661 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc7e7-694c-43ba-9e2c-236d1ea2d1cf service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.967248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc7e7-694c-43ba-9e2c-236d1ea2d1cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.967548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc7e7-694c-43ba-9e2c-236d1ea2d1cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.970768 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a54fc7e7-694c-43ba-9e2c-236d1ea2d1cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:58.988701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ab6bf-c72b-4e9e-b552-7f47278c5268 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:58.991990 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:58.995070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:58.995727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:58.996011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:58.996319 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] PATH_INFO: `/v3/users/7cdaf8738a2e4a16918ac38dca55a46f` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:58.997541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdaf8738a2e4a16918ac38dca55a46f)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:59.000013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:59.046392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fc7e7-694c-43ba-9e2c-236d1ea2d1cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:59.047897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fc7e7-694c-43ba-9e2c-236d1ea2d1cf service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:59.058254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1067/2150] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:59.063636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b2f04-0080-4237-8431-db7623514925 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:59.063636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b2f04-0080-4237-8431-db7623514925 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:59.064303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdaf8738a2e4a16918ac38dca55a46f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.064923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b2f04-0080-4237-8431-db7623514925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:59.065424 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdaf8738a2e4a16918ac38dca55a46f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.078207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdaf8738a2e4a16918ac38dca55a46f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.101629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdaf8738a2e4a16918ac38dca55a46f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.111871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdaf8738a2e4a16918ac38dca55a46f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.121608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-903b2f04-0080-4237-8431-db7623514925 None None] MFA Rules not processed for user `4186ade9500e46f3a175ea5fc064ed9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:59.122996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-903b2f04-0080-4237-8431-db7623514925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:59.127841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1084/2151] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:54:58 2022] DELETE /identity/v3/users/7cdaf8738a2e4a16918ac38dca55a46f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:59.237907 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1068/2152] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:59.248770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:59.250774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:59.303402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:59.346762 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb886cb-bbf0-42a6-9ba1-050f97e8d3cc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:59.351385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fcecb-e2f1-4a8d-9b65-9e785a01f8c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:59.352021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fcecb-e2f1-4a8d-9b65-9e785a01f8c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:59.353049 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fcecb-e2f1-4a8d-9b65-9e785a01f8c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:59.353341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fcecb-e2f1-4a8d-9b65-9e785a01f8c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:59.355201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-200fcecb-e2f1-4a8d-9b65-9e785a01f8c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:59.421050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fcecb-e2f1-4a8d-9b65-9e785a01f8c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:59.422632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fcecb-e2f1-4a8d-9b65-9e785a01f8c8 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:59.432054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1085/2153] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:54:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:54:59.553686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b2f04-0080-4237-8431-db7623514925 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:59.555309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-903b2f04-0080-4237-8431-db7623514925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:59.565516 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fcecb-e2f1-4a8d-9b65-9e785a01f8c8 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:54:59.569395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-200fcecb-e2f1-4a8d-9b65-9e785a01f8c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:59.570302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b2f04-0080-4237-8431-db7623514925 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:59.650372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84ec75-4381-452f-ac8f-e6e6aca2e025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:59.651158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84ec75-4381-452f-ac8f-e6e6aca2e025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:59.651569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84ec75-4381-452f-ac8f-e6e6aca2e025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:59.651936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84ec75-4381-452f-ac8f-e6e6aca2e025 admin admin] PATH_INFO: `/v3/projects/8f7adb90bc594c7eb4519e7592c7207a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:59.653229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84ec75-4381-452f-ac8f-e6e6aca2e025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7adb90bc594c7eb4519e7592c7207a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:59.655324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84ec75-4381-452f-ac8f-e6e6aca2e025 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:59.725467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:59.730664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4b84ec75-4381-452f-ac8f-e6e6aca2e025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7adb90bc594c7eb4519e7592c7207a', 'request_id': 'req-4b84ec75-4381-452f-ac8f-e6e6aca2e025'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.737764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fcecb-e2f1-4a8d-9b65-9e785a01f8c8 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:54:59.740847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4b84ec75-4381-452f-ac8f-e6e6aca2e025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7adb90bc594c7eb4519e7592c7207a', 'request_id': 'req-4b84ec75-4381-452f-ac8f-e6e6aca2e025'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.752877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4b84ec75-4381-452f-ac8f-e6e6aca2e025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7adb90bc594c7eb4519e7592c7207a', 'request_id': 'req-4b84ec75-4381-452f-ac8f-e6e6aca2e025'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.775443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4b84ec75-4381-452f-ac8f-e6e6aca2e025 admin admin] The token cache is being invalidate because project 8f7adb90bc594c7eb4519e7592c7207a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:59.776150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4b84ec75-4381-452f-ac8f-e6e6aca2e025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.777419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4b84ec75-4381-452f-ac8f-e6e6aca2e025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.780885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1069/2154] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:59 2022] DELETE /identity/v3/projects/8f7adb90bc594c7eb4519e7592c7207a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:54:59.787969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc196b1-6984-4742-995c-77daf0547a00 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:59.788636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc196b1-6984-4742-995c-77daf0547a00 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:59.789375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc196b1-6984-4742-995c-77daf0547a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:59.824998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4dc196b1-6984-4742-995c-77daf0547a00 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:59.828106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4dc196b1-6984-4742-995c-77daf0547a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:59.860726 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8989f-b0c3-4a03-a528-155751dbfe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:54:59.861303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8989f-b0c3-4a03-a528-155751dbfe1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:59.864250 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8989f-b0c3-4a03-a528-155751dbfe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:59.864250 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8989f-b0c3-4a03-a528-155751dbfe1e admin admin] PATH_INFO: `/v3/projects/f73ecd5771a04d0fbf61b5792d93a31f` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:59.864912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8989f-b0c3-4a03-a528-155751dbfe1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73ecd5771a04d0fbf61b5792d93a31f)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:54:59.867520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8989f-b0c3-4a03-a528-155751dbfe1e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:54:59.917938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1070/2155] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:54:59.922807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:59.926284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb731dd7-8780-467b-9437-968c371e901b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:59.926726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb731dd7-8780-467b-9437-968c371e901b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:59.926875 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb731dd7-8780-467b-9437-968c371e901b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:59.931694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5bb8989f-b0c3-4a03-a528-155751dbfe1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73ecd5771a04d0fbf61b5792d93a31f', 'request_id': 'req-5bb8989f-b0c3-4a03-a528-155751dbfe1e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.937475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5bb8989f-b0c3-4a03-a528-155751dbfe1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73ecd5771a04d0fbf61b5792d93a31f', 'request_id': 'req-5bb8989f-b0c3-4a03-a528-155751dbfe1e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.944968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5bb8989f-b0c3-4a03-a528-155751dbfe1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73ecd5771a04d0fbf61b5792d93a31f', 'request_id': 'req-5bb8989f-b0c3-4a03-a528-155751dbfe1e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.947925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-eb731dd7-8780-467b-9437-968c371e901b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:59.949162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-eb731dd7-8780-467b-9437-968c371e901b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:54:59.956915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5bb8989f-b0c3-4a03-a528-155751dbfe1e admin admin] The token cache is being invalidate because project f73ecd5771a04d0fbf61b5792d93a31f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:54:59.957841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5bb8989f-b0c3-4a03-a528-155751dbfe1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.958486 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5bb8989f-b0c3-4a03-a528-155751dbfe1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:54:59.959993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1086/2156] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:54:59 2022] DELETE /identity/v3/projects/f73ecd5771a04d0fbf61b5792d93a31f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:54:59.964614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb49e-1c5c-4e73-a0d1-26826b9f3ad0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:54:59.964930 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb49e-1c5c-4e73-a0d1-26826b9f3ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:54:59.965326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb49e-1c5c-4e73-a0d1-26826b9f3ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:54:59.985648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-956bb49e-1c5c-4e73-a0d1-26826b9f3ad0 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:54:59.986852 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-956bb49e-1c5c-4e73-a0d1-26826b9f3ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:00.011643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1071/2157] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:55:00.016483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb731dd7-8780-467b-9437-968c371e901b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.025255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb731dd7-8780-467b-9437-968c371e901b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.029887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7eeeb4-11bd-4825-bd19-0ba61944a4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.031090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7eeeb4-11bd-4825-bd19-0ba61944a4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.031375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7eeeb4-11bd-4825-bd19-0ba61944a4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.031645 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7eeeb4-11bd-4825-bd19-0ba61944a4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.032401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7eeeb4-11bd-4825-bd19-0ba61944a4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:55:00.032706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7eeeb4-11bd-4825-bd19-0ba61944a4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.034308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7eeeb4-11bd-4825-bd19-0ba61944a4c9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.046014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1072/2158] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:55:00.049445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1087/2159] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:55:00.050295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7eeeb4-11bd-4825-bd19-0ba61944a4c9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.056632 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d82fe7-b5b1-4bd1-ba41-ade95bf7d964 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.056924 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d82fe7-b5b1-4bd1-ba41-ade95bf7d964 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.057254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d82fe7-b5b1-4bd1-ba41-ade95bf7d964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.060272 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7eeeb4-11bd-4825-bd19-0ba61944a4c9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.065244 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf2868-2bcc-4d2b-a411-ac8c173a0c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.065880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf2868-2bcc-4d2b-a411-ac8c173a0c61 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.066170 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf2868-2bcc-4d2b-a411-ac8c173a0c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.066451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf2868-2bcc-4d2b-a411-ac8c173a0c61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.067113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf2868-2bcc-4d2b-a411-ac8c173a0c61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.069116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf2868-2bcc-4d2b-a411-ac8c173a0c61 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.076860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-64d82fe7-b5b1-4bd1-ba41-ade95bf7d964 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:00.078731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-64d82fe7-b5b1-4bd1-ba41-ade95bf7d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:00.086967 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1088/2160] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:55:00.091185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d82fe7-b5b1-4bd1-ba41-ade95bf7d964 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.098801 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1073/2161] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:55:00 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:55:00.100973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d82fe7-b5b1-4bd1-ba41-ade95bf7d964 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.102835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf2868-2bcc-4d2b-a411-ac8c173a0c61 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.158492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:00.165008 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2d9a8-11f9-4525-a37a-7edc90654936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.165604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2d9a8-11f9-4525-a37a-7edc90654936 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.165895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2d9a8-11f9-4525-a37a-7edc90654936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.166217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2d9a8-11f9-4525-a37a-7edc90654936 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.166874 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2d9a8-11f9-4525-a37a-7edc90654936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:55:00.167190 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2d9a8-11f9-4525-a37a-7edc90654936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.168870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2d9a8-11f9-4525-a37a-7edc90654936 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.184173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1089/2162] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:55:00.189196 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf2868-2bcc-4d2b-a411-ac8c173a0c61 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.189321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2d9a8-11f9-4525-a37a-7edc90654936 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.194676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661051da-7475-4999-98d0-bc96f5622800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.195339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661051da-7475-4999-98d0-bc96f5622800 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.195627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661051da-7475-4999-98d0-bc96f5622800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.195911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661051da-7475-4999-98d0-bc96f5622800 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.197166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661051da-7475-4999-98d0-bc96f5622800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.199107 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661051da-7475-4999-98d0-bc96f5622800 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.200005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2d9a8-11f9-4525-a37a-7edc90654936 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.205498 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b8cb9-371f-4dc0-8e00-2a0b2389c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.206224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b8cb9-371f-4dc0-8e00-2a0b2389c6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.206630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b8cb9-371f-4dc0-8e00-2a0b2389c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.207918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b8cb9-371f-4dc0-8e00-2a0b2389c6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.208058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b8cb9-371f-4dc0-8e00-2a0b2389c6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.211158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b8cb9-371f-4dc0-8e00-2a0b2389c6c9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.225519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1074/2163] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:55:00 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:55:00.230004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661051da-7475-4999-98d0-bc96f5622800 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.244561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1090/2164] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:55:00 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:55:00.244755 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661051da-7475-4999-98d0-bc96f5622800 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.245746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b8cb9-371f-4dc0-8e00-2a0b2389c6c9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.284807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:00.306888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc34f32-ddbd-4da2-a651-31b1eca958d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.307679 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34f32-ddbd-4da2-a651-31b1eca958d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.307980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34f32-ddbd-4da2-a651-31b1eca958d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.308304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34f32-ddbd-4da2-a651-31b1eca958d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.309007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc34f32-ddbd-4da2-a651-31b1eca958d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.310640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc34f32-ddbd-4da2-a651-31b1eca958d7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.321458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b8cb9-371f-4dc0-8e00-2a0b2389c6c9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.321639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1075/2165] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:55:00.325143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc34f32-ddbd-4da2-a651-31b1eca958d7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.326592 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8346bdb-1517-4c42-ba47-cb91bf9612b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.327791 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8346bdb-1517-4c42-ba47-cb91bf9612b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.328081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8346bdb-1517-4c42-ba47-cb91bf9612b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.328388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8346bdb-1517-4c42-ba47-cb91bf9612b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.329200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8346bdb-1517-4c42-ba47-cb91bf9612b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.331298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8346bdb-1517-4c42-ba47-cb91bf9612b7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.335582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc34f32-ddbd-4da2-a651-31b1eca958d7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.340149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce7a58-ab33-443e-8583-e637d2235342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.340757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce7a58-ab33-443e-8583-e637d2235342 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.341042 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce7a58-ab33-443e-8583-e637d2235342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.341323 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce7a58-ab33-443e-8583-e637d2235342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.342017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce7a58-ab33-443e-8583-e637d2235342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.343614 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce7a58-ab33-443e-8583-e637d2235342 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.356958 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1076/2167] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:55:00.357144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1091/2167] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:55:00 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:55:00.358178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce7a58-ab33-443e-8583-e637d2235342 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.358932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8346bdb-1517-4c42-ba47-cb91bf9612b7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.368248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce7a58-ab33-443e-8583-e637d2235342 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.370620 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8346bdb-1517-4c42-ba47-cb91bf9612b7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.373723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150a832-b40d-45e2-9b54-ce79d3006e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.374903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150a832-b40d-45e2-9b54-ce79d3006e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.375186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150a832-b40d-45e2-9b54-ce79d3006e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.375570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150a832-b40d-45e2-9b54-ce79d3006e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.376398 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150a832-b40d-45e2-9b54-ce79d3006e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.376637 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46654f1-eff8-4d56-b8f8-a16175470e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.377316 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46654f1-eff8-4d56-b8f8-a16175470e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.377604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46654f1-eff8-4d56-b8f8-a16175470e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.377912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46654f1-eff8-4d56-b8f8-a16175470e45 admin admin] PATH_INFO: `/v3/projects/a0e2204915244154818f508ce71f77b3/users/4b7997ebcec44d36b29d514aedec5eff/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.379482 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150a832-b40d-45e2-9b54-ce79d3006e58 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.394436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1077/2168] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:55:00.395494 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150a832-b40d-45e2-9b54-ce79d3006e58 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.398710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46654f1-eff8-4d56-b8f8-a16175470e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e2204915244154818f508ce71f77b3, user_id=4b7997ebcec44d36b29d514aedec5eff, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.401503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46654f1-eff8-4d56-b8f8-a16175470e45 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.406062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150a832-b40d-45e2-9b54-ce79d3006e58 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.411988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90da723-f47b-4921-8687-cac0099bcaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.412823 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90da723-f47b-4921-8687-cac0099bcaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.413205 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90da723-f47b-4921-8687-cac0099bcaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.413609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90da723-f47b-4921-8687-cac0099bcaf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.414579 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90da723-f47b-4921-8687-cac0099bcaf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.416807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90da723-f47b-4921-8687-cac0099bcaf5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.421601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1092/2169] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:55:00 2022] PUT /identity/v3/projects/a0e2204915244154818f508ce71f77b3/users/4b7997ebcec44d36b29d514aedec5eff/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:00.429176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1078/2170] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:55:00.433099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90da723-f47b-4921-8687-cac0099bcaf5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.433519 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83195e35-a51a-453d-9f96-f38bbf1fb4a6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.433817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83195e35-a51a-453d-9f96-f38bbf1fb4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.434574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83195e35-a51a-453d-9f96-f38bbf1fb4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.444468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90da723-f47b-4921-8687-cac0099bcaf5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.469892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-83195e35-a51a-453d-9f96-f38bbf1fb4a6 None None] MFA Rules not processed for user `4b7997ebcec44d36b29d514aedec5eff`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:00.471138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-83195e35-a51a-453d-9f96-f38bbf1fb4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:00.510931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21156b9-1ef0-4632-9898-184a3c9c5f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.511584 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21156b9-1ef0-4632-9898-184a3c9c5f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.512023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21156b9-1ef0-4632-9898-184a3c9c5f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.512333 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21156b9-1ef0-4632-9898-184a3c9c5f1e admin admin] PATH_INFO: `/v3/projects/7d608ccba4fb4493850a25be26e06b3d/users/249a4335b5ac4568adafde4e46edf740/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.537511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21156b9-1ef0-4632-9898-184a3c9c5f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d608ccba4fb4493850a25be26e06b3d, user_id=249a4335b5ac4568adafde4e46edf740, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.540270 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21156b9-1ef0-4632-9898-184a3c9c5f1e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.552166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1093/2171] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:55:00.560313 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1079/2172] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:55:00 2022] PUT /identity/v3/projects/7d608ccba4fb4493850a25be26e06b3d/users/249a4335b5ac4568adafde4e46edf740/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:00.565416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83195e35-a51a-453d-9f96-f38bbf1fb4a6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.566787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-83195e35-a51a-453d-9f96-f38bbf1fb4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:00.571780 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d2d2b-60ca-46b5-b086-c7e9013e8470 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.572175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d2d2b-60ca-46b5-b086-c7e9013e8470 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.572645 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d2d2b-60ca-46b5-b086-c7e9013e8470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.598886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:00.602983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-173d2d2b-60ca-46b5-b086-c7e9013e8470 None None] MFA Rules not processed for user `249a4335b5ac4568adafde4e46edf740`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:00.604983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-173d2d2b-60ca-46b5-b086-c7e9013e8470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:00.645327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83195e35-a51a-453d-9f96-f38bbf1fb4a6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.665395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:00.675154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1080/2173] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:55:00.686424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d2d2b-60ca-46b5-b086-c7e9013e8470 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:00.688909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-173d2d2b-60ca-46b5-b086-c7e9013e8470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:00.704967 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e889a-2d39-469b-a40d-b08255466f94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b08a946b43f08028c5da415d4e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.705604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e889a-2d39-469b-a40d-b08255466f94 service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.705900 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e889a-2d39-469b-a40d-b08255466f94 service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.706182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e889a-2d39-469b-a40d-b08255466f94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.746977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d2d2b-60ca-46b5-b086-c7e9013e8470 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:00.751629 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f3a85-4374-41f0-a96e-74cd55840291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:00.752284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f3a85-4374-41f0-a96e-74cd55840291 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:00.752564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f3a85-4374-41f0-a96e-74cd55840291 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:00.752839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f3a85-4374-41f0-a96e-74cd55840291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:00.761350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f3a85-4374-41f0-a96e-74cd55840291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.762769 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f3a85-4374-41f0-a96e-74cd55840291 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.768671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e889a-2d39-469b-a40d-b08255466f94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:00.770114 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e889a-2d39-469b-a40d-b08255466f94 service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:00.772110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1081/2174] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:55:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:55:00.779195 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1094/2175] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:55:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:55:05.574563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f3a85-4374-41f0-a96e-74cd55840291 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:05.576280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3d5f3a85-4374-41f0-a96e-74cd55840291 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:05.652255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f3a85-4374-41f0-a96e-74cd55840291 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:05.658933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:05.659594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:05.659874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:05.660190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] PATH_INFO: `/v3/users/6a482dbf453c466680229d5c837a8f52` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:05.661358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a482dbf453c466680229d5c837a8f52)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:05.663273 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:05.718053 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a482dbf453c466680229d5c837a8f52'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:05.718714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a482dbf453c466680229d5c837a8f52'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:05.719849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:05.733471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a482dbf453c466680229d5c837a8f52'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:05.742988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a482dbf453c466680229d5c837a8f52'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:05.751131 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a482dbf453c466680229d5c837a8f52'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:05.757145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1082/2176] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:55:05 2022] DELETE /identity/v3/users/6a482dbf453c466680229d5c837a8f52 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:05.761562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524310d-eefe-4482-bf8f-6068a97f6fac None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:05.762090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524310d-eefe-4482-bf8f-6068a97f6fac None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:05.762185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524310d-eefe-4482-bf8f-6068a97f6fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:05.781936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3524310d-eefe-4482-bf8f-6068a97f6fac None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:05.783141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3524310d-eefe-4482-bf8f-6068a97f6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:05.843387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1095/2177] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:05.854144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:05.855726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:05.912796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b34be-d550-4912-823b-88a624e63b4f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:05.916443 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6be9a6-8d2f-43c8-8328-d70bad0b0a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:05.917062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6be9a6-8d2f-43c8-8328-d70bad0b0a67 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:05.917345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6be9a6-8d2f-43c8-8328-d70bad0b0a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:05.917622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6be9a6-8d2f-43c8-8328-d70bad0b0a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:05.927059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6be9a6-8d2f-43c8-8328-d70bad0b0a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:05.928557 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6be9a6-8d2f-43c8-8328-d70bad0b0a67 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:05.938542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1083/2178] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:55:06.212820 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524310d-eefe-4482-bf8f-6068a97f6fac None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:06.214274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3524310d-eefe-4482-bf8f-6068a97f6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:06.227032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524310d-eefe-4482-bf8f-6068a97f6fac None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:06.232207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:06.232979 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:06.234098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:06.234098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] PATH_INFO: `/v3/projects/7a96d5b91988426cad508d60a4e7cc8b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:06.235468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a96d5b91988426cad508d60a4e7cc8b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:06.237448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:06.286688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a96d5b91988426cad508d60a4e7cc8b', 'request_id': 'req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.292148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a96d5b91988426cad508d60a4e7cc8b', 'request_id': 'req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.300174 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a96d5b91988426cad508d60a4e7cc8b', 'request_id': 'req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.311025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] The token cache is being invalidate because project 7a96d5b91988426cad508d60a4e7cc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:55:06.311309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.311958 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.313521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1096/2179] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:55:06 2022] DELETE /identity/v3/projects/7a96d5b91988426cad508d60a4e7cc8b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:06.317674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6be9a6-8d2f-43c8-8328-d70bad0b0a67 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:06.327243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6be9a6-8d2f-43c8-8328-d70bad0b0a67 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:06.382504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1af878-f406-46b7-af31-f04fe333ab55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:06.383063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1af878-f406-46b7-af31-f04fe333ab55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:06.383351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1af878-f406-46b7-af31-f04fe333ab55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:06.383628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1af878-f406-46b7-af31-f04fe333ab55 admin admin] PATH_INFO: `/v3/users/4186ade9500e46f3a175ea5fc064ed9e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:06.384897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1af878-f406-46b7-af31-f04fe333ab55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4186ade9500e46f3a175ea5fc064ed9e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:06.386818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1af878-f406-46b7-af31-f04fe333ab55 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:06.440749 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9e1af878-f406-46b7-af31-f04fe333ab55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4186ade9500e46f3a175ea5fc064ed9e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.441418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9e1af878-f406-46b7-af31-f04fe333ab55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4186ade9500e46f3a175ea5fc064ed9e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.453573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9e1af878-f406-46b7-af31-f04fe333ab55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4186ade9500e46f3a175ea5fc064ed9e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.457235 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:06.462803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9e1af878-f406-46b7-af31-f04fe333ab55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4186ade9500e46f3a175ea5fc064ed9e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.472134 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9e1af878-f406-46b7-af31-f04fe333ab55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4186ade9500e46f3a175ea5fc064ed9e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.478247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1084/2180] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:55:06 2022] DELETE /identity/v3/users/4186ade9500e46f3a175ea5fc064ed9e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:06.737094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:06.738705 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:06.749079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:06.756234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ebe2f-f8fe-4d9c-9d37-cf47a24abe07 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:06.824600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:06.825261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:06.825540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:06.825817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] PATH_INFO: `/v3/users/4bd92ed9460741aaa133488e75e45e39` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:06.827555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd92ed9460741aaa133488e75e45e39)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:06.830044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:06.888228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd92ed9460741aaa133488e75e45e39'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.888841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd92ed9460741aaa133488e75e45e39'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.898785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd92ed9460741aaa133488e75e45e39'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.917535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd92ed9460741aaa133488e75e45e39'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.925875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd92ed9460741aaa133488e75e45e39'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:06.933523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1097/2181] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:55:06 2022] DELETE /identity/v3/users/4bd92ed9460741aaa133488e75e45e39 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:06.939068 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb55a8-deab-4801-8add-63352c0b5d44 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:06.939946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb55a8-deab-4801-8add-63352c0b5d44 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:06.940416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb55a8-deab-4801-8add-63352c0b5d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:06.961579 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6afb55a8-deab-4801-8add-63352c0b5d44 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:06.962788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6afb55a8-deab-4801-8add-63352c0b5d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:07.046941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1085/2182] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:07.057358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:07.059884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:07.094739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb55a8-deab-4801-8add-63352c0b5d44 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:07.097324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6afb55a8-deab-4801-8add-63352c0b5d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:07.114519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb55a8-deab-4801-8add-63352c0b5d44 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:07.120182 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c4f64-fddd-44bf-a94e-8306071316ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:07.120964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c4f64-fddd-44bf-a94e-8306071316ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.121251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c4f64-fddd-44bf-a94e-8306071316ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.121529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c4f64-fddd-44bf-a94e-8306071316ac admin admin] PATH_INFO: `/v3/projects/83360f71cda24f26a7d7f6aa34f425f9` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.122705 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c4f64-fddd-44bf-a94e-8306071316ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=83360f71cda24f26a7d7f6aa34f425f9)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:07.125184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c4f64-fddd-44bf-a94e-8306071316ac admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:07.162628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dbf2b-957d-4b5a-af4d-4f03a4089fbb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:07.166662 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2a397-cdad-4c93-bdc1-5bb0ebf64a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:07.167291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2a397-cdad-4c93-bdc1-5bb0ebf64a7b service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.167568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2a397-cdad-4c93-bdc1-5bb0ebf64a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.167849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2a397-cdad-4c93-bdc1-5bb0ebf64a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.177974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2a397-cdad-4c93-bdc1-5bb0ebf64a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:07.179468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2a397-cdad-4c93-bdc1-5bb0ebf64a7b service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:07.184671 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cf6c4f64-fddd-44bf-a94e-8306071316ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83360f71cda24f26a7d7f6aa34f425f9', 'request_id': 'req-cf6c4f64-fddd-44bf-a94e-8306071316ac'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:07.191272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1098/2183] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:55:07.192294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cf6c4f64-fddd-44bf-a94e-8306071316ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83360f71cda24f26a7d7f6aa34f425f9', 'request_id': 'req-cf6c4f64-fddd-44bf-a94e-8306071316ac'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:07.199177 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cf6c4f64-fddd-44bf-a94e-8306071316ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83360f71cda24f26a7d7f6aa34f425f9', 'request_id': 'req-cf6c4f64-fddd-44bf-a94e-8306071316ac'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:07.225157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cf6c4f64-fddd-44bf-a94e-8306071316ac admin admin] The token cache is being invalidate because project 83360f71cda24f26a7d7f6aa34f425f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:55:07.225492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cf6c4f64-fddd-44bf-a94e-8306071316ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:07.226139 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cf6c4f64-fddd-44bf-a94e-8306071316ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:07.228100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1086/2184] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:55:07 2022] DELETE /identity/v3/projects/83360f71cda24f26a7d7f6aa34f425f9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:07.233132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69f316-d4b8-47cf-95b7-34666f422d52 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.233669 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69f316-d4b8-47cf-95b7-34666f422d52 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.234088 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69f316-d4b8-47cf-95b7-34666f422d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.262645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6f69f316-d4b8-47cf-95b7-34666f422d52 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:07.264029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6f69f316-d4b8-47cf-95b7-34666f422d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:07.292544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:07.340893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1099/2185] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:07.349077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e61afb-a2a6-4ea9-abed-86466e56f3e4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.349371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e61afb-a2a6-4ea9-abed-86466e56f3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.349653 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e61afb-a2a6-4ea9-abed-86466e56f3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.369886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-16e61afb-a2a6-4ea9-abed-86466e56f3e4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:07.371102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-16e61afb-a2a6-4ea9-abed-86466e56f3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:07.380272 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1087/2186] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:07.384398 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69f316-d4b8-47cf-95b7-34666f422d52 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:07.394937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69f316-d4b8-47cf-95b7-34666f422d52 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:07.399857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2357cb-5199-4c0b-aa8f-ea0f2acde1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:07.400501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2357cb-5199-4c0b-aa8f-ea0f2acde1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.400783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2357cb-5199-4c0b-aa8f-ea0f2acde1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.401054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2357cb-5199-4c0b-aa8f-ea0f2acde1f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.401750 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2357cb-5199-4c0b-aa8f-ea0f2acde1f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:55:07.402052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2357cb-5199-4c0b-aa8f-ea0f2acde1f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:07.403644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2357cb-5199-4c0b-aa8f-ea0f2acde1f7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:07.416075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1100/2187] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:55:07.421393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e61afb-a2a6-4ea9-abed-86466e56f3e4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:07.443521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e61afb-a2a6-4ea9-abed-86466e56f3e4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:07.449387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d904d-b35a-4aed-ba56-c231429263f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:07.450055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d904d-b35a-4aed-ba56-c231429263f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.450338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d904d-b35a-4aed-ba56-c231429263f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.450644 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d904d-b35a-4aed-ba56-c231429263f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.451585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d904d-b35a-4aed-ba56-c231429263f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:07.453315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d904d-b35a-4aed-ba56-c231429263f8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:07.519276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1088/2188] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:55:07 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:55:07.524397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2357cb-5199-4c0b-aa8f-ea0f2acde1f7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:07.540516 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2357cb-5199-4c0b-aa8f-ea0f2acde1f7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:07.596954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d904d-b35a-4aed-ba56-c231429263f8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:07.599054 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0a3d904d-b35a-4aed-ba56-c231429263f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:07.606091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa40fa-cc67-4716-80c6-2408b44f07c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:07.607029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa40fa-cc67-4716-80c6-2408b44f07c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.607684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa40fa-cc67-4716-80c6-2408b44f07c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.608712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa40fa-cc67-4716-80c6-2408b44f07c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.609564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa40fa-cc67-4716-80c6-2408b44f07c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:07.612072 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa40fa-cc67-4716-80c6-2408b44f07c0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:07.651802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1101/2189] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:55:07 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:55:07.656342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa40fa-cc67-4716-80c6-2408b44f07c0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:07.664861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:07.666521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa40fa-cc67-4716-80c6-2408b44f07c0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:07.682555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48367994-5348-459f-b8d7-c31f1264bf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:07.688226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48367994-5348-459f-b8d7-c31f1264bf33 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.688980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48367994-5348-459f-b8d7-c31f1264bf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.689454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48367994-5348-459f-b8d7-c31f1264bf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.691503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48367994-5348-459f-b8d7-c31f1264bf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:07.694364 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48367994-5348-459f-b8d7-c31f1264bf33 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:07.706447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d904d-b35a-4aed-ba56-c231429263f8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:07.710681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1102/2190] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:55:07.714572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:07.714745 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48367994-5348-459f-b8d7-c31f1264bf33 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:07.715241 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.715533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.715816 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc admin admin] PATH_INFO: `/v3/projects/0330f99cccfd43fbb15a2c942d222a88` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.717037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0330f99cccfd43fbb15a2c942d222a88)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:07.719682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:07.727034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48367994-5348-459f-b8d7-c31f1264bf33 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:07.732395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a91a3-ca3c-4273-9ed4-f5a302b340c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:07.733018 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a91a3-ca3c-4273-9ed4-f5a302b340c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.733857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a91a3-ca3c-4273-9ed4-f5a302b340c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.734252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a91a3-ca3c-4273-9ed4-f5a302b340c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.734953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a91a3-ca3c-4273-9ed4-f5a302b340c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:07.736700 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a91a3-ca3c-4273-9ed4-f5a302b340c6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:07.748449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1103/2191] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:55:07.751679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a91a3-ca3c-4273-9ed4-f5a302b340c6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:07.765189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a91a3-ca3c-4273-9ed4-f5a302b340c6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:07.774439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0330f99cccfd43fbb15a2c942d222a88', 'request_id': 'req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:07.781553 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0330f99cccfd43fbb15a2c942d222a88', 'request_id': 'req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:07.788248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0330f99cccfd43fbb15a2c942d222a88', 'request_id': 'req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:07.810326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc admin admin] The token cache is being invalidate because project 0330f99cccfd43fbb15a2c942d222a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:55:07.810698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:07.811540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-30845a5d-ef11-40ae-ac02-cc8fd490c5dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:07.816153 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1089/2192] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:55:07 2022] DELETE /identity/v3/projects/0330f99cccfd43fbb15a2c942d222a88 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:55:07.822101 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91ec2-b448-4748-84ab-4ad8fd3eea96 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.822401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91ec2-b448-4748-84ab-4ad8fd3eea96 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.822689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91ec2-b448-4748-84ab-4ad8fd3eea96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.846306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95b30b-41f6-46e7-b1b5-73435f29f1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:07.847091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95b30b-41f6-46e7-b1b5-73435f29f1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.847489 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95b30b-41f6-46e7-b1b5-73435f29f1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.847770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95b30b-41f6-46e7-b1b5-73435f29f1f3 admin admin] PATH_INFO: `/v3/projects/4bd82ed4679e41f7a64f84113c355139/users/232db85b2acd446db06ad21f097b9ed0/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.850830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2cb91ec2-b448-4748-84ab-4ad8fd3eea96 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:07.852237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2cb91ec2-b448-4748-84ab-4ad8fd3eea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:07.864566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1090/2193] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:07.872471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f03c6-f92f-4d77-b20f-d0f7a89905d4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.872834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f03c6-f92f-4d77-b20f-d0f7a89905d4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.873227 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f03c6-f92f-4d77-b20f-d0f7a89905d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.877936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95b30b-41f6-46e7-b1b5-73435f29f1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd82ed4679e41f7a64f84113c355139, user_id=232db85b2acd446db06ad21f097b9ed0, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:07.881447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95b30b-41f6-46e7-b1b5-73435f29f1f3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:07.897429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bf3f03c6-f92f-4d77-b20f-d0f7a89905d4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:07.898652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bf3f03c6-f92f-4d77-b20f-d0f7a89905d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:07.900049 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1104/2194] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:55:07 2022] PUT /identity/v3/projects/4bd82ed4679e41f7a64f84113c355139/users/232db85b2acd446db06ad21f097b9ed0/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:07.910960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35605e94-a1cc-4715-ab8f-b85245aa96dd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.911169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35605e94-a1cc-4715-ab8f-b85245aa96dd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.911452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35605e94-a1cc-4715-ab8f-b85245aa96dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.918760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:07.957454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-35605e94-a1cc-4715-ab8f-b85245aa96dd None None] MFA Rules not processed for user `232db85b2acd446db06ad21f097b9ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:07.959051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-35605e94-a1cc-4715-ab8f-b85245aa96dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:07.970931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1091/2195] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:07.974635 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f03c6-f92f-4d77-b20f-d0f7a89905d4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:07.984903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f03c6-f92f-4d77-b20f-d0f7a89905d4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:07.990419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e8c76-bf06-4adb-8a6a-e3f785900ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:07.991123 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e8c76-bf06-4adb-8a6a-e3f785900ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:07.991806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e8c76-bf06-4adb-8a6a-e3f785900ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:07.992230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e8c76-bf06-4adb-8a6a-e3f785900ec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:07.993017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e8c76-bf06-4adb-8a6a-e3f785900ec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:55:07.993456 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e8c76-bf06-4adb-8a6a-e3f785900ec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:07.995276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e8c76-bf06-4adb-8a6a-e3f785900ec6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:08.015946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1092/2196] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:55:08.017136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e8c76-bf06-4adb-8a6a-e3f785900ec6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:08.029100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e8c76-bf06-4adb-8a6a-e3f785900ec6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:08.042590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440ead1-589c-4ef0-82ad-24a1e95465ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:08.043800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440ead1-589c-4ef0-82ad-24a1e95465ee admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:08.044366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440ead1-589c-4ef0-82ad-24a1e95465ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:08.044855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440ead1-589c-4ef0-82ad-24a1e95465ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:08.046452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440ead1-589c-4ef0-82ad-24a1e95465ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:08.049924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440ead1-589c-4ef0-82ad-24a1e95465ee admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:08.069982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1105/2197] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:08.087874 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35605e94-a1cc-4715-ab8f-b85245aa96dd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:08.091469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-35605e94-a1cc-4715-ab8f-b85245aa96dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:08.100174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1093/2198] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:55:08 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:55:08.102630 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440ead1-589c-4ef0-82ad-24a1e95465ee admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:08.138377 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:08.170535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35605e94-a1cc-4715-ab8f-b85245aa96dd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:08.183086 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440ead1-589c-4ef0-82ad-24a1e95465ee admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:08.194814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7d46b-1c3d-4e9e-be37-98ef0d5e8bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:08.196231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7d46b-1c3d-4e9e-be37-98ef0d5e8bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:08.196619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7d46b-1c3d-4e9e-be37-98ef0d5e8bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:08.196997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7d46b-1c3d-4e9e-be37-98ef0d5e8bdb admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:08.198173 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7d46b-1c3d-4e9e-be37-98ef0d5e8bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:08.200788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7d46b-1c3d-4e9e-be37-98ef0d5e8bdb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:08.226904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1094/2199] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:55:08 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:55:08.230351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df2b06-4d7a-4c1c-b482-39dccc696b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:08.230986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df2b06-4d7a-4c1c-b482-39dccc696b92 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:08.231273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df2b06-4d7a-4c1c-b482-39dccc696b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:08.231557 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df2b06-4d7a-4c1c-b482-39dccc696b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:08.231675 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7d46b-1c3d-4e9e-be37-98ef0d5e8bdb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:08.242809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7d46b-1c3d-4e9e-be37-98ef0d5e8bdb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:08.248007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27770102-be2f-472f-ac04-7c7f3af4a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:08.248762 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27770102-be2f-472f-ac04-7c7f3af4a55b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:08.249690 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27770102-be2f-472f-ac04-7c7f3af4a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:08.250065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27770102-be2f-472f-ac04-7c7f3af4a55b admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:08.250880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27770102-be2f-472f-ac04-7c7f3af4a55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:08.252656 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27770102-be2f-472f-ac04-7c7f3af4a55b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:08.264817 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1095/2200] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:55:08.268536 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27770102-be2f-472f-ac04-7c7f3af4a55b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:08.279659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27770102-be2f-472f-ac04-7c7f3af4a55b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:08.285666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce8cbe-619e-4f7e-8317-63a8bfede3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:08.286361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce8cbe-619e-4f7e-8317-63a8bfede3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:08.286741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce8cbe-619e-4f7e-8317-63a8bfede3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:08.287068 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce8cbe-619e-4f7e-8317-63a8bfede3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:08.287833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce8cbe-619e-4f7e-8317-63a8bfede3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:08.290026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce8cbe-619e-4f7e-8317-63a8bfede3a5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:08.295304 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df2b06-4d7a-4c1c-b482-39dccc696b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:08.297422 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df2b06-4d7a-4c1c-b482-39dccc696b92 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:08.303367 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1096/2201] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:55:08.307203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce8cbe-619e-4f7e-8317-63a8bfede3a5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:08.307567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1106/2202] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:55:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:55:08.319745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce8cbe-619e-4f7e-8317-63a8bfede3a5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:08.326122 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c20bc-42aa-4310-8bd6-63d9672ac2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:08.327025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c20bc-42aa-4310-8bd6-63d9672ac2a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:08.327396 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c20bc-42aa-4310-8bd6-63d9672ac2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:08.327744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c20bc-42aa-4310-8bd6-63d9672ac2a4 admin admin] PATH_INFO: `/v3/projects/b40df4325f5c495396daab8f57b0dcf4/users/41650f44d6a14a1abab40d3f05317fa8/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:08.351810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c20bc-42aa-4310-8bd6-63d9672ac2a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40df4325f5c495396daab8f57b0dcf4, user_id=41650f44d6a14a1abab40d3f05317fa8, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:08.363544 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c20bc-42aa-4310-8bd6-63d9672ac2a4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:08.383329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1097/2203] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:55:08 2022] PUT /identity/v3/projects/b40df4325f5c495396daab8f57b0dcf4/users/41650f44d6a14a1abab40d3f05317fa8/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:55:08.388997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4a97e-60c9-41c9-b7e6-feac8ba6f603 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:08.389431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4a97e-60c9-41c9-b7e6-feac8ba6f603 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:08.389866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4a97e-60c9-41c9-b7e6-feac8ba6f603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:08.405679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:08.427436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-72e4a97e-60c9-41c9-b7e6-feac8ba6f603 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:08.428730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-72e4a97e-60c9-41c9-b7e6-feac8ba6f603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:08.515654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1107/2204] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:08.525657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c20bc-42aa-4310-8bd6-63d9672ac2a4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:08.527985 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d96c20bc-42aa-4310-8bd6-63d9672ac2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:08.636929 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c20bc-42aa-4310-8bd6-63d9672ac2a4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:08.642973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc667c-9aeb-487f-8edd-dfe5c9a6714a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:08.644238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc667c-9aeb-487f-8edd-dfe5c9a6714a service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:08.644548 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc667c-9aeb-487f-8edd-dfe5c9a6714a service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:08.644832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc667c-9aeb-487f-8edd-dfe5c9a6714a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:08.658421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc667c-9aeb-487f-8edd-dfe5c9a6714a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:08.660043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc667c-9aeb-487f-8edd-dfe5c9a6714a service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:08.678528 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1098/2205] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:55:09.461046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c05ba2-1e45-417f-9fff-9d20e1195637 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:09.461605 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c05ba2-1e45-417f-9fff-9d20e1195637 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:09.461605 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c05ba2-1e45-417f-9fff-9d20e1195637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:09.492469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-40c05ba2-1e45-417f-9fff-9d20e1195637 None None] MFA Rules not processed for user `41650f44d6a14a1abab40d3f05317fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:09.493687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-40c05ba2-1e45-417f-9fff-9d20e1195637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:09.614621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1108/2206] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:09.622886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc667c-9aeb-487f-8edd-dfe5c9a6714a service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:09.624989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-83dc667c-9aeb-487f-8edd-dfe5c9a6714a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:09.737001 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc667c-9aeb-487f-8edd-dfe5c9a6714a service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:09.741897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c9d7c-50d3-43d7-a25e-271583e45f7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:09.742717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c9d7c-50d3-43d7-a25e-271583e45f7e service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:09.743121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c9d7c-50d3-43d7-a25e-271583e45f7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:09.743819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c9d7c-50d3-43d7-a25e-271583e45f7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:09.757672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c9d7c-50d3-43d7-a25e-271583e45f7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:09.760176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c9d7c-50d3-43d7-a25e-271583e45f7e service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:09.773043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1099/2207] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:55:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:55:11.965347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8f260-afe1-4c30-bbd8-668191fd6115 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:11.966240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8f260-afe1-4c30-bbd8-668191fd6115 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:11.966240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8f260-afe1-4c30-bbd8-668191fd6115 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:11.967542 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1109/2208] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 08:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:55:11.997023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8639e89-5f7a-44fa-ac49-5a978e334fde None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:11.998085 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8639e89-5f7a-44fa-ac49-5a978e334fde None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:11.998214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8639e89-5f7a-44fa-ac49-5a978e334fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:12.020174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c8639e89-5f7a-44fa-ac49-5a978e334fde None None] MFA Rules not processed for user `cd9f2dc3c1c442b4b1b09964ff7c000b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:12.023317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c8639e89-5f7a-44fa-ac49-5a978e334fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:12.039341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8f260-afe1-4c30-bbd8-668191fd6115 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:12.042854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:12.043850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-faf8f260-afe1-4c30-bbd8-668191fd6115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:12.086243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8f260-afe1-4c30-bbd8-668191fd6115 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:12.113476 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af3d63-58d3-4fd9-9873-c75141e61651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:12.114571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af3d63-58d3-4fd9-9873-c75141e61651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:12.115050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af3d63-58d3-4fd9-9873-c75141e61651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:12.115507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af3d63-58d3-4fd9-9873-c75141e61651 admin admin] PATH_INFO: `/v3/users/e83b16baa6944aa299cd112043306f68` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:12.117137 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af3d63-58d3-4fd9-9873-c75141e61651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83b16baa6944aa299cd112043306f68)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:12.119756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af3d63-58d3-4fd9-9873-c75141e61651 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:12.137416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1100/2209] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 08:55:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:12.150496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8639e89-5f7a-44fa-ac49-5a978e334fde None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:12.152314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c8639e89-5f7a-44fa-ac49-5a978e334fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:12.167771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8639e89-5f7a-44fa-ac49-5a978e334fde None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:12.174523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c9e7-1ff6-42f8-80bd-c67fc2440607 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:12.175307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c9e7-1ff6-42f8-80bd-c67fc2440607 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:12.175771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c9e7-1ff6-42f8-80bd-c67fc2440607 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:12.176256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c9e7-1ff6-42f8-80bd-c67fc2440607 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:12.178527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a2af3d63-58d3-4fd9-9873-c75141e61651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83b16baa6944aa299cd112043306f68'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:12.179368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a2af3d63-58d3-4fd9-9873-c75141e61651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83b16baa6944aa299cd112043306f68'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:12.185850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5c9e7-1ff6-42f8-80bd-c67fc2440607 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:12.187946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5c9e7-1ff6-42f8-80bd-c67fc2440607 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:12.188703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a2af3d63-58d3-4fd9-9873-c75141e61651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83b16baa6944aa299cd112043306f68'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:12.201140 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1101/2210] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:55:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:55:12.202870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a2af3d63-58d3-4fd9-9873-c75141e61651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83b16baa6944aa299cd112043306f68'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:12.210497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a2af3d63-58d3-4fd9-9873-c75141e61651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83b16baa6944aa299cd112043306f68'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:12.216861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1110/2211] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:55:12 2022] DELETE /identity/v3/users/e83b16baa6944aa299cd112043306f68 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:12.400768 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c9e7-1ff6-42f8-80bd-c67fc2440607 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:12.419903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c9e7-1ff6-42f8-80bd-c67fc2440607 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:12.461235 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691b827-1ebe-4b65-8442-86f91c904452 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:12.461524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691b827-1ebe-4b65-8442-86f91c904452 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:12.461803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691b827-1ebe-4b65-8442-86f91c904452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:12.470036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:12.482648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8691b827-1ebe-4b65-8442-86f91c904452 None None] MFA Rules not processed for user `41650f44d6a14a1abab40d3f05317fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:12.484576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8691b827-1ebe-4b65-8442-86f91c904452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:12.488345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df251c-c610-447b-a65b-243778b722a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:12.488993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df251c-c610-447b-a65b-243778b722a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:12.489276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df251c-c610-447b-a65b-243778b722a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:12.489554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df251c-c610-447b-a65b-243778b722a2 admin admin] PATH_INFO: `/v3/projects/e350e1aaf5d446b989d2e6c7ab90e133` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:12.490746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df251c-c610-447b-a65b-243778b722a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e350e1aaf5d446b989d2e6c7ab90e133)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:12.492678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df251c-c610-447b-a65b-243778b722a2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:12.540580 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a2df251c-c610-447b-a65b-243778b722a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e350e1aaf5d446b989d2e6c7ab90e133', 'request_id': 'req-a2df251c-c610-447b-a65b-243778b722a2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:12.542593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1111/2212] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:55:12.551627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a2df251c-c610-447b-a65b-243778b722a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e350e1aaf5d446b989d2e6c7ab90e133', 'request_id': 'req-a2df251c-c610-447b-a65b-243778b722a2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:12.557975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a2df251c-c610-447b-a65b-243778b722a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e350e1aaf5d446b989d2e6c7ab90e133', 'request_id': 'req-a2df251c-c610-447b-a65b-243778b722a2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:12.571527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a2df251c-c610-447b-a65b-243778b722a2 admin admin] The token cache is being invalidate because project e350e1aaf5d446b989d2e6c7ab90e133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:55:12.571744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a2df251c-c610-447b-a65b-243778b722a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:12.572870 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a2df251c-c610-447b-a65b-243778b722a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:12.574928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1102/2213] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:55:12 2022] DELETE /identity/v3/projects/e350e1aaf5d446b989d2e6c7ab90e133 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:12.580730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ba84e-06af-4dee-917f-b7e4271367d8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:12.581026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ba84e-06af-4dee-917f-b7e4271367d8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:12.581350 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ba84e-06af-4dee-917f-b7e4271367d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:12.602954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a11ba84e-06af-4dee-917f-b7e4271367d8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:12.604176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a11ba84e-06af-4dee-917f-b7e4271367d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:12.675830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1112/2214] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:55:12.678381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c44057-5b45-409b-bbf5-ad836efc2215 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:12.678702 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c44057-5b45-409b-bbf5-ad836efc2215 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:12.678986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c44057-5b45-409b-bbf5-ad836efc2215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:12.701371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f2c44057-5b45-409b-bbf5-ad836efc2215 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:12.702626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f2c44057-5b45-409b-bbf5-ad836efc2215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:12.710938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1103/2215] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:12.715270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ba84e-06af-4dee-917f-b7e4271367d8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:12.725637 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ba84e-06af-4dee-917f-b7e4271367d8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:12.730272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf01345-974d-49db-bbbe-9035a5ff4053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:12.730928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf01345-974d-49db-bbbe-9035a5ff4053 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:12.731162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf01345-974d-49db-bbbe-9035a5ff4053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:12.731435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf01345-974d-49db-bbbe-9035a5ff4053 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:12.732147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf01345-974d-49db-bbbe-9035a5ff4053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:55:12.732466 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf01345-974d-49db-bbbe-9035a5ff4053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:12.734588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf01345-974d-49db-bbbe-9035a5ff4053 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:12.746530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1113/2216] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:55:12.751685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c44057-5b45-409b-bbf5-ad836efc2215 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:12.761700 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c44057-5b45-409b-bbf5-ad836efc2215 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:12.766407 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85bca9-2d94-4ac7-8d8a-0f9efaa1d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:12.767168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85bca9-2d94-4ac7-8d8a-0f9efaa1d407 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:12.767304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85bca9-2d94-4ac7-8d8a-0f9efaa1d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:12.767577 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85bca9-2d94-4ac7-8d8a-0f9efaa1d407 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:12.768511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85bca9-2d94-4ac7-8d8a-0f9efaa1d407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:12.770410 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85bca9-2d94-4ac7-8d8a-0f9efaa1d407 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:12.800175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1104/2217] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:55:12 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:55:12.804234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf01345-974d-49db-bbbe-9035a5ff4053 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:12.820574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf01345-974d-49db-bbbe-9035a5ff4053 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:12.891117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b07bb-7946-4c2e-a358-e853bb9b8277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:12.891749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b07bb-7946-4c2e-a358-e853bb9b8277 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:12.892037 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b07bb-7946-4c2e-a358-e853bb9b8277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:12.892347 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b07bb-7946-4c2e-a358-e853bb9b8277 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:12.893027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b07bb-7946-4c2e-a358-e853bb9b8277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:12.895004 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b07bb-7946-4c2e-a358-e853bb9b8277 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:12.917090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1114/2218] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:55:12 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:55:12.921758 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85bca9-2d94-4ac7-8d8a-0f9efaa1d407 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:12.928390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:12.932794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85bca9-2d94-4ac7-8d8a-0f9efaa1d407 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:12.938917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d56cd3-61ac-4c52-9f16-0b2bc4569d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:12.939539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d56cd3-61ac-4c52-9f16-0b2bc4569d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:12.939987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d56cd3-61ac-4c52-9f16-0b2bc4569d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:12.940372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d56cd3-61ac-4c52-9f16-0b2bc4569d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:12.941320 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d56cd3-61ac-4c52-9f16-0b2bc4569d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:12.942911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d56cd3-61ac-4c52-9f16-0b2bc4569d50 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:12.954248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1105/2219] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:55:12.958895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b07bb-7946-4c2e-a358-e853bb9b8277 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:12.980721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b07bb-7946-4c2e-a358-e853bb9b8277 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:12.988770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695ecb1-0014-4aa3-bb04-04aa17d2e7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:12.989396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695ecb1-0014-4aa3-bb04-04aa17d2e7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:12.989677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695ecb1-0014-4aa3-bb04-04aa17d2e7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:12.989948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695ecb1-0014-4aa3-bb04-04aa17d2e7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:12.990857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695ecb1-0014-4aa3-bb04-04aa17d2e7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:12.991968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d56cd3-61ac-4c52-9f16-0b2bc4569d50 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:12.992578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695ecb1-0014-4aa3-bb04-04aa17d2e7c3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:12.994813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-22d56cd3-61ac-4c52-9f16-0b2bc4569d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:13.004691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1115/2220] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:55:13.009354 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695ecb1-0014-4aa3-bb04-04aa17d2e7c3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:13.010885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d56cd3-61ac-4c52-9f16-0b2bc4569d50 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:13.017540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f8ec4-4839-4b74-bc76-b85a7bc03597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:13.018280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f8ec4-4839-4b74-bc76-b85a7bc03597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:13.018485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f8ec4-4839-4b74-bc76-b85a7bc03597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:13.018752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f8ec4-4839-4b74-bc76-b85a7bc03597 admin admin] PATH_INFO: `/v3/users/232db85b2acd446db06ad21f097b9ed0` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:13.019958 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f8ec4-4839-4b74-bc76-b85a7bc03597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=232db85b2acd446db06ad21f097b9ed0)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:13.020485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695ecb1-0014-4aa3-bb04-04aa17d2e7c3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:13.021951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f8ec4-4839-4b74-bc76-b85a7bc03597 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:13.025290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dff6ca-ed5c-42ca-ac15-310a074c8a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:13.025962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dff6ca-ed5c-42ca-ac15-310a074c8a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:13.026240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dff6ca-ed5c-42ca-ac15-310a074c8a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:13.026518 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dff6ca-ed5c-42ca-ac15-310a074c8a67 admin admin] PATH_INFO: `/v3/projects/3179955b76864553a96682674d01b781/users/f01062e92f974dc890897d19359e7e63/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:13.048504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:13.056057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dff6ca-ed5c-42ca-ac15-310a074c8a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3179955b76864553a96682674d01b781, user_id=f01062e92f974dc890897d19359e7e63, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:13.061611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dff6ca-ed5c-42ca-ac15-310a074c8a67 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:13.080085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1116/2221] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:55:13 2022] PUT /identity/v3/projects/3179955b76864553a96682674d01b781/users/f01062e92f974dc890897d19359e7e63/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:13.086174 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcbdc3-bd16-4ce1-8c7a-ea098aba4232 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:13.086765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcbdc3-bd16-4ce1-8c7a-ea098aba4232 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:13.086890 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcbdc3-bd16-4ce1-8c7a-ea098aba4232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:13.089211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e67f8ec4-4839-4b74-bc76-b85a7bc03597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232db85b2acd446db06ad21f097b9ed0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:13.093853 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e67f8ec4-4839-4b74-bc76-b85a7bc03597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232db85b2acd446db06ad21f097b9ed0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:13.121260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e67f8ec4-4839-4b74-bc76-b85a7bc03597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232db85b2acd446db06ad21f097b9ed0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:13.123715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-edfcbdc3-bd16-4ce1-8c7a-ea098aba4232 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:13.125050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-edfcbdc3-bd16-4ce1-8c7a-ea098aba4232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:13.153528 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e67f8ec4-4839-4b74-bc76-b85a7bc03597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232db85b2acd446db06ad21f097b9ed0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:13.163539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e67f8ec4-4839-4b74-bc76-b85a7bc03597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232db85b2acd446db06ad21f097b9ed0'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:13.189574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1106/2222] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:55:12 2022] DELETE /identity/v3/users/232db85b2acd446db06ad21f097b9ed0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:55:13.194929 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8932794-5f99-4c5a-91cc-96e6668ebfcc None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:13.194929 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8932794-5f99-4c5a-91cc-96e6668ebfcc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:13.195138 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8932794-5f99-4c5a-91cc-96e6668ebfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:13.259064 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b8932794-5f99-4c5a-91cc-96e6668ebfcc None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:13.260566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b8932794-5f99-4c5a-91cc-96e6668ebfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:13.300601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1117/2223] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:13.310997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcbdc3-bd16-4ce1-8c7a-ea098aba4232 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:13.312552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-edfcbdc3-bd16-4ce1-8c7a-ea098aba4232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:13.342289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1107/2224] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:13.349310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8932794-5f99-4c5a-91cc-96e6668ebfcc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:13.350688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b8932794-5f99-4c5a-91cc-96e6668ebfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:13.382141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcbdc3-bd16-4ce1-8c7a-ea098aba4232 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:13.420436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8932794-5f99-4c5a-91cc-96e6668ebfcc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:13.425506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30b327-3cc5-4e5c-8987-c05f81b9523f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:13.426507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30b327-3cc5-4e5c-8987-c05f81b9523f service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:13.426749 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30b327-3cc5-4e5c-8987-c05f81b9523f service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:13.427304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30b327-3cc5-4e5c-8987-c05f81b9523f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:13.440054 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30b327-3cc5-4e5c-8987-c05f81b9523f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:13.442218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30b327-3cc5-4e5c-8987-c05f81b9523f service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:13.449251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946ce99-7303-4453-a17c-62250d17a2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:13.449914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946ce99-7303-4453-a17c-62250d17a2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:13.450200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946ce99-7303-4453-a17c-62250d17a2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:13.450482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946ce99-7303-4453-a17c-62250d17a2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:13.454664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1108/2225] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:55:13.461724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946ce99-7303-4453-a17c-62250d17a2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:13.463306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946ce99-7303-4453-a17c-62250d17a2c7 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:13.475043 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1118/2226] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:55:14.011461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30b327-3cc5-4e5c-8987-c05f81b9523f service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:14.013775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3a30b327-3cc5-4e5c-8987-c05f81b9523f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:14.029721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30b327-3cc5-4e5c-8987-c05f81b9523f service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:14.036248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:14.037165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:14.044557 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:14.044971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] PATH_INFO: `/v3/projects/4bd82ed4679e41f7a64f84113c355139` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:14.046349 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd82ed4679e41f7a64f84113c355139)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:14.048305 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:14.050947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:14.114515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd82ed4679e41f7a64f84113c355139', 'request_id': 'req-a62b50cf-90a1-4ba3-b6af-01a3a928610e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:14.120460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd82ed4679e41f7a64f84113c355139', 'request_id': 'req-a62b50cf-90a1-4ba3-b6af-01a3a928610e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:14.127310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd82ed4679e41f7a64f84113c355139', 'request_id': 'req-a62b50cf-90a1-4ba3-b6af-01a3a928610e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:14.143048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] The token cache is being invalidate because project 4bd82ed4679e41f7a64f84113c355139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:55:14.143252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:14.144158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:14.146275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1109/2227] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:55:14 2022] DELETE /identity/v3/projects/4bd82ed4679e41f7a64f84113c355139 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:17.985003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5bd41-5e73-4dfe-a5c9-762e075e4f0f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:17.985445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5bd41-5e73-4dfe-a5c9-762e075e4f0f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:17.985621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5bd41-5e73-4dfe-a5c9-762e075e4f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:18.016026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-57b5bd41-5e73-4dfe-a5c9-762e075e4f0f None None] MFA Rules not processed for user `f01062e92f974dc890897d19359e7e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:18.017314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-57b5bd41-5e73-4dfe-a5c9-762e075e4f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:18.080996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:18.121290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1119/2228] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:18.135459 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:18.136972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:18.216417 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b50cf-90a1-4ba3-b6af-01a3a928610e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:18.222668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ced1e-4d3a-4bdf-99cc-d999186fd628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:18.223302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ced1e-4d3a-4bdf-99cc-d999186fd628 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:18.223587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ced1e-4d3a-4bdf-99cc-d999186fd628 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:18.223863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ced1e-4d3a-4bdf-99cc-d999186fd628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:18.232416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ced1e-4d3a-4bdf-99cc-d999186fd628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:18.234595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ced1e-4d3a-4bdf-99cc-d999186fd628 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:18.244543 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1110/2229] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:55:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:55:19.691786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246d107-1d63-4c91-957c-47adc252498a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:19.692431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246d107-1d63-4c91-957c-47adc252498a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:19.692431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246d107-1d63-4c91-957c-47adc252498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:19.724504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7246d107-1d63-4c91-957c-47adc252498a None None] MFA Rules not processed for user `f01062e92f974dc890897d19359e7e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:19.728319 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7246d107-1d63-4c91-957c-47adc252498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:19.737978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1120/2230] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:55:28.240460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:29.708961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=12 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:37.010269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ced1e-4d3a-4bdf-99cc-d999186fd628 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:37.011662 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3b6ced1e-4d3a-4bdf-99cc-d999186fd628 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:37.079191 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ced1e-4d3a-4bdf-99cc-d999186fd628 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:37.083857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:37.084539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:37.084825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:37.085103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] PATH_INFO: `/v3/users/4b7997ebcec44d36b29d514aedec5eff` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:37.086251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b7997ebcec44d36b29d514aedec5eff)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:37.088187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:37.140693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b7997ebcec44d36b29d514aedec5eff'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:37.141384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b7997ebcec44d36b29d514aedec5eff'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:37.165045 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b7997ebcec44d36b29d514aedec5eff'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:37.175071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b7997ebcec44d36b29d514aedec5eff'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:37.184639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b7997ebcec44d36b29d514aedec5eff'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:37.197067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1111/2231] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:55:37 2022] DELETE /identity/v3/users/4b7997ebcec44d36b29d514aedec5eff => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:37.198178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc399c8-7a94-4341-9d14-b77eeead2ba4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:37.198614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc399c8-7a94-4341-9d14-b77eeead2ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:37.198741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc399c8-7a94-4341-9d14-b77eeead2ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:37.222666 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bbc399c8-7a94-4341-9d14-b77eeead2ba4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:37.223940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bbc399c8-7a94-4341-9d14-b77eeead2ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:37.308346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1121/2232] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:55:37.319069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:37.320569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:37.381511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1398e-3660-4c3d-9936-3a7c99aee0f2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:37.385171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64d706-f204-40cc-962d-bcc05b5b4deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:37.385793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64d706-f204-40cc-962d-bcc05b5b4deb service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:37.386079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64d706-f204-40cc-962d-bcc05b5b4deb service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:37.386360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64d706-f204-40cc-962d-bcc05b5b4deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:37.396725 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64d706-f204-40cc-962d-bcc05b5b4deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:37.398198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64d706-f204-40cc-962d-bcc05b5b4deb service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:37.408466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1112/2233] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:55:37.714652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc399c8-7a94-4341-9d14-b77eeead2ba4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:55:37.716192 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bbc399c8-7a94-4341-9d14-b77eeead2ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:37.730985 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc399c8-7a94-4341-9d14-b77eeead2ba4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:55:37.736057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:55:37.736737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:37.737017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:37.737290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] PATH_INFO: `/v3/projects/a0e2204915244154818f508ce71f77b3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:37.738497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e2204915244154818f508ce71f77b3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:55:37.740487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:55:37.787728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e2204915244154818f508ce71f77b3', 'request_id': 'req-055681e3-604f-403f-8cb7-a6fda711f851'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:37.793236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e2204915244154818f508ce71f77b3', 'request_id': 'req-055681e3-604f-403f-8cb7-a6fda711f851'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:37.801051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e2204915244154818f508ce71f77b3', 'request_id': 'req-055681e3-604f-403f-8cb7-a6fda711f851'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:37.812769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] The token cache is being invalidate because project a0e2204915244154818f508ce71f77b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:55:37.813065 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:37.813702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:55:37.815497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1122/2234] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:55:37 2022] DELETE /identity/v3/projects/a0e2204915244154818f508ce71f77b3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:55:47.404739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:47.809500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:55.483624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d245-e487-4a22-ac18-fe32e3441b74 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:55:55.484163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d245-e487-4a22-ac18-fe32e3441b74 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:55:55.484318 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d245-e487-4a22-ac18-fe32e3441b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:55:55.503262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ba79d245-e487-4a22-ac18-fe32e3441b74 None None] MFA Rules not processed for user `7ed1be3a1ae249828caa8b88fd606557`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:55:55.504497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ba79d245-e487-4a22-ac18-fe32e3441b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:55:55.560950 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1113/2235] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:55:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:56:03.562480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:03.563972 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:03.631907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055681e3-604f-403f-8cb7-a6fda711f851 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:03.637258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:03.638069 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:03.638355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:03.638635 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] PATH_INFO: `/v3/users/249a4335b5ac4568adafde4e46edf740` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:03.639822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] RBAC: Authorizing `identity:delete_user(user_id=249a4335b5ac4568adafde4e46edf740)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:03.641797 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:03.692062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249a4335b5ac4568adafde4e46edf740'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:03.692743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249a4335b5ac4568adafde4e46edf740'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:03.700885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249a4335b5ac4568adafde4e46edf740'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:03.714656 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249a4335b5ac4568adafde4e46edf740'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:03.721571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249a4335b5ac4568adafde4e46edf740'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:03.729305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1123/2236] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:56:03 2022] DELETE /identity/v3/users/249a4335b5ac4568adafde4e46edf740 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:56:03.734586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4781-a1fc-4c11-b5da-0493d4f5705b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:03.735093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4781-a1fc-4c11-b5da-0493d4f5705b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:03.735559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4781-a1fc-4c11-b5da-0493d4f5705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:03.756559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-629b4781-a1fc-4c11-b5da-0493d4f5705b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:56:03.757771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-629b4781-a1fc-4c11-b5da-0493d4f5705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:03.822454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1114/2237] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:56:03.832079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:03.833802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:03.890552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af8d50-e247-4216-b618-2054d208f17c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:03.894230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76cdd8-0e16-4f3d-b121-b856c448cdd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:03.894837 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76cdd8-0e16-4f3d-b121-b856c448cdd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:03.895128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76cdd8-0e16-4f3d-b121-b856c448cdd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:03.895402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76cdd8-0e16-4f3d-b121-b856c448cdd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:03.904501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76cdd8-0e16-4f3d-b121-b856c448cdd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:03.905960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76cdd8-0e16-4f3d-b121-b856c448cdd7 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:03.915835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1124/2238] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:56:04.185317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4781-a1fc-4c11-b5da-0493d4f5705b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:04.187129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-629b4781-a1fc-4c11-b5da-0493d4f5705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:04.199256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4781-a1fc-4c11-b5da-0493d4f5705b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:04.212069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34894707-3218-4ce1-baac-ce0f23a22b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:04.212782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34894707-3218-4ce1-baac-ce0f23a22b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:04.213066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34894707-3218-4ce1-baac-ce0f23a22b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:04.213341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34894707-3218-4ce1-baac-ce0f23a22b5d admin admin] PATH_INFO: `/v3/projects/7d608ccba4fb4493850a25be26e06b3d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:04.214588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34894707-3218-4ce1-baac-ce0f23a22b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d608ccba4fb4493850a25be26e06b3d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:04.216667 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34894707-3218-4ce1-baac-ce0f23a22b5d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:04.265248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-34894707-3218-4ce1-baac-ce0f23a22b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d608ccba4fb4493850a25be26e06b3d', 'request_id': 'req-34894707-3218-4ce1-baac-ce0f23a22b5d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:04.270927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-34894707-3218-4ce1-baac-ce0f23a22b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d608ccba4fb4493850a25be26e06b3d', 'request_id': 'req-34894707-3218-4ce1-baac-ce0f23a22b5d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:04.277531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-34894707-3218-4ce1-baac-ce0f23a22b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d608ccba4fb4493850a25be26e06b3d', 'request_id': 'req-34894707-3218-4ce1-baac-ce0f23a22b5d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:04.290339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-34894707-3218-4ce1-baac-ce0f23a22b5d admin admin] The token cache is being invalidate because project 7d608ccba4fb4493850a25be26e06b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:56:04.290729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-34894707-3218-4ce1-baac-ce0f23a22b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:04.291388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-34894707-3218-4ce1-baac-ce0f23a22b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:04.293092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1115/2239] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:56:04 2022] DELETE /identity/v3/projects/7d608ccba4fb4493850a25be26e06b3d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:56:04.297995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a4df3-3291-4799-8bf1-5d83ebfd2087 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:04.298977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a4df3-3291-4799-8bf1-5d83ebfd2087 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:04.299275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a4df3-3291-4799-8bf1-5d83ebfd2087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:04.319465 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c50a4df3-3291-4799-8bf1-5d83ebfd2087 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:56:04.320219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c50a4df3-3291-4799-8bf1-5d83ebfd2087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:04.338262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:04.384768 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1125/2240] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:56:04.392213 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159425d-5d78-40ef-911e-3bbf88dae07a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:04.392511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159425d-5d78-40ef-911e-3bbf88dae07a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:04.392794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159425d-5d78-40ef-911e-3bbf88dae07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:04.413093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f159425d-5d78-40ef-911e-3bbf88dae07a None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:56:04.414927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f159425d-5d78-40ef-911e-3bbf88dae07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:04.424814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1116/2241] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:56:04.428927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a4df3-3291-4799-8bf1-5d83ebfd2087 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:04.438696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a4df3-3291-4799-8bf1-5d83ebfd2087 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:04.443319 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d12d95-a052-406e-9816-f1ee1829c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:04.443936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d12d95-a052-406e-9816-f1ee1829c947 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:04.444261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d12d95-a052-406e-9816-f1ee1829c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:04.444541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d12d95-a052-406e-9816-f1ee1829c947 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:04.446074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d12d95-a052-406e-9816-f1ee1829c947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:56:04.446622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d12d95-a052-406e-9816-f1ee1829c947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:04.447978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d12d95-a052-406e-9816-f1ee1829c947 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:04.460216 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1126/2242] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:56:04.465085 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159425d-5d78-40ef-911e-3bbf88dae07a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:04.474317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159425d-5d78-40ef-911e-3bbf88dae07a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:04.479324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a857c-54dc-4170-b4a4-7cee3c54a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:04.479925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a857c-54dc-4170-b4a4-7cee3c54a735 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:04.480234 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a857c-54dc-4170-b4a4-7cee3c54a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:04.480507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a857c-54dc-4170-b4a4-7cee3c54a735 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:04.481174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a857c-54dc-4170-b4a4-7cee3c54a735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:04.483653 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a857c-54dc-4170-b4a4-7cee3c54a735 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:04.505660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:04.513002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1117/2243] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:56:04 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:56:04.517686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d12d95-a052-406e-9816-f1ee1829c947 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:04.528468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d12d95-a052-406e-9816-f1ee1829c947 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:04.582968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96942bb-805c-423e-8f67-3121b8613eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:04.583566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96942bb-805c-423e-8f67-3121b8613eac admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:04.583857 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96942bb-805c-423e-8f67-3121b8613eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:04.584156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96942bb-805c-423e-8f67-3121b8613eac admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:04.584819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96942bb-805c-423e-8f67-3121b8613eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:04.587342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96942bb-805c-423e-8f67-3121b8613eac admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:04.607452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1127/2244] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:56:04 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:56:04.611589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a857c-54dc-4170-b4a4-7cee3c54a735 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:04.621766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a857c-54dc-4170-b4a4-7cee3c54a735 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:04.626360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00e1d8-94c7-428e-a9eb-60fca9be9419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:04.626969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00e1d8-94c7-428e-a9eb-60fca9be9419 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:04.627255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00e1d8-94c7-428e-a9eb-60fca9be9419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:04.627534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00e1d8-94c7-428e-a9eb-60fca9be9419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:04.628266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00e1d8-94c7-428e-a9eb-60fca9be9419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:04.630669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00e1d8-94c7-428e-a9eb-60fca9be9419 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:04.641616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1118/2245] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:56:04.645583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96942bb-805c-423e-8f67-3121b8613eac admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:04.656824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96942bb-805c-423e-8f67-3121b8613eac admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:04.661969 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6468b3-2dfc-41d1-b726-93df5455cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:04.662619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6468b3-2dfc-41d1-b726-93df5455cfcf admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:04.662908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6468b3-2dfc-41d1-b726-93df5455cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:04.663187 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6468b3-2dfc-41d1-b726-93df5455cfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:04.663927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6468b3-2dfc-41d1-b726-93df5455cfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:04.665583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6468b3-2dfc-41d1-b726-93df5455cfcf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:04.676825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1128/2246] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:56:04.681232 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00e1d8-94c7-428e-a9eb-60fca9be9419 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:04.691470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00e1d8-94c7-428e-a9eb-60fca9be9419 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:04.697682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64410112-9536-4320-b14d-84dfeda05832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:04.698295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64410112-9536-4320-b14d-84dfeda05832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:04.698587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64410112-9536-4320-b14d-84dfeda05832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:04.698875 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64410112-9536-4320-b14d-84dfeda05832 admin admin] PATH_INFO: `/v3/projects/4178c67e55fe4974a97c7af6e4a1cb00/users/5de371d29e954e549bf127b41e1df9cd/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:04.715225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64410112-9536-4320-b14d-84dfeda05832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4178c67e55fe4974a97c7af6e4a1cb00, user_id=5de371d29e954e549bf127b41e1df9cd, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:04.717960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64410112-9536-4320-b14d-84dfeda05832 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:04.731909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1119/2247] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:56:04 2022] PUT /identity/v3/projects/4178c67e55fe4974a97c7af6e4a1cb00/users/5de371d29e954e549bf127b41e1df9cd/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:56:04.801795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255105b-3b17-487d-ac98-e4b89f3f8ae7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:04.802108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255105b-3b17-487d-ac98-e4b89f3f8ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:04.802415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255105b-3b17-487d-ac98-e4b89f3f8ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:04.837041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6255105b-3b17-487d-ac98-e4b89f3f8ae7 None None] MFA Rules not processed for user `5de371d29e954e549bf127b41e1df9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:56:04.838414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6255105b-3b17-487d-ac98-e4b89f3f8ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:04.926177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1129/2248] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:56:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:56:04.939411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64410112-9536-4320-b14d-84dfeda05832 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:04.941092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-64410112-9536-4320-b14d-84dfeda05832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:05.012814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64410112-9536-4320-b14d-84dfeda05832 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:05.017427 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2fe1-b146-4d45-b353-44d6e49e83bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:05.018061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2fe1-b146-4d45-b353-44d6e49e83bc service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:05.018349 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2fe1-b146-4d45-b353-44d6e49e83bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:05.018631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2fe1-b146-4d45-b353-44d6e49e83bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:05.028942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff2fe1-b146-4d45-b353-44d6e49e83bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:05.030925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff2fe1-b146-4d45-b353-44d6e49e83bc service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:05.042730 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1120/2249] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:56:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:56:05.076332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255105b-3b17-487d-ac98-e4b89f3f8ae7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:05.097863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:05.143783 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255105b-3b17-487d-ac98-e4b89f3f8ae7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:05.148410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:05.149055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:05.149335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:05.149611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] PATH_INFO: `/v3/users/5de371d29e954e549bf127b41e1df9cd` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:05.150825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de371d29e954e549bf127b41e1df9cd)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:05.152837 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:05.203663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de371d29e954e549bf127b41e1df9cd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:05.204356 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de371d29e954e549bf127b41e1df9cd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:05.213990 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de371d29e954e549bf127b41e1df9cd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:05.227512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de371d29e954e549bf127b41e1df9cd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:05.234594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de371d29e954e549bf127b41e1df9cd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:05.240546 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1130/2250] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:56:05 2022] DELETE /identity/v3/users/5de371d29e954e549bf127b41e1df9cd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:56:05.245623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867ead6-a2fa-4188-b3d0-7bd681e5aa56 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:05.245917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867ead6-a2fa-4188-b3d0-7bd681e5aa56 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:05.246199 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867ead6-a2fa-4188-b3d0-7bd681e5aa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:05.264772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c867ead6-a2fa-4188-b3d0-7bd681e5aa56 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:56:05.266010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c867ead6-a2fa-4188-b3d0-7bd681e5aa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:05.324777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1121/2251] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:56:05.334835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:05.336293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:05.392995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c511d3a-8edd-4055-954d-30002b7f676a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:05.396615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72add838-bfd0-438d-96f9-dec0588b65b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:05.397225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72add838-bfd0-438d-96f9-dec0588b65b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:05.397513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72add838-bfd0-438d-96f9-dec0588b65b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:05.397794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72add838-bfd0-438d-96f9-dec0588b65b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:05.407271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72add838-bfd0-438d-96f9-dec0588b65b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:05.408856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72add838-bfd0-438d-96f9-dec0588b65b9 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:05.418221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1131/2252] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:56:05.748826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867ead6-a2fa-4188-b3d0-7bd681e5aa56 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:05.750267 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c867ead6-a2fa-4188-b3d0-7bd681e5aa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:05.763693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867ead6-a2fa-4188-b3d0-7bd681e5aa56 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:05.768461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19806fb0-8d74-4d98-82a8-d77d8cc35f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:05.769116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19806fb0-8d74-4d98-82a8-d77d8cc35f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:05.769404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19806fb0-8d74-4d98-82a8-d77d8cc35f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:05.769682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19806fb0-8d74-4d98-82a8-d77d8cc35f99 admin admin] PATH_INFO: `/v3/projects/4178c67e55fe4974a97c7af6e4a1cb00` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:05.770872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19806fb0-8d74-4d98-82a8-d77d8cc35f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4178c67e55fe4974a97c7af6e4a1cb00)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:05.772926 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19806fb0-8d74-4d98-82a8-d77d8cc35f99 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:05.823843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-19806fb0-8d74-4d98-82a8-d77d8cc35f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4178c67e55fe4974a97c7af6e4a1cb00', 'request_id': 'req-19806fb0-8d74-4d98-82a8-d77d8cc35f99'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:05.829529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-19806fb0-8d74-4d98-82a8-d77d8cc35f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4178c67e55fe4974a97c7af6e4a1cb00', 'request_id': 'req-19806fb0-8d74-4d98-82a8-d77d8cc35f99'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:05.836027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-19806fb0-8d74-4d98-82a8-d77d8cc35f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4178c67e55fe4974a97c7af6e4a1cb00', 'request_id': 'req-19806fb0-8d74-4d98-82a8-d77d8cc35f99'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:05.837740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:05.851211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-19806fb0-8d74-4d98-82a8-d77d8cc35f99 admin admin] The token cache is being invalidate because project 4178c67e55fe4974a97c7af6e4a1cb00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:56:05.851503 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-19806fb0-8d74-4d98-82a8-d77d8cc35f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:05.852171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-19806fb0-8d74-4d98-82a8-d77d8cc35f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:56:05.853709 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1122/2253] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:56:05 2022] DELETE /identity/v3/projects/4178c67e55fe4974a97c7af6e4a1cb00 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:56:15.414026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:15.848544 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:45.541389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72add838-bfd0-438d-96f9-dec0588b65b9 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:56:45.543558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-72add838-bfd0-438d-96f9-dec0588b65b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:45.617243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72add838-bfd0-438d-96f9-dec0588b65b9 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:56:45.682538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb982d-0a77-42ef-a0ac-b43d4941478c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:56:45.683178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb982d-0a77-42ef-a0ac-b43d4941478c service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:45.684053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb982d-0a77-42ef-a0ac-b43d4941478c service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:45.684379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb982d-0a77-42ef-a0ac-b43d4941478c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:45.686225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b0bb982d-0a77-42ef-a0ac-b43d4941478c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:45.698275 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb982d-0a77-42ef-a0ac-b43d4941478c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:56:45.700590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb982d-0a77-42ef-a0ac-b43d4941478c service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:56:45.711879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1132/2254] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:56:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:56:55.708418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=58 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:58.700007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9032eb5-6742-4e32-97ba-9a936d8a7e5a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:56:58.700522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9032eb5-6742-4e32-97ba-9a936d8a7e5a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:56:58.700625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9032eb5-6742-4e32-97ba-9a936d8a7e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:56:58.720219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c9032eb5-6742-4e32-97ba-9a936d8a7e5a None None] MFA Rules not processed for user `41650f44d6a14a1abab40d3f05317fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:56:58.721409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c9032eb5-6742-4e32-97ba-9a936d8a7e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:56:58.782054 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1123/2255] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:56:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:57:08.775308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=25 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:11.169839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df7904-ded8-450f-8a96-f16017cabcb7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:11.170365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df7904-ded8-450f-8a96-f16017cabcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:11.170464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df7904-ded8-450f-8a96-f16017cabcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:11.194340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-36df7904-ded8-450f-8a96-f16017cabcb7 None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:11.195376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-36df7904-ded8-450f-8a96-f16017cabcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:11.264730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1133/2256] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 08:58:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:11.316839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9032eb5-6742-4e32-97ba-9a936d8a7e5a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:11.318391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c9032eb5-6742-4e32-97ba-9a936d8a7e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:11.400310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9032eb5-6742-4e32-97ba-9a936d8a7e5a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:11.405378 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f5e9e-c1d7-4a3d-ba2f-050928dc0c9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:11.406022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f5e9e-c1d7-4a3d-ba2f-050928dc0c9e service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:11.406306 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f5e9e-c1d7-4a3d-ba2f-050928dc0c9e service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:11.406584 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f5e9e-c1d7-4a3d-ba2f-050928dc0c9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:11.415154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f5e9e-c1d7-4a3d-ba2f-050928dc0c9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:11.416781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f5e9e-c1d7-4a3d-ba2f-050928dc0c9e service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:11.425145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1124/2257] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 08:58:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:58:20.064971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df7904-ded8-450f-8a96-f16017cabcb7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:20.067134 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-36df7904-ded8-450f-8a96-f16017cabcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:20.156393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df7904-ded8-450f-8a96-f16017cabcb7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:20.161809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca73fa9-ae8f-4ecc-bc45-53590fc62ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:20.162469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca73fa9-ae8f-4ecc-bc45-53590fc62ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:20.162748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca73fa9-ae8f-4ecc-bc45-53590fc62ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:20.163021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca73fa9-ae8f-4ecc-bc45-53590fc62ee9 admin admin] PATH_INFO: `/v3/users/41650f44d6a14a1abab40d3f05317fa8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:20.164256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca73fa9-ae8f-4ecc-bc45-53590fc62ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41650f44d6a14a1abab40d3f05317fa8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:20.166205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca73fa9-ae8f-4ecc-bc45-53590fc62ee9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:20.213426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aca73fa9-ae8f-4ecc-bc45-53590fc62ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41650f44d6a14a1abab40d3f05317fa8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:20.214150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aca73fa9-ae8f-4ecc-bc45-53590fc62ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41650f44d6a14a1abab40d3f05317fa8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:20.224233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aca73fa9-ae8f-4ecc-bc45-53590fc62ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41650f44d6a14a1abab40d3f05317fa8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:20.237471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aca73fa9-ae8f-4ecc-bc45-53590fc62ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41650f44d6a14a1abab40d3f05317fa8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:20.248081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-aca73fa9-ae8f-4ecc-bc45-53590fc62ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41650f44d6a14a1abab40d3f05317fa8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:20.255436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1134/2258] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:58:20 2022] DELETE /identity/v3/users/41650f44d6a14a1abab40d3f05317fa8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:58:20.441708 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f5e9e-c1d7-4a3d-ba2f-050928dc0c9e service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:20.475177 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f5e9e-c1d7-4a3d-ba2f-050928dc0c9e service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:20.553868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af738ee1-e7b7-488f-bd9e-94c7d471ddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:20.554938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738ee1-e7b7-488f-bd9e-94c7d471ddab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:20.555222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738ee1-e7b7-488f-bd9e-94c7d471ddab admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:20.555491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738ee1-e7b7-488f-bd9e-94c7d471ddab admin admin] PATH_INFO: `/v3/projects/b40df4325f5c495396daab8f57b0dcf4` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:20.556725 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af738ee1-e7b7-488f-bd9e-94c7d471ddab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40df4325f5c495396daab8f57b0dcf4)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:20.559139 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af738ee1-e7b7-488f-bd9e-94c7d471ddab admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:20.611620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af738ee1-e7b7-488f-bd9e-94c7d471ddab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40df4325f5c495396daab8f57b0dcf4', 'request_id': 'req-af738ee1-e7b7-488f-bd9e-94c7d471ddab'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:20.618138 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af738ee1-e7b7-488f-bd9e-94c7d471ddab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40df4325f5c495396daab8f57b0dcf4', 'request_id': 'req-af738ee1-e7b7-488f-bd9e-94c7d471ddab'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:20.624485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af738ee1-e7b7-488f-bd9e-94c7d471ddab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40df4325f5c495396daab8f57b0dcf4', 'request_id': 'req-af738ee1-e7b7-488f-bd9e-94c7d471ddab'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:20.637943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af738ee1-e7b7-488f-bd9e-94c7d471ddab admin admin] The token cache is being invalidate because project b40df4325f5c495396daab8f57b0dcf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:58:20.638229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af738ee1-e7b7-488f-bd9e-94c7d471ddab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:20.638840 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af738ee1-e7b7-488f-bd9e-94c7d471ddab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:20.640368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1125/2259] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:58:20 2022] DELETE /identity/v3/projects/b40df4325f5c495396daab8f57b0dcf4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:58:20.645335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c19b9-6abb-4f4b-95ef-2547282d0371 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:20.645722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c19b9-6abb-4f4b-95ef-2547282d0371 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:20.645999 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c19b9-6abb-4f4b-95ef-2547282d0371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:20.666016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c28c19b9-6abb-4f4b-95ef-2547282d0371 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:20.667218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c28c19b9-6abb-4f4b-95ef-2547282d0371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:20.687264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:20.735934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1135/2260] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:20.745265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39dd34-1a11-4aaf-873d-b28099720c12 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:20.745559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39dd34-1a11-4aaf-873d-b28099720c12 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:20.745832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39dd34-1a11-4aaf-873d-b28099720c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:20.765747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ae39dd34-1a11-4aaf-873d-b28099720c12 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:20.766943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ae39dd34-1a11-4aaf-873d-b28099720c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:20.774964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1126/2261] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:20.839603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c19b9-6abb-4f4b-95ef-2547282d0371 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:20.850146 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c19b9-6abb-4f4b-95ef-2547282d0371 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:20.854966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36930b8e-e623-41ba-b9fe-42b17fc007f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:20.855672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930b8e-e623-41ba-b9fe-42b17fc007f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:20.855956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930b8e-e623-41ba-b9fe-42b17fc007f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:20.856308 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930b8e-e623-41ba-b9fe-42b17fc007f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:20.857073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36930b8e-e623-41ba-b9fe-42b17fc007f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:58:20.857410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36930b8e-e623-41ba-b9fe-42b17fc007f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:20.859175 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36930b8e-e623-41ba-b9fe-42b17fc007f9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:20.872322 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1136/2262] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:58:20.876594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39dd34-1a11-4aaf-873d-b28099720c12 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:20.887063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39dd34-1a11-4aaf-873d-b28099720c12 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:20.891942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cde814-e15f-44c2-b3bf-e3e4ef3bb256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:20.892590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cde814-e15f-44c2-b3bf-e3e4ef3bb256 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:20.892874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cde814-e15f-44c2-b3bf-e3e4ef3bb256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:20.893149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cde814-e15f-44c2-b3bf-e3e4ef3bb256 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:20.893812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cde814-e15f-44c2-b3bf-e3e4ef3bb256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:20.895806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cde814-e15f-44c2-b3bf-e3e4ef3bb256 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:20.911332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:20.955853 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1127/2263] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:58:20 2022] POST /identity/v3/projects => generated 399 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:58:20.961000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36930b8e-e623-41ba-b9fe-42b17fc007f9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:20.980660 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36930b8e-e623-41ba-b9fe-42b17fc007f9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:21.060597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cbfee-8553-4a11-9649-7183203ca969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:21.061390 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cbfee-8553-4a11-9649-7183203ca969 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:21.061733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cbfee-8553-4a11-9649-7183203ca969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:21.062015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cbfee-8553-4a11-9649-7183203ca969 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:21.062956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cbfee-8553-4a11-9649-7183203ca969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:21.065000 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cbfee-8553-4a11-9649-7183203ca969 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:21.093161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1137/2264] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:58:20 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:58:21.098204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cde814-e15f-44c2-b3bf-e3e4ef3bb256 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:21.111633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cde814-e15f-44c2-b3bf-e3e4ef3bb256 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:21.119385 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ced028-2f3d-45e8-960e-809b1f7df78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:21.120011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced028-2f3d-45e8-960e-809b1f7df78a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:21.120329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced028-2f3d-45e8-960e-809b1f7df78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:21.120610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced028-2f3d-45e8-960e-809b1f7df78a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:21.121341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ced028-2f3d-45e8-960e-809b1f7df78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:21.123273 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ced028-2f3d-45e8-960e-809b1f7df78a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:21.138636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1128/2265] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:58:21.142610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cbfee-8553-4a11-9649-7183203ca969 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:21.156106 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cbfee-8553-4a11-9649-7183203ca969 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:21.162523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f5e68-6af0-4505-bb2b-ff3f21ababa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:21.163147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f5e68-6af0-4505-bb2b-ff3f21ababa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:21.163435 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f5e68-6af0-4505-bb2b-ff3f21ababa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:21.163717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f5e68-6af0-4505-bb2b-ff3f21ababa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:21.164460 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f5e68-6af0-4505-bb2b-ff3f21ababa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:21.166145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f5e68-6af0-4505-bb2b-ff3f21ababa1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:21.182907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1138/2266] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:58:21.184056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ced028-2f3d-45e8-960e-809b1f7df78a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:21.196810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ced028-2f3d-45e8-960e-809b1f7df78a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:21.202519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd6a66-8654-4a1a-a1af-9471b80b5985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:21.203452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd6a66-8654-4a1a-a1af-9471b80b5985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:21.204049 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd6a66-8654-4a1a-a1af-9471b80b5985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:21.204583 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd6a66-8654-4a1a-a1af-9471b80b5985 admin admin] PATH_INFO: `/v3/projects/a982859ca0a742a08cee8fdc449ef37b/users/d2fa345ae07d42b9a89c3e37215b3f6f/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:21.220951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd6a66-8654-4a1a-a1af-9471b80b5985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a982859ca0a742a08cee8fdc449ef37b, user_id=d2fa345ae07d42b9a89c3e37215b3f6f, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:21.223827 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd6a66-8654-4a1a-a1af-9471b80b5985 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:21.251277 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1129/2267] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:58:21 2022] PUT /identity/v3/projects/a982859ca0a742a08cee8fdc449ef37b/users/d2fa345ae07d42b9a89c3e37215b3f6f/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:58:21.259051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3249f96-542f-4d0f-b552-4b0392d0fe85 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:21.259564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3249f96-542f-4d0f-b552-4b0392d0fe85 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:21.259863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3249f96-542f-4d0f-b552-4b0392d0fe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:21.295851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d3249f96-542f-4d0f-b552-4b0392d0fe85 None None] MFA Rules not processed for user `d2fa345ae07d42b9a89c3e37215b3f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:21.297472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d3249f96-542f-4d0f-b552-4b0392d0fe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:21.377393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1139/2268] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:58:21 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:21.390235 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd6a66-8654-4a1a-a1af-9471b80b5985 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:21.391914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a3fd6a66-8654-4a1a-a1af-9471b80b5985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:21.459017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd6a66-8654-4a1a-a1af-9471b80b5985 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:21.463041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e83838-6de4-4d8b-a23a-088ea0948fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:21.463747 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e83838-6de4-4d8b-a23a-088ea0948fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:21.464146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e83838-6de4-4d8b-a23a-088ea0948fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:21.464437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e83838-6de4-4d8b-a23a-088ea0948fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:21.474248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e83838-6de4-4d8b-a23a-088ea0948fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:21.475687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e83838-6de4-4d8b-a23a-088ea0948fe4 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:21.485469 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1130/2269] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:58:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:58:30.672026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3249f96-542f-4d0f-b552-4b0392d0fe85 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:30.693179 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:30.735954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3249f96-542f-4d0f-b552-4b0392d0fe85 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:30.740511 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:30.741149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:30.741436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:30.741723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] PATH_INFO: `/v3/users/d2fa345ae07d42b9a89c3e37215b3f6f` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:30.742896 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2fa345ae07d42b9a89c3e37215b3f6f)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:30.744898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:30.790258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2fa345ae07d42b9a89c3e37215b3f6f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:30.790908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2fa345ae07d42b9a89c3e37215b3f6f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:30.800520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2fa345ae07d42b9a89c3e37215b3f6f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:30.818845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2fa345ae07d42b9a89c3e37215b3f6f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:30.826131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2fa345ae07d42b9a89c3e37215b3f6f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:30.832710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1140/2270] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 08:58:30 2022] DELETE /identity/v3/users/d2fa345ae07d42b9a89c3e37215b3f6f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:58:30.837157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027eb43-5e34-4bfb-8a9e-3ca456159010 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:30.837645 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027eb43-5e34-4bfb-8a9e-3ca456159010 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:30.837741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027eb43-5e34-4bfb-8a9e-3ca456159010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:30.856897 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8027eb43-5e34-4bfb-8a9e-3ca456159010 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:30.858120 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8027eb43-5e34-4bfb-8a9e-3ca456159010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:30.917113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1131/2271] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:30.926670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:30.928071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:30.988630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638afe25-bd1a-466d-ae0c-d4b99015944b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:30.992248 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc20f8f-521a-4374-bbeb-c35fcaf28788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:30.992861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc20f8f-521a-4374-bbeb-c35fcaf28788 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:30.993144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc20f8f-521a-4374-bbeb-c35fcaf28788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:30.993420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc20f8f-521a-4374-bbeb-c35fcaf28788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:31.002305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc20f8f-521a-4374-bbeb-c35fcaf28788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:31.003748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc20f8f-521a-4374-bbeb-c35fcaf28788 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:31.013083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1141/2272] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:58:31.277303 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027eb43-5e34-4bfb-8a9e-3ca456159010 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:31.278866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8027eb43-5e34-4bfb-8a9e-3ca456159010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:31.292071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027eb43-5e34-4bfb-8a9e-3ca456159010 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:31.296839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3c07e-4798-41f3-88f4-c4f58248d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:31.297583 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3c07e-4798-41f3-88f4-c4f58248d153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:31.297941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3c07e-4798-41f3-88f4-c4f58248d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:31.298297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3c07e-4798-41f3-88f4-c4f58248d153 admin admin] PATH_INFO: `/v3/projects/a982859ca0a742a08cee8fdc449ef37b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:31.299483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3c07e-4798-41f3-88f4-c4f58248d153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a982859ca0a742a08cee8fdc449ef37b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:31.302084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3c07e-4798-41f3-88f4-c4f58248d153 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:31.352467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-edc3c07e-4798-41f3-88f4-c4f58248d153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a982859ca0a742a08cee8fdc449ef37b', 'request_id': 'req-edc3c07e-4798-41f3-88f4-c4f58248d153'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:31.356367 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:31.358822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-edc3c07e-4798-41f3-88f4-c4f58248d153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a982859ca0a742a08cee8fdc449ef37b', 'request_id': 'req-edc3c07e-4798-41f3-88f4-c4f58248d153'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:31.367005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-edc3c07e-4798-41f3-88f4-c4f58248d153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a982859ca0a742a08cee8fdc449ef37b', 'request_id': 'req-edc3c07e-4798-41f3-88f4-c4f58248d153'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:31.380738 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-edc3c07e-4798-41f3-88f4-c4f58248d153 admin admin] The token cache is being invalidate because project a982859ca0a742a08cee8fdc449ef37b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:58:31.381031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-edc3c07e-4798-41f3-88f4-c4f58248d153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:31.381656 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-edc3c07e-4798-41f3-88f4-c4f58248d153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:58:31.383156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1132/2273] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 08:58:31 2022] DELETE /identity/v3/projects/a982859ca0a742a08cee8fdc449ef37b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:58:31.388607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e107826-4e06-41f4-981d-9b45f6d0d1da None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:31.388899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e107826-4e06-41f4-981d-9b45f6d0d1da None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:31.389180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e107826-4e06-41f4-981d-9b45f6d0d1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:31.408471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9e107826-4e06-41f4-981d-9b45f6d0d1da None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:31.411020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9e107826-4e06-41f4-981d-9b45f6d0d1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:31.454796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:31.478070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1142/2274] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:31.486050 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab929-535d-432f-a899-017ae13cbfd3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:31.486345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab929-535d-432f-a899-017ae13cbfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:31.486625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab929-535d-432f-a899-017ae13cbfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:31.509198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-315ab929-535d-432f-a899-017ae13cbfd3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:31.510479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-315ab929-535d-432f-a899-017ae13cbfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:31.518670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1133/2275] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:31.523406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e107826-4e06-41f4-981d-9b45f6d0d1da None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:31.533453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e107826-4e06-41f4-981d-9b45f6d0d1da None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:31.549809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2333f-62c7-4e30-9908-6be4aef2ebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:31.550451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2333f-62c7-4e30-9908-6be4aef2ebdd admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:31.550733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2333f-62c7-4e30-9908-6be4aef2ebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:31.551035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2333f-62c7-4e30-9908-6be4aef2ebdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:31.551755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2333f-62c7-4e30-9908-6be4aef2ebdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:58:31.552060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2333f-62c7-4e30-9908-6be4aef2ebdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:31.553700 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2333f-62c7-4e30-9908-6be4aef2ebdd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:31.565899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1143/2276] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 08:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:58:31.570347 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ab929-535d-432f-a899-017ae13cbfd3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:31.579485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ab929-535d-432f-a899-017ae13cbfd3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:31.584741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b30ef-d19d-440f-b3dd-d587c381ebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:31.585358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b30ef-d19d-440f-b3dd-d587c381ebc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:31.585640 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b30ef-d19d-440f-b3dd-d587c381ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:31.585916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b30ef-d19d-440f-b3dd-d587c381ebc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:31.586575 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b30ef-d19d-440f-b3dd-d587c381ebc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:31.588560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b30ef-d19d-440f-b3dd-d587c381ebc0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:31.618681 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1134/2277] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:58:31 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:58:31.624790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2333f-62c7-4e30-9908-6be4aef2ebdd admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:31.637686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2333f-62c7-4e30-9908-6be4aef2ebdd admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:31.705401 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa1b5a-50ff-49bb-9b6e-d215e9f0f01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:31.706040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa1b5a-50ff-49bb-9b6e-d215e9f0f01f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:31.706358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa1b5a-50ff-49bb-9b6e-d215e9f0f01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:31.706644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa1b5a-50ff-49bb-9b6e-d215e9f0f01f admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:31.707934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa1b5a-50ff-49bb-9b6e-d215e9f0f01f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:31.709928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa1b5a-50ff-49bb-9b6e-d215e9f0f01f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:31.732485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1144/2278] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:58:31 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:58:31.736670 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b30ef-d19d-440f-b3dd-d587c381ebc0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:31.747762 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b30ef-d19d-440f-b3dd-d587c381ebc0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:31.752941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6349063-c7dc-444a-a7a9-5adbec7c3bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:31.753556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6349063-c7dc-444a-a7a9-5adbec7c3bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:31.753963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6349063-c7dc-444a-a7a9-5adbec7c3bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:31.754246 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6349063-c7dc-444a-a7a9-5adbec7c3bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:31.754949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6349063-c7dc-444a-a7a9-5adbec7c3bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:31.756649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6349063-c7dc-444a-a7a9-5adbec7c3bdf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:31.767049 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1135/2279] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:58:31.771691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa1b5a-50ff-49bb-9b6e-d215e9f0f01f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:31.781918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa1b5a-50ff-49bb-9b6e-d215e9f0f01f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:31.787225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f0055-01e8-4c4d-95b8-f8451d7dd0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:31.787837 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f0055-01e8-4c4d-95b8-f8451d7dd0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:31.788147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f0055-01e8-4c4d-95b8-f8451d7dd0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:31.788417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f0055-01e8-4c4d-95b8-f8451d7dd0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:31.789110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f0055-01e8-4c4d-95b8-f8451d7dd0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:31.790711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f0055-01e8-4c4d-95b8-f8451d7dd0b3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:31.807565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1145/2280] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:58:31.807865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6349063-c7dc-444a-a7a9-5adbec7c3bdf admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:31.819099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6349063-c7dc-444a-a7a9-5adbec7c3bdf admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:31.823804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434bdc-f1b0-4344-80b4-c4cd8c0c3dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:31.824504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434bdc-f1b0-4344-80b4-c4cd8c0c3dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:31.824795 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434bdc-f1b0-4344-80b4-c4cd8c0c3dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:31.825071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434bdc-f1b0-4344-80b4-c4cd8c0c3dd4 admin admin] PATH_INFO: `/v3/projects/8e34c8b3cec84078bbb2121ae4a279de/users/e2cc95918e4f457f955161df0dd0ebde/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:31.840754 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07434bdc-f1b0-4344-80b4-c4cd8c0c3dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e34c8b3cec84078bbb2121ae4a279de, user_id=e2cc95918e4f457f955161df0dd0ebde, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:31.843619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07434bdc-f1b0-4344-80b4-c4cd8c0c3dd4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:31.856359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1136/2281] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:58:31 2022] PUT /identity/v3/projects/8e34c8b3cec84078bbb2121ae4a279de/users/e2cc95918e4f457f955161df0dd0ebde/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:58:31.861791 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80b411-6bf9-4276-80c1-9489b73b0303 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:31.862082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80b411-6bf9-4276-80c1-9489b73b0303 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:31.862365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80b411-6bf9-4276-80c1-9489b73b0303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:31.882817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4b80b411-6bf9-4276-80c1-9489b73b0303 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:31.884110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4b80b411-6bf9-4276-80c1-9489b73b0303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:31.950550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1146/2282] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:31.961291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434bdc-f1b0-4344-80b4-c4cd8c0c3dd4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:31.963022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-07434bdc-f1b0-4344-80b4-c4cd8c0c3dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:32.031635 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434bdc-f1b0-4344-80b4-c4cd8c0c3dd4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:32.036905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de6697-571f-4a37-ad68-f28782ce30ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:32.037295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de6697-571f-4a37-ad68-f28782ce30ae service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:32.037577 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de6697-571f-4a37-ad68-f28782ce30ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:32.037850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de6697-571f-4a37-ad68-f28782ce30ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:32.048665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de6697-571f-4a37-ad68-f28782ce30ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:32.050141 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de6697-571f-4a37-ad68-f28782ce30ae service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:32.060701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1137/2283] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:58:32.328105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3922d-5374-4432-bc78-02a34f1ca534 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:32.328587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3922d-5374-4432-bc78-02a34f1ca534 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:32.328917 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3922d-5374-4432-bc78-02a34f1ca534 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:32.330520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1147/2284] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 08:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:58:32.337150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500fd24-674a-4abb-a96f-fa15c58f84be None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:32.337461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500fd24-674a-4abb-a96f-fa15c58f84be None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:32.337746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500fd24-674a-4abb-a96f-fa15c58f84be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:32.357884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5500fd24-674a-4abb-a96f-fa15c58f84be None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:32.359103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5500fd24-674a-4abb-a96f-fa15c58f84be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:32.439492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1138/2285] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 08:58:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:32.453526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3922d-5374-4432-bc78-02a34f1ca534 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:32.455647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-43e3922d-5374-4432-bc78-02a34f1ca534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:32.529582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:32.536325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3922d-5374-4432-bc78-02a34f1ca534 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:32.539936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db4f8e-cd12-43b4-b312-37bed1e9ad1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b08a946b43f08028c5da415d4e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:32.540654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db4f8e-cd12-43b4-b312-37bed1e9ad1a service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:32.541335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db4f8e-cd12-43b4-b312-37bed1e9ad1a service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:32.542552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db4f8e-cd12-43b4-b312-37bed1e9ad1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:32.555365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db4f8e-cd12-43b4-b312-37bed1e9ad1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:32.556869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db4f8e-cd12-43b4-b312-37bed1e9ad1a service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:32.570115 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1148/2286] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:58:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:58:32.639739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951d015-daa1-4a60-b9ff-4fe70fef0602 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:32.640033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951d015-daa1-4a60-b9ff-4fe70fef0602 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:32.640332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951d015-daa1-4a60-b9ff-4fe70fef0602 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:32.641843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1139/2287] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 08:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:58:32.646751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e04cad-10d8-44e8-be10-0ad96794768e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:32.647096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e04cad-10d8-44e8-be10-0ad96794768e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:32.647478 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e04cad-10d8-44e8-be10-0ad96794768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:32.669892 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-09e04cad-10d8-44e8-be10-0ad96794768e None None] MFA Rules not processed for user `c9162dcfb8d542679c7217fae8f5c185`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:32.671115 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-09e04cad-10d8-44e8-be10-0ad96794768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:32.678931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1149/2288] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 08:58:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:32.690379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951d015-daa1-4a60-b9ff-4fe70fef0602 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:32.701221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951d015-daa1-4a60-b9ff-4fe70fef0602 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:32.704726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f316bd5-e0e7-4dec-975f-bd3a379b89de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:32.705339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316bd5-e0e7-4dec-975f-bd3a379b89de service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:32.706016 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316bd5-e0e7-4dec-975f-bd3a379b89de service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:32.706016 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316bd5-e0e7-4dec-975f-bd3a379b89de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:32.714341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f316bd5-e0e7-4dec-975f-bd3a379b89de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:32.716059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f316bd5-e0e7-4dec-975f-bd3a379b89de service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:32.720637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:32.725745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1140/2289] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:58:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:58:32.825926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad725-d650-4b99-bf3f-16cb31ce0466 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:32.826487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad725-d650-4b99-bf3f-16cb31ce0466 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:32.826487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad725-d650-4b99-bf3f-16cb31ce0466 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:32.827983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1150/2290] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 08:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:58:32.834968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978bfd-6505-4d3d-99ce-a5a8e97b39ff None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:32.835567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978bfd-6505-4d3d-99ce-a5a8e97b39ff None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:32.837526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978bfd-6505-4d3d-99ce-a5a8e97b39ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:32.864428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-95978bfd-6505-4d3d-99ce-a5a8e97b39ff None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:32.866369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-95978bfd-6505-4d3d-99ce-a5a8e97b39ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:32.878543 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1141/2291] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 08:58:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:58:32.892075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad725-d650-4b99-bf3f-16cb31ce0466 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:32.893821 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9e3ad725-d650-4b99-bf3f-16cb31ce0466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:32.909610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad725-d650-4b99-bf3f-16cb31ce0466 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:32.914323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3616bb-26d1-4d9a-b6e1-72a986663b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:32.914952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3616bb-26d1-4d9a-b6e1-72a986663b92 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:32.915264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3616bb-26d1-4d9a-b6e1-72a986663b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:32.915534 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3616bb-26d1-4d9a-b6e1-72a986663b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:32.927486 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3616bb-26d1-4d9a-b6e1-72a986663b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:32.929131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3616bb-26d1-4d9a-b6e1-72a986663b92 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:32.945650 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1151/2292] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:58:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:58:34.814700 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95978bfd-6505-4d3d-99ce-a5a8e97b39ff None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:34.826675 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95978bfd-6505-4d3d-99ce-a5a8e97b39ff None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:34.836809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486fc3a-f609-4c80-b7cb-f270087d295d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:34.837451 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486fc3a-f609-4c80-b7cb-f270087d295d service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:34.838054 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486fc3a-f609-4c80-b7cb-f270087d295d service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:34.838822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486fc3a-f609-4c80-b7cb-f270087d295d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:34.844697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0486fc3a-f609-4c80-b7cb-f270087d295d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:34.885864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486fc3a-f609-4c80-b7cb-f270087d295d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:34.888015 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486fc3a-f609-4c80-b7cb-f270087d295d service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:34.913655 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1142/2293] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:58:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:58:36.887305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813377-cf56-4502-a01d-4caed4426da8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:36.888997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813377-cf56-4502-a01d-4caed4426da8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:36.889949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813377-cf56-4502-a01d-4caed4426da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:36.913960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f1813377-cf56-4502-a01d-4caed4426da8 None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:36.915652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f1813377-cf56-4502-a01d-4caed4426da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:36.920158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486fc3a-f609-4c80-b7cb-f270087d295d service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:36.922983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0486fc3a-f609-4c80-b7cb-f270087d295d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:37.020826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486fc3a-f609-4c80-b7cb-f270087d295d service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:37.029517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5b189-59c0-497c-a085-7757680ce920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:37.030396 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5b189-59c0-497c-a085-7757680ce920 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:37.030839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5b189-59c0-497c-a085-7757680ce920 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:37.031299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5b189-59c0-497c-a085-7757680ce920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:37.031678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1152/2294] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 08:58:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:37.033619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9fc5b189-59c0-497c-a085-7757680ce920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:37.047956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1813377-cf56-4502-a01d-4caed4426da8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:37.050017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f1813377-cf56-4502-a01d-4caed4426da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:37.058181 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5b189-59c0-497c-a085-7757680ce920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:37.059911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5b189-59c0-497c-a085-7757680ce920 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:37.073193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1143/2295] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:58:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:58:37.166703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1813377-cf56-4502-a01d-4caed4426da8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:37.173316 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a28f37-1d5e-458a-a0ad-23cfdad11a81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:37.173963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a28f37-1d5e-458a-a0ad-23cfdad11a81 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:37.174247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a28f37-1d5e-458a-a0ad-23cfdad11a81 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:37.174526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a28f37-1d5e-458a-a0ad-23cfdad11a81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:37.185011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a28f37-1d5e-458a-a0ad-23cfdad11a81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:37.187034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a28f37-1d5e-458a-a0ad-23cfdad11a81 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:37.194115 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2585-8a45-4a15-b40e-484e76f9fcef None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:37.194406 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2585-8a45-4a15-b40e-484e76f9fcef None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:37.194684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2585-8a45-4a15-b40e-484e76f9fcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:37.203286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1153/2296] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 08:58:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 08:58:37.230287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-885d2585-8a45-4a15-b40e-484e76f9fcef None None] MFA Rules not processed for user `e2cc95918e4f457f955161df0dd0ebde`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:37.231587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-885d2585-8a45-4a15-b40e-484e76f9fcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:37.357353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1144/2297] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:58:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:37.362161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a28f37-1d5e-458a-a0ad-23cfdad11a81 service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:37.382395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a28f37-1d5e-458a-a0ad-23cfdad11a81 service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:37.387460 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c536ba-6528-4c9e-ae88-9910e3486478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:37.388195 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c536ba-6528-4c9e-ae88-9910e3486478 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:37.388573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c536ba-6528-4c9e-ae88-9910e3486478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:37.388922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c536ba-6528-4c9e-ae88-9910e3486478 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:37.389811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c536ba-6528-4c9e-ae88-9910e3486478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:37.391847 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c536ba-6528-4c9e-ae88-9910e3486478 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:37.429058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1154/2298] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 08:58:37 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:58:37.433349 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d2585-8a45-4a15-b40e-484e76f9fcef None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:37.453838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d2585-8a45-4a15-b40e-484e76f9fcef None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:37.592051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ebefa-8e05-442a-b14a-a03e0382aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:37.592803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ebefa-8e05-442a-b14a-a03e0382aeab admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:37.593093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ebefa-8e05-442a-b14a-a03e0382aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:37.593373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ebefa-8e05-442a-b14a-a03e0382aeab admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:37.594051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ebefa-8e05-442a-b14a-a03e0382aeab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:37.596014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ebefa-8e05-442a-b14a-a03e0382aeab admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:37.653285 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1145/2299] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 08:58:37 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:58:37.658012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c536ba-6528-4c9e-ae88-9910e3486478 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:37.673729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c536ba-6528-4c9e-ae88-9910e3486478 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:37.692299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94faf4-d0f6-4287-ab09-7cd2e959af4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:37.692965 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94faf4-d0f6-4287-ab09-7cd2e959af4d admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:37.693251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94faf4-d0f6-4287-ab09-7cd2e959af4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:37.693522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94faf4-d0f6-4287-ab09-7cd2e959af4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:37.694263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94faf4-d0f6-4287-ab09-7cd2e959af4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:37.695875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94faf4-d0f6-4287-ab09-7cd2e959af4d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:37.726973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1155/2300] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:58:37.730985 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ebefa-8e05-442a-b14a-a03e0382aeab admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:37.739834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:37.746805 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ebefa-8e05-442a-b14a-a03e0382aeab admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:37.766931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8c504-01d5-47ff-b786-11c00152ef48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:37.768568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8c504-01d5-47ff-b786-11c00152ef48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:37.773207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8c504-01d5-47ff-b786-11c00152ef48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:37.773965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8c504-01d5-47ff-b786-11c00152ef48 admin admin] PATH_INFO: `/v3/projects/e6f332980ae440069caad14ecc2acf3d/users/8ed4e38b08ba4cd5baaa7890697a851c/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:37.798856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8c504-01d5-47ff-b786-11c00152ef48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f332980ae440069caad14ecc2acf3d, user_id=8ed4e38b08ba4cd5baaa7890697a851c, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:37.801896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8c504-01d5-47ff-b786-11c00152ef48 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:37.839543 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1146/2301] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:58:37 2022] PUT /identity/v3/projects/e6f332980ae440069caad14ecc2acf3d/users/8ed4e38b08ba4cd5baaa7890697a851c/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:58:37.843550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94faf4-d0f6-4287-ab09-7cd2e959af4d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:37.864061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94faf4-d0f6-4287-ab09-7cd2e959af4d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:37.899818 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:37.943096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d20abb-8cae-45b3-971f-5544b3061495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:37.943736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d20abb-8cae-45b3-971f-5544b3061495 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:37.944022 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d20abb-8cae-45b3-971f-5544b3061495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:37.944338 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d20abb-8cae-45b3-971f-5544b3061495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:37.945083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d20abb-8cae-45b3-971f-5544b3061495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:37.946726 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d20abb-8cae-45b3-971f-5544b3061495 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:37.957974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1156/2302] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 08:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:58:37.962484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8c504-01d5-47ff-b786-11c00152ef48 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:37.973124 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8c504-01d5-47ff-b786-11c00152ef48 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:37.977843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a04a6-5b6b-4c3d-9e63-3dde05c06572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:37.978529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a04a6-5b6b-4c3d-9e63-3dde05c06572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:37.978821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a04a6-5b6b-4c3d-9e63-3dde05c06572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:37.979128 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a04a6-5b6b-4c3d-9e63-3dde05c06572 admin admin] PATH_INFO: `/v3/projects/e6f332980ae440069caad14ecc2acf3d/users/8ed4e38b08ba4cd5baaa7890697a851c/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:37.981337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a04a6-5b6b-4c3d-9e63-3dde05c06572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f332980ae440069caad14ecc2acf3d, user_id=8ed4e38b08ba4cd5baaa7890697a851c, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:37.984006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a04a6-5b6b-4c3d-9e63-3dde05c06572 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:38.010113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1147/2303] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 08:58:37 2022] PUT /identity/v3/projects/e6f332980ae440069caad14ecc2acf3d/users/8ed4e38b08ba4cd5baaa7890697a851c/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:58:38.776420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d20abb-8cae-45b3-971f-5544b3061495 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:38.907484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d20abb-8cae-45b3-971f-5544b3061495 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:39.005150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89450a72-c748-4c33-97a0-6b3a7bff9e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:39.006217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89450a72-c748-4c33-97a0-6b3a7bff9e65 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:39.006694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89450a72-c748-4c33-97a0-6b3a7bff9e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:39.007381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89450a72-c748-4c33-97a0-6b3a7bff9e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:39.011484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-89450a72-c748-4c33-97a0-6b3a7bff9e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:39.128330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89450a72-c748-4c33-97a0-6b3a7bff9e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:39.130635 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89450a72-c748-4c33-97a0-6b3a7bff9e65 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:39.143461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1157/2304] 10.222.0.17 () {60 vars in 1396 bytes} [Tue Aug 2 08:58:38 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:58:43.717353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56880ca-38b6-4b74-9e40-015ca11d8d57 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:43.717939 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56880ca-38b6-4b74-9e40-015ca11d8d57 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:43.717939 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56880ca-38b6-4b74-9e40-015ca11d8d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:43.778082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c56880ca-38b6-4b74-9e40-015ca11d8d57 None None] MFA Rules not processed for user `8ed4e38b08ba4cd5baaa7890697a851c`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:43.780304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c56880ca-38b6-4b74-9e40-015ca11d8d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:43.871682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1148/2305] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:58:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:58:43.888984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89450a72-c748-4c33-97a0-6b3a7bff9e65 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:43.890928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-89450a72-c748-4c33-97a0-6b3a7bff9e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:43.942287 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:43.979962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89450a72-c748-4c33-97a0-6b3a7bff9e65 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:43.985725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897b552-df08-432d-8737-7fe8ded78fc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:43.986478 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b552-df08-432d-8737-7fe8ded78fc8 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:43.986760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b552-df08-432d-8737-7fe8ded78fc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:43.987035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b552-df08-432d-8737-7fe8ded78fc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:44.059307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897b552-df08-432d-8737-7fe8ded78fc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:44.061050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897b552-df08-432d-8737-7fe8ded78fc8 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:44.072105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1158/2306] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:58:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:58:45.481729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d0024-aad7-4c8a-a4e4-7658970f0e03 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:45.482252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d0024-aad7-4c8a-a4e4-7658970f0e03 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:45.482350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d0024-aad7-4c8a-a4e4-7658970f0e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:45.518282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3e4d0024-aad7-4c8a-a4e4-7658970f0e03 None None] MFA Rules not processed for user `e2cc95918e4f457f955161df0dd0ebde`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:58:45.520098 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3e4d0024-aad7-4c8a-a4e4-7658970f0e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:45.527158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1149/2307] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:58:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:58:54.067792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=38 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:54.560923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897b552-df08-432d-8737-7fe8ded78fc8 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:54.562436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d897b552-df08-432d-8737-7fe8ded78fc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:54.623544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897b552-df08-432d-8737-7fe8ded78fc8 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:54.627171 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87f030-1298-4ffa-bb12-793bec2f40fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:54.628277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87f030-1298-4ffa-bb12-793bec2f40fe service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:54.628277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87f030-1298-4ffa-bb12-793bec2f40fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:54.628483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87f030-1298-4ffa-bb12-793bec2f40fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:54.630341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-de87f030-1298-4ffa-bb12-793bec2f40fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:54.695010 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87f030-1298-4ffa-bb12-793bec2f40fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:54.696616 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87f030-1298-4ffa-bb12-793bec2f40fe service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:54.706558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1159/2308] 10.222.0.17 () {60 vars in 1396 bytes} [Tue Aug 2 08:58:54 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:58:55.512510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=51,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:58.378239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d0024-aad7-4c8a-a4e4-7658970f0e03 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:58:58.388461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d0024-aad7-4c8a-a4e4-7658970f0e03 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:58:58.391989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25df1d-78f1-4067-a22a-86936603c383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:58:58.392636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25df1d-78f1-4067-a22a-86936603c383 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:58:58.392920 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25df1d-78f1-4067-a22a-86936603c383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:58:58.393195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25df1d-78f1-4067-a22a-86936603c383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:58:58.394960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9c25df1d-78f1-4067-a22a-86936603c383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:58:58.405639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25df1d-78f1-4067-a22a-86936603c383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:58:58.407117 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25df1d-78f1-4067-a22a-86936603c383 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:58:58.415134 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1150/2309] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:58:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:59:04.701948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=48 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:08.411635 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:08.990089 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c81fd-39a7-4841-8e02-2cb613212c13 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:59:08.990609 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c81fd-39a7-4841-8e02-2cb613212c13 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:59:08.990738 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c81fd-39a7-4841-8e02-2cb613212c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:59:09.010798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-996c81fd-39a7-4841-8e02-2cb613212c13 None None] MFA Rules not processed for user `f01062e92f974dc890897d19359e7e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:59:09.012007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-996c81fd-39a7-4841-8e02-2cb613212c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:59:09.074625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1160/2310] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:59:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:59:09.389295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25df1d-78f1-4067-a22a-86936603c383 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:59:09.397651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25df1d-78f1-4067-a22a-86936603c383 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:59:09.401891 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b94479-ac3c-4e6a-abb7-a3e130b96b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:59:09.402496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b94479-ac3c-4e6a-abb7-a3e130b96b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:59:09.402780 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b94479-ac3c-4e6a-abb7-a3e130b96b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:59:09.403058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b94479-ac3c-4e6a-abb7-a3e130b96b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:59:09.404821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-79b94479-ac3c-4e6a-abb7-a3e130b96b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:59:09.414010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b94479-ac3c-4e6a-abb7-a3e130b96b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:59:09.415424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b94479-ac3c-4e6a-abb7-a3e130b96b11 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:59:09.423198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1151/2311] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:59:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:59:09.755899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c81fd-39a7-4841-8e02-2cb613212c13 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:59:09.757375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-996c81fd-39a7-4841-8e02-2cb613212c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:59:09.837180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c81fd-39a7-4841-8e02-2cb613212c13 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:59:09.842416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a8bef-aa07-49f4-b643-d849c6d46f97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:59:09.843041 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a8bef-aa07-49f4-b643-d849c6d46f97 service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:59:09.843329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a8bef-aa07-49f4-b643-d849c6d46f97 service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:59:09.843613 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a8bef-aa07-49f4-b643-d849c6d46f97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:59:09.845415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b50a8bef-aa07-49f4-b643-d849c6d46f97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:59:09.856980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a8bef-aa07-49f4-b643-d849c6d46f97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:59:09.858504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a8bef-aa07-49f4-b643-d849c6d46f97 service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:59:09.868940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1161/2312] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:59:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:59:11.995047 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4364beb-f5f6-48a6-bc83-48bf54d47d0e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:59:11.995529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4364beb-f5f6-48a6-bc83-48bf54d47d0e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:59:11.995529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4364beb-f5f6-48a6-bc83-48bf54d47d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:59:12.015892 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a4364beb-f5f6-48a6-bc83-48bf54d47d0e None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:59:12.017158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a4364beb-f5f6-48a6-bc83-48bf54d47d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:59:12.072558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1152/2313] 10.222.0.17 () {58 vars in 967 bytes} [Tue Aug 2 08:59:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:59:12.096268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a8bef-aa07-49f4-b643-d849c6d46f97 service placement] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:59:12.164140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a8bef-aa07-49f4-b643-d849c6d46f97 service placement] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:59:12.169585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d5e57-3190-4fd7-b1ad-c6ee624d3c52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:59:12.170203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d5e57-3190-4fd7-b1ad-c6ee624d3c52 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:59:12.170488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d5e57-3190-4fd7-b1ad-c6ee624d3c52 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:59:12.170762 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d5e57-3190-4fd7-b1ad-c6ee624d3c52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:59:12.178954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d5e57-3190-4fd7-b1ad-c6ee624d3c52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:59:12.181149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d5e57-3190-4fd7-b1ad-c6ee624d3c52 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:59:12.189328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1162/2314] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 08:59:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 08:59:13.849186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4364beb-f5f6-48a6-bc83-48bf54d47d0e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:59:13.859107 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4364beb-f5f6-48a6-bc83-48bf54d47d0e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:59:13.863014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8870e3-b4f3-4f74-bc3f-7a3970559910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:59:13.863720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8870e3-b4f3-4f74-bc3f-7a3970559910 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:59:13.864073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8870e3-b4f3-4f74-bc3f-7a3970559910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:59:13.864446 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8870e3-b4f3-4f74-bc3f-7a3970559910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:59:13.866267 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-da8870e3-b4f3-4f74-bc3f-7a3970559910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:59:13.878718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8870e3-b4f3-4f74-bc3f-7a3970559910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:59:13.883513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8870e3-b4f3-4f74-bc3f-7a3970559910 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:59:13.895217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1153/2315] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:59:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:59:14.979522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d5e57-3190-4fd7-b1ad-c6ee624d3c52 service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:59:14.982622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-039d5e57-3190-4fd7-b1ad-c6ee624d3c52 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:59:15.005590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d5e57-3190-4fd7-b1ad-c6ee624d3c52 service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:59:15.015627 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835a9c8-2033-46ac-ba02-14e55ea2ab5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:59:15.016496 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835a9c8-2033-46ac-ba02-14e55ea2ab5f service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:59:15.016987 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835a9c8-2033-46ac-ba02-14e55ea2ab5f service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:59:15.017708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835a9c8-2033-46ac-ba02-14e55ea2ab5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:59:15.020393 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4835a9c8-2033-46ac-ba02-14e55ea2ab5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:59:15.039434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835a9c8-2033-46ac-ba02-14e55ea2ab5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:59:15.045590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835a9c8-2033-46ac-ba02-14e55ea2ab5f service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:59:15.068358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1163/2316] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:59:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:59:19.276628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8870e3-b4f3-4f74-bc3f-7a3970559910 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:59:19.291200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8870e3-b4f3-4f74-bc3f-7a3970559910 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:59:19.298214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8089f4-eb00-4430-9f68-21edd53f8c55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:59:19.298843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8089f4-eb00-4430-9f68-21edd53f8c55 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:59:19.299129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8089f4-eb00-4430-9f68-21edd53f8c55 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:59:19.299406 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8089f4-eb00-4430-9f68-21edd53f8c55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:59:19.301290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0f8089f4-eb00-4430-9f68-21edd53f8c55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:59:19.316340 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8089f4-eb00-4430-9f68-21edd53f8c55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:59:19.317937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8089f4-eb00-4430-9f68-21edd53f8c55 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:59:19.331190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1154/2317] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:59:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:59:21.503605 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835a9c8-2033-46ac-ba02-14e55ea2ab5f service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:59:21.520488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835a9c8-2033-46ac-ba02-14e55ea2ab5f service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:59:21.526276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395b610-8f9c-496e-8aee-a22865a0e0c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:59:21.526910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395b610-8f9c-496e-8aee-a22865a0e0c3 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:59:21.527199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395b610-8f9c-496e-8aee-a22865a0e0c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:59:21.527482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395b610-8f9c-496e-8aee-a22865a0e0c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:59:21.529422 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1395b610-8f9c-496e-8aee-a22865a0e0c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:59:21.542637 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395b610-8f9c-496e-8aee-a22865a0e0c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:59:21.544315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395b610-8f9c-496e-8aee-a22865a0e0c3 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:59:21.549499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:21.560213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1164/2318] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:59:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:59:29.326280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=43 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:31.554003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:34.957639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8089f4-eb00-4430-9f68-21edd53f8c55 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:59:34.966804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8089f4-eb00-4430-9f68-21edd53f8c55 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:59:34.970365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855008f7-e1d3-4c07-97ff-3cd56076456f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:59:34.970967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855008f7-e1d3-4c07-97ff-3cd56076456f service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:59:34.971249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855008f7-e1d3-4c07-97ff-3cd56076456f service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:59:34.971539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855008f7-e1d3-4c07-97ff-3cd56076456f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:59:34.981556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855008f7-e1d3-4c07-97ff-3cd56076456f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:59:34.983121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855008f7-e1d3-4c07-97ff-3cd56076456f service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:59:34.993211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1155/2319] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:59:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:59:40.377377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a17d-d553-4c3f-a9b7-eb520c870efe None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:59:40.377869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a17d-d553-4c3f-a9b7-eb520c870efe None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:59:40.377985 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a17d-d553-4c3f-a9b7-eb520c870efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:59:40.397167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f3e8a17d-d553-4c3f-a9b7-eb520c870efe None None] MFA Rules not processed for user `7ed1be3a1ae249828caa8b88fd606557`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:59:40.398365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f3e8a17d-d553-4c3f-a9b7-eb520c870efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:59:40.405455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1165/2320] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 08:59:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:59:42.060288 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855008f7-e1d3-4c07-97ff-3cd56076456f service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:59:42.073184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855008f7-e1d3-4c07-97ff-3cd56076456f service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:59:42.078500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06c11-e817-4dfd-b3be-17109c2d4012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:59:42.079104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06c11-e817-4dfd-b3be-17109c2d4012 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:59:42.079388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06c11-e817-4dfd-b3be-17109c2d4012 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:59:42.079663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06c11-e817-4dfd-b3be-17109c2d4012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:59:42.081407 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d1f06c11-e817-4dfd-b3be-17109c2d4012 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:59:42.139142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f06c11-e817-4dfd-b3be-17109c2d4012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:59:42.140811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f06c11-e817-4dfd-b3be-17109c2d4012 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:59:42.149791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1156/2321] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 08:59:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:59:50.391866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:52.145615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=34 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:40.614331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef6cb3-3f04-48cd-8ecf-1cb33c320613 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:00:40.614858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef6cb3-3f04-48cd-8ecf-1cb33c320613 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:00:40.615038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef6cb3-3f04-48cd-8ecf-1cb33c320613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:00:40.635663 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-89ef6cb3-3f04-48cd-8ecf-1cb33c320613 None None] MFA Rules not processed for user `e846d960fa87451db8ae291e22b3cb7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:00:40.636955 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-89ef6cb3-3f04-48cd-8ecf-1cb33c320613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:00:40.644065 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1166/2322] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:00:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:00:50.629094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:07.652724 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06c11-e817-4dfd-b3be-17109c2d4012 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:07.664162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06c11-e817-4dfd-b3be-17109c2d4012 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:07.669774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772653-fdb0-4d42-aa50-c692fda6787b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:07.670379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772653-fdb0-4d42-aa50-c692fda6787b service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:07.670657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772653-fdb0-4d42-aa50-c692fda6787b service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:07.670951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772653-fdb0-4d42-aa50-c692fda6787b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:07.673237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-23772653-fdb0-4d42-aa50-c692fda6787b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:07.683561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23772653-fdb0-4d42-aa50-c692fda6787b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:07.685098 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23772653-fdb0-4d42-aa50-c692fda6787b service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:07.694708 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1157/2323] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:12.048230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef6cb3-3f04-48cd-8ecf-1cb33c320613 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:12.057990 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef6cb3-3f04-48cd-8ecf-1cb33c320613 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:12.061820 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0b91e-8754-4aa5-97d1-a81fc1b8143c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:12.062443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0b91e-8754-4aa5-97d1-a81fc1b8143c service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:12.062724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0b91e-8754-4aa5-97d1-a81fc1b8143c service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:12.063006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0b91e-8754-4aa5-97d1-a81fc1b8143c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:12.064851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f1f0b91e-8754-4aa5-97d1-a81fc1b8143c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:12.133747 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0b91e-8754-4aa5-97d1-a81fc1b8143c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:12.135561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0b91e-8754-4aa5-97d1-a81fc1b8143c service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:12.146739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1167/2324] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:15.437707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772653-fdb0-4d42-aa50-c692fda6787b service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:15.439164 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-23772653-fdb0-4d42-aa50-c692fda6787b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:15.455225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772653-fdb0-4d42-aa50-c692fda6787b service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:15.460756 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effb2b0-a192-46c9-b64f-c8d3ba9cd916 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:15.461680 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effb2b0-a192-46c9-b64f-c8d3ba9cd916 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:15.462211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effb2b0-a192-46c9-b64f-c8d3ba9cd916 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:15.462714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effb2b0-a192-46c9-b64f-c8d3ba9cd916 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:15.464780 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2effb2b0-a192-46c9-b64f-c8d3ba9cd916 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:15.481088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effb2b0-a192-46c9-b64f-c8d3ba9cd916 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:15.483021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effb2b0-a192-46c9-b64f-c8d3ba9cd916 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:15.494767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1158/2325] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:15.508365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0b91e-8754-4aa5-97d1-a81fc1b8143c service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:15.509847 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f1f0b91e-8754-4aa5-97d1-a81fc1b8143c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:15.522622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0b91e-8754-4aa5-97d1-a81fc1b8143c service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:15.527243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87c6ba-2ac7-4fc4-8b41-a427e9191c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:15.527866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87c6ba-2ac7-4fc4-8b41-a427e9191c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:15.528425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87c6ba-2ac7-4fc4-8b41-a427e9191c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:15.528841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87c6ba-2ac7-4fc4-8b41-a427e9191c0b admin admin] PATH_INFO: `/v3/users/7ed1be3a1ae249828caa8b88fd606557` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:15.530036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87c6ba-2ac7-4fc4-8b41-a427e9191c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed1be3a1ae249828caa8b88fd606557)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:15.532599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87c6ba-2ac7-4fc4-8b41-a427e9191c0b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:15.578854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f87c6ba-2ac7-4fc4-8b41-a427e9191c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed1be3a1ae249828caa8b88fd606557'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:15.579539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f87c6ba-2ac7-4fc4-8b41-a427e9191c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed1be3a1ae249828caa8b88fd606557'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:15.586919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f87c6ba-2ac7-4fc4-8b41-a427e9191c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed1be3a1ae249828caa8b88fd606557'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:15.599984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f87c6ba-2ac7-4fc4-8b41-a427e9191c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed1be3a1ae249828caa8b88fd606557'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:15.606762 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f87c6ba-2ac7-4fc4-8b41-a427e9191c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed1be3a1ae249828caa8b88fd606557'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:15.614536 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1168/2326] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:01:15 2022] DELETE /identity/v3/users/7ed1be3a1ae249828caa8b88fd606557 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:01:15.788097 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effb2b0-a192-46c9-b64f-c8d3ba9cd916 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:15.802945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effb2b0-a192-46c9-b64f-c8d3ba9cd916 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:15.862332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4144b-138f-443b-a793-c6b0baa1d7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:15.862974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4144b-138f-443b-a793-c6b0baa1d7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:15.863253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4144b-138f-443b-a793-c6b0baa1d7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:15.863520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4144b-138f-443b-a793-c6b0baa1d7f5 admin admin] PATH_INFO: `/v3/projects/a4c886ec53c84d5d9542ab7dbbdfcf8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:15.864712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4144b-138f-443b-a793-c6b0baa1d7f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c886ec53c84d5d9542ab7dbbdfcf8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:15.866646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4144b-138f-443b-a793-c6b0baa1d7f5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:15.912525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-07a4144b-138f-443b-a793-c6b0baa1d7f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'request_id': 'req-07a4144b-138f-443b-a793-c6b0baa1d7f5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:15.918008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-07a4144b-138f-443b-a793-c6b0baa1d7f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'request_id': 'req-07a4144b-138f-443b-a793-c6b0baa1d7f5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:15.923971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-07a4144b-138f-443b-a793-c6b0baa1d7f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'request_id': 'req-07a4144b-138f-443b-a793-c6b0baa1d7f5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:15.936316 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-07a4144b-138f-443b-a793-c6b0baa1d7f5 admin admin] The token cache is being invalidate because project a4c886ec53c84d5d9542ab7dbbdfcf8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:01:15.936606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-07a4144b-138f-443b-a793-c6b0baa1d7f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:15.937231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-07a4144b-138f-443b-a793-c6b0baa1d7f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:15.938735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1159/2327] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:01:15 2022] DELETE /identity/v3/projects/a4c886ec53c84d5d9542ab7dbbdfcf8b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:01:15.943780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff17a2b-3fc2-4e47-80b3-5f22237b0a15 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:15.944068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff17a2b-3fc2-4e47-80b3-5f22237b0a15 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:15.944387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff17a2b-3fc2-4e47-80b3-5f22237b0a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:15.964495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bff17a2b-3fc2-4e47-80b3-5f22237b0a15 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:15.965692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bff17a2b-3fc2-4e47-80b3-5f22237b0a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:16.031230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1169/2328] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:16.039438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24da58-17cd-4133-b6ca-c1fb5de095c4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.039874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24da58-17cd-4133-b6ca-c1fb5de095c4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.040046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24da58-17cd-4133-b6ca-c1fb5de095c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.059570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0e24da58-17cd-4133-b6ca-c1fb5de095c4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:16.061022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0e24da58-17cd-4133-b6ca-c1fb5de095c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:16.072072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1160/2329] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:16.076453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff17a2b-3fc2-4e47-80b3-5f22237b0a15 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:16.088738 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff17a2b-3fc2-4e47-80b3-5f22237b0a15 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:16.093961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105d1ef-f742-4322-992f-b5cb756175a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:16.095075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105d1ef-f742-4322-992f-b5cb756175a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.095349 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105d1ef-f742-4322-992f-b5cb756175a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.095765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105d1ef-f742-4322-992f-b5cb756175a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.096669 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105d1ef-f742-4322-992f-b5cb756175a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:01:16.097147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105d1ef-f742-4322-992f-b5cb756175a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:16.098913 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105d1ef-f742-4322-992f-b5cb756175a9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:16.100868 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:16.114730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1170/2330] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:01:16.118987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24da58-17cd-4133-b6ca-c1fb5de095c4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:16.128898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24da58-17cd-4133-b6ca-c1fb5de095c4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:16.133665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e157af-a8c1-4eb2-98f0-7f734b7a5ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:16.134283 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e157af-a8c1-4eb2-98f0-7f734b7a5ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.134570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e157af-a8c1-4eb2-98f0-7f734b7a5ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.134850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e157af-a8c1-4eb2-98f0-7f734b7a5ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.135525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e157af-a8c1-4eb2-98f0-7f734b7a5ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:16.137466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e157af-a8c1-4eb2-98f0-7f734b7a5ebb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:16.167314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1161/2331] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:01:16 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:01:16.171628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105d1ef-f742-4322-992f-b5cb756175a9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:16.182433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105d1ef-f742-4322-992f-b5cb756175a9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:16.243383 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f30729-69be-4bcd-b437-a1a2d376c2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:16.244189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f30729-69be-4bcd-b437-a1a2d376c2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.244583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f30729-69be-4bcd-b437-a1a2d376c2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.245098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f30729-69be-4bcd-b437-a1a2d376c2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.245877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f30729-69be-4bcd-b437-a1a2d376c2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:16.247904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f30729-69be-4bcd-b437-a1a2d376c2f0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:16.270589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1171/2332] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:01:16 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:01:16.274983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e157af-a8c1-4eb2-98f0-7f734b7a5ebb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:16.285679 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e157af-a8c1-4eb2-98f0-7f734b7a5ebb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:16.290930 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c44022-8ec8-408e-9478-30adab0146fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:16.291541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c44022-8ec8-408e-9478-30adab0146fd admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.291821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c44022-8ec8-408e-9478-30adab0146fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.292325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c44022-8ec8-408e-9478-30adab0146fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.293024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c44022-8ec8-408e-9478-30adab0146fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:16.294591 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c44022-8ec8-408e-9478-30adab0146fd admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:16.307831 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1162/2333] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:01:16.309303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f30729-69be-4bcd-b437-a1a2d376c2f0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:16.323658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f30729-69be-4bcd-b437-a1a2d376c2f0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:16.329360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b6a3c-ccd0-4134-8a9f-4200e143492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:16.330057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b6a3c-ccd0-4134-8a9f-4200e143492b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.330373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b6a3c-ccd0-4134-8a9f-4200e143492b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.330636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b6a3c-ccd0-4134-8a9f-4200e143492b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.331387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b6a3c-ccd0-4134-8a9f-4200e143492b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:16.333324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b6a3c-ccd0-4134-8a9f-4200e143492b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:16.345281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1172/2334] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:01:16.349668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c44022-8ec8-408e-9478-30adab0146fd admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:16.359912 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c44022-8ec8-408e-9478-30adab0146fd admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:16.364486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e833-533b-4942-86c8-1f73bd94cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:16.365143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e833-533b-4942-86c8-1f73bd94cf53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.365449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e833-533b-4942-86c8-1f73bd94cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.365732 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e833-533b-4942-86c8-1f73bd94cf53 admin admin] PATH_INFO: `/v3/projects/73d5cc819dc34a1cad78795e7327f084/users/bed88ecbc18f4c81b855e2237dbef3e3/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.380896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353e833-533b-4942-86c8-1f73bd94cf53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d5cc819dc34a1cad78795e7327f084, user_id=bed88ecbc18f4c81b855e2237dbef3e3, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:16.383648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353e833-533b-4942-86c8-1f73bd94cf53 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:16.393530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:16.398912 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1163/2335] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:01:16 2022] PUT /identity/v3/projects/73d5cc819dc34a1cad78795e7327f084/users/bed88ecbc18f4c81b855e2237dbef3e3/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:01:16.410390 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907cda0-2796-46fe-beed-8d2e0ddab910 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.410762 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907cda0-2796-46fe-beed-8d2e0ddab910 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.411122 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907cda0-2796-46fe-beed-8d2e0ddab910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.441647 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0907cda0-2796-46fe-beed-8d2e0ddab910 None None] MFA Rules not processed for user `bed88ecbc18f4c81b855e2237dbef3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:16.443520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0907cda0-2796-46fe-beed-8d2e0ddab910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:16.511244 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1173/2336] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:01:16 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:16.515953 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e833-533b-4942-86c8-1f73bd94cf53 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:16.581803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e833-533b-4942-86c8-1f73bd94cf53 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:16.586788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb09d2d-679d-444c-bc15-a3868b613ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:16.587434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb09d2d-679d-444c-bc15-a3868b613ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.587708 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb09d2d-679d-444c-bc15-a3868b613ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.587987 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb09d2d-679d-444c-bc15-a3868b613ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.588695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb09d2d-679d-444c-bc15-a3868b613ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:16.590616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb09d2d-679d-444c-bc15-a3868b613ae6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:16.621389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1164/2337] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:01:16 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:01:16.626448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907cda0-2796-46fe-beed-8d2e0ddab910 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:16.639459 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907cda0-2796-46fe-beed-8d2e0ddab910 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:16.697813 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57819c-7537-4c90-9f08-f236d24b102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:16.698437 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57819c-7537-4c90-9f08-f236d24b102a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.698724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57819c-7537-4c90-9f08-f236d24b102a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.699007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57819c-7537-4c90-9f08-f236d24b102a admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.699678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57819c-7537-4c90-9f08-f236d24b102a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:16.701641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57819c-7537-4c90-9f08-f236d24b102a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:16.710973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:16.724992 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1174/2338] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:01:16 2022] POST /identity/v3/users => generated 309 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:01:16.729218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb09d2d-679d-444c-bc15-a3868b613ae6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:16.740813 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb09d2d-679d-444c-bc15-a3868b613ae6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:16.745574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b968d68-c586-4e5d-9ebf-9ee849f02251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:16.746194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b968d68-c586-4e5d-9ebf-9ee849f02251 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.746477 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b968d68-c586-4e5d-9ebf-9ee849f02251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.746757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b968d68-c586-4e5d-9ebf-9ee849f02251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.747458 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b968d68-c586-4e5d-9ebf-9ee849f02251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:16.749087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b968d68-c586-4e5d-9ebf-9ee849f02251 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:16.760631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1165/2339] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:01:16.765284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57819c-7537-4c90-9f08-f236d24b102a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:16.774953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57819c-7537-4c90-9f08-f236d24b102a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:16.779602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf76a4-bdec-48d8-a136-0ffb9917e1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:16.780311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf76a4-bdec-48d8-a136-0ffb9917e1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.780599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf76a4-bdec-48d8-a136-0ffb9917e1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.780878 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf76a4-bdec-48d8-a136-0ffb9917e1f7 admin admin] PATH_INFO: `/v3/projects/4b84d301eba545f9a9fc10e90cae1ab9/users/89ace81894764bd59ff73818cfffe19e/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.795550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf76a4-bdec-48d8-a136-0ffb9917e1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b84d301eba545f9a9fc10e90cae1ab9, user_id=89ace81894764bd59ff73818cfffe19e, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:16.798827 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf76a4-bdec-48d8-a136-0ffb9917e1f7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:16.817946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1175/2340] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:01:16 2022] PUT /identity/v3/projects/4b84d301eba545f9a9fc10e90cae1ab9/users/89ace81894764bd59ff73818cfffe19e/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:01:16.822134 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b968d68-c586-4e5d-9ebf-9ee849f02251 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:16.840928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b968d68-c586-4e5d-9ebf-9ee849f02251 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:16.912268 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ed2d5-3d2e-40f7-a723-96be325bf012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:16.913033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ed2d5-3d2e-40f7-a723-96be325bf012 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.913529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ed2d5-3d2e-40f7-a723-96be325bf012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.913978 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ed2d5-3d2e-40f7-a723-96be325bf012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.914819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ed2d5-3d2e-40f7-a723-96be325bf012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:16.916694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ed2d5-3d2e-40f7-a723-96be325bf012 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:16.932659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1166/2341] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:01:16.933575 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf76a4-bdec-48d8-a136-0ffb9917e1f7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:16.947590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf76a4-bdec-48d8-a136-0ffb9917e1f7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:16.958785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ad112-befa-4e1a-96df-ac038979b4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:16.959524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ad112-befa-4e1a-96df-ac038979b4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.959810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ad112-befa-4e1a-96df-ac038979b4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.960090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ad112-befa-4e1a-96df-ac038979b4e3 admin admin] PATH_INFO: `/v3/projects/4b84d301eba545f9a9fc10e90cae1ab9/users/89ace81894764bd59ff73818cfffe19e/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:16.962403 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ad112-befa-4e1a-96df-ac038979b4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b84d301eba545f9a9fc10e90cae1ab9, user_id=89ace81894764bd59ff73818cfffe19e, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:16.965244 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ad112-befa-4e1a-96df-ac038979b4e3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:16.977866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1176/2342] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:01:16 2022] PUT /identity/v3/projects/4b84d301eba545f9a9fc10e90cae1ab9/users/89ace81894764bd59ff73818cfffe19e/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:01:16.990236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d89972-0f22-4bcb-bf34-4dd62cd449df None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:16.990618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d89972-0f22-4bcb-bf34-4dd62cd449df None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:16.990973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d89972-0f22-4bcb-bf34-4dd62cd449df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:17.022099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-47d89972-0f22-4bcb-bf34-4dd62cd449df None None] MFA Rules not processed for user `89ace81894764bd59ff73818cfffe19e`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:17.024207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-47d89972-0f22-4bcb-bf34-4dd62cd449df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:17.113168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:17.127461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1167/2343] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:01:16 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:17.140714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ad112-befa-4e1a-96df-ac038979b4e3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:17.142535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2f6ad112-befa-4e1a-96df-ac038979b4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:17.205010 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ad112-befa-4e1a-96df-ac038979b4e3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:17.209055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373d85f-61d7-4a19-867f-25a475ad993a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:17.209619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373d85f-61d7-4a19-867f-25a475ad993a service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:17.209902 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373d85f-61d7-4a19-867f-25a475ad993a service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:17.210177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373d85f-61d7-4a19-867f-25a475ad993a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:17.220176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373d85f-61d7-4a19-867f-25a475ad993a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:17.221621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373d85f-61d7-4a19-867f-25a475ad993a service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:17.231226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1177/2344] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:17 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:17.399397 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d89972-0f22-4bcb-bf34-4dd62cd449df None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:17.478939 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d89972-0f22-4bcb-bf34-4dd62cd449df None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:17.483710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:17.485302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:17.485693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:17.486070 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] PATH_INFO: `/v3/users/bed88ecbc18f4c81b855e2237dbef3e3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:17.487324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed88ecbc18f4c81b855e2237dbef3e3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:17.489310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:17.548722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed88ecbc18f4c81b855e2237dbef3e3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:17.549401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed88ecbc18f4c81b855e2237dbef3e3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:17.567944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed88ecbc18f4c81b855e2237dbef3e3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:17.576342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed88ecbc18f4c81b855e2237dbef3e3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:17.584030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed88ecbc18f4c81b855e2237dbef3e3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:17.592322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1168/2345] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:01:17 2022] DELETE /identity/v3/users/bed88ecbc18f4c81b855e2237dbef3e3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:01:17.599199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a38a-50fe-4757-bec1-d0aae845e863 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:17.600740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a38a-50fe-4757-bec1-d0aae845e863 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:17.601343 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a38a-50fe-4757-bec1-d0aae845e863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:17.625438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7151a38a-50fe-4757-bec1-d0aae845e863 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:17.626664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7151a38a-50fe-4757-bec1-d0aae845e863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:17.688871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1178/2346] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:17.698575 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:17.700142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:17.762914 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b976fc-48ed-4b0e-b34a-9cb2f67a8e22 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:17.766713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397ddf0-b09e-4ccf-bc7a-bfb33dbbbdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:17.767338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397ddf0-b09e-4ccf-bc7a-bfb33dbbbdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:17.767618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397ddf0-b09e-4ccf-bc7a-bfb33dbbbdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:17.767895 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397ddf0-b09e-4ccf-bc7a-bfb33dbbbdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:17.777564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397ddf0-b09e-4ccf-bc7a-bfb33dbbbdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:17.779041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397ddf0-b09e-4ccf-bc7a-bfb33dbbbdf9 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:17.789500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1169/2347] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:18.102766 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151a38a-50fe-4757-bec1-d0aae845e863 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:18.104299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7151a38a-50fe-4757-bec1-d0aae845e863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:18.116904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151a38a-50fe-4757-bec1-d0aae845e863 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:18.122227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:18.123003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:18.123405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:18.123789 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] PATH_INFO: `/v3/projects/73d5cc819dc34a1cad78795e7327f084` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:18.125160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d5cc819dc34a1cad78795e7327f084)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:18.127224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:18.185791 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d5cc819dc34a1cad78795e7327f084', 'request_id': 'req-e22d0714-298a-4574-b447-dbb0655bc185'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.187713 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:18.192844 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d5cc819dc34a1cad78795e7327f084', 'request_id': 'req-e22d0714-298a-4574-b447-dbb0655bc185'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.201760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d5cc819dc34a1cad78795e7327f084', 'request_id': 'req-e22d0714-298a-4574-b447-dbb0655bc185'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.213644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] The token cache is being invalidate because project 73d5cc819dc34a1cad78795e7327f084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:01:18.215419 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.215419 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.216886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1179/2348] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:01:18 2022] DELETE /identity/v3/projects/73d5cc819dc34a1cad78795e7327f084 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:01:18.221553 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397ddf0-b09e-4ccf-bc7a-bfb33dbbbdf9 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:18.232174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397ddf0-b09e-4ccf-bc7a-bfb33dbbbdf9 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:18.245515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:18.303739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d10c0-d171-4e99-9d7e-6990ec2fa4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:18.304614 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d10c0-d171-4e99-9d7e-6990ec2fa4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:18.304963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d10c0-d171-4e99-9d7e-6990ec2fa4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:18.305304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d10c0-d171-4e99-9d7e-6990ec2fa4c5 admin admin] PATH_INFO: `/v3/users/89ace81894764bd59ff73818cfffe19e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:18.306517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d10c0-d171-4e99-9d7e-6990ec2fa4c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ace81894764bd59ff73818cfffe19e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:18.308538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d10c0-d171-4e99-9d7e-6990ec2fa4c5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:18.358742 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-927d10c0-d171-4e99-9d7e-6990ec2fa4c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ace81894764bd59ff73818cfffe19e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.359458 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-927d10c0-d171-4e99-9d7e-6990ec2fa4c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ace81894764bd59ff73818cfffe19e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.371944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-927d10c0-d171-4e99-9d7e-6990ec2fa4c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ace81894764bd59ff73818cfffe19e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.380909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-927d10c0-d171-4e99-9d7e-6990ec2fa4c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ace81894764bd59ff73818cfffe19e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.388399 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-927d10c0-d171-4e99-9d7e-6990ec2fa4c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ace81894764bd59ff73818cfffe19e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.395294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1170/2349] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:01:18 2022] DELETE /identity/v3/users/89ace81894764bd59ff73818cfffe19e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:01:18.723242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:18.724882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:18.738834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0714-298a-4574-b447-dbb0655bc185 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:18.802986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1969c5f-c6c7-4c2b-81e6-13419cecd317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:18.803648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1969c5f-c6c7-4c2b-81e6-13419cecd317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:18.803935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1969c5f-c6c7-4c2b-81e6-13419cecd317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:18.804682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1969c5f-c6c7-4c2b-81e6-13419cecd317 admin admin] PATH_INFO: `/v3/projects/4b84d301eba545f9a9fc10e90cae1ab9` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:18.805524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1969c5f-c6c7-4c2b-81e6-13419cecd317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b84d301eba545f9a9fc10e90cae1ab9)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:18.807455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1969c5f-c6c7-4c2b-81e6-13419cecd317 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:18.858731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1969c5f-c6c7-4c2b-81e6-13419cecd317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b84d301eba545f9a9fc10e90cae1ab9', 'request_id': 'req-b1969c5f-c6c7-4c2b-81e6-13419cecd317'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.864806 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1969c5f-c6c7-4c2b-81e6-13419cecd317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b84d301eba545f9a9fc10e90cae1ab9', 'request_id': 'req-b1969c5f-c6c7-4c2b-81e6-13419cecd317'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.873927 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1969c5f-c6c7-4c2b-81e6-13419cecd317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b84d301eba545f9a9fc10e90cae1ab9', 'request_id': 'req-b1969c5f-c6c7-4c2b-81e6-13419cecd317'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.885784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1969c5f-c6c7-4c2b-81e6-13419cecd317 admin admin] The token cache is being invalidate because project 4b84d301eba545f9a9fc10e90cae1ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:01:18.886077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1969c5f-c6c7-4c2b-81e6-13419cecd317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.886739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1969c5f-c6c7-4c2b-81e6-13419cecd317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:01:18.888299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1180/2350] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:01:18 2022] DELETE /identity/v3/projects/4b84d301eba545f9a9fc10e90cae1ab9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:01:18.893160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731d920-138f-407e-844e-ad14d5d19552 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:18.893625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731d920-138f-407e-844e-ad14d5d19552 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:18.893741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731d920-138f-407e-844e-ad14d5d19552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:18.919210 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5731d920-138f-407e-844e-ad14d5d19552 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:18.920547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5731d920-138f-407e-844e-ad14d5d19552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:18.981656 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1171/2351] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:18.990015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd756a8a-2eb3-4a09-a5ea-6224a3b02141 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:18.990313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd756a8a-2eb3-4a09-a5ea-6224a3b02141 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:18.990619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd756a8a-2eb3-4a09-a5ea-6224a3b02141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.011194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cd756a8a-2eb3-4a09-a5ea-6224a3b02141 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:19.012442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cd756a8a-2eb3-4a09-a5ea-6224a3b02141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:19.021033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1181/2352] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:01:19.025174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731d920-138f-407e-844e-ad14d5d19552 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:19.035011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731d920-138f-407e-844e-ad14d5d19552 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:19.039673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659e194-0feb-41c3-91ab-3c34358d7444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:19.040346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659e194-0feb-41c3-91ab-3c34358d7444 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.040764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659e194-0feb-41c3-91ab-3c34358d7444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.040942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659e194-0feb-41c3-91ab-3c34358d7444 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.041870 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659e194-0feb-41c3-91ab-3c34358d7444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:01:19.042244 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659e194-0feb-41c3-91ab-3c34358d7444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:19.044228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659e194-0feb-41c3-91ab-3c34358d7444 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:19.057178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1172/2353] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:01:19.061612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd756a8a-2eb3-4a09-a5ea-6224a3b02141 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:19.071669 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd756a8a-2eb3-4a09-a5ea-6224a3b02141 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:19.077781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59e775-732c-40e4-b570-c0cab147d1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:19.077781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e775-732c-40e4-b570-c0cab147d1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.078062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e775-732c-40e4-b570-c0cab147d1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.078367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e775-732c-40e4-b570-c0cab147d1f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.079186 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59e775-732c-40e4-b570-c0cab147d1f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:19.081542 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59e775-732c-40e4-b570-c0cab147d1f5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:19.111537 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1182/2354] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:01:19 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:01:19.115665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659e194-0feb-41c3-91ab-3c34358d7444 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:19.126226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659e194-0feb-41c3-91ab-3c34358d7444 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:19.147618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:19.192476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249879b-ab88-4736-a00c-1ac766865984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:19.193103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249879b-ab88-4736-a00c-1ac766865984 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.193394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249879b-ab88-4736-a00c-1ac766865984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.193676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249879b-ab88-4736-a00c-1ac766865984 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.194522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249879b-ab88-4736-a00c-1ac766865984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:19.196485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249879b-ab88-4736-a00c-1ac766865984 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:19.224052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1173/2355] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:01:19 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:01:19.225263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59e775-732c-40e4-b570-c0cab147d1f5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:19.236530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59e775-732c-40e4-b570-c0cab147d1f5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:19.241754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f995443-f862-4898-a7d3-13ec47086eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:19.242491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f995443-f862-4898-a7d3-13ec47086eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.242820 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f995443-f862-4898-a7d3-13ec47086eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.243458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f995443-f862-4898-a7d3-13ec47086eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.244235 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f995443-f862-4898-a7d3-13ec47086eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:19.246233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f995443-f862-4898-a7d3-13ec47086eb2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:19.260166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1183/2356] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:01:19.262734 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249879b-ab88-4736-a00c-1ac766865984 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:19.272855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249879b-ab88-4736-a00c-1ac766865984 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:19.277625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612ddb6-9f36-4fa6-9f0d-908337fad7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:19.278476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612ddb6-9f36-4fa6-9f0d-908337fad7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.278597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612ddb6-9f36-4fa6-9f0d-908337fad7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.278801 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612ddb6-9f36-4fa6-9f0d-908337fad7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.279673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612ddb6-9f36-4fa6-9f0d-908337fad7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:19.281158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612ddb6-9f36-4fa6-9f0d-908337fad7ad admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:19.293144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1174/2357] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:01:19.298298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f995443-f862-4898-a7d3-13ec47086eb2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:19.308726 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f995443-f862-4898-a7d3-13ec47086eb2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:19.314025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3914f-e72e-4fea-bbba-3db03db59515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:19.314695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3914f-e72e-4fea-bbba-3db03db59515 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.314975 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3914f-e72e-4fea-bbba-3db03db59515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.315250 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3914f-e72e-4fea-bbba-3db03db59515 admin admin] PATH_INFO: `/v3/projects/4d6e21b482bf4c17ad5eff86bbcc7677/users/c085d3f9ba9a46848db9882fa360bc77/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.330492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3914f-e72e-4fea-bbba-3db03db59515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6e21b482bf4c17ad5eff86bbcc7677, user_id=c085d3f9ba9a46848db9882fa360bc77, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:19.333462 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3914f-e72e-4fea-bbba-3db03db59515 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:19.348920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1184/2358] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:01:19 2022] PUT /identity/v3/projects/4d6e21b482bf4c17ad5eff86bbcc7677/users/c085d3f9ba9a46848db9882fa360bc77/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:01:19.361644 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91dc5a-a29b-460f-833d-302da752c047 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.361940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91dc5a-a29b-460f-833d-302da752c047 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.362223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91dc5a-a29b-460f-833d-302da752c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.392758 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6b91dc5a-a29b-460f-833d-302da752c047 None None] MFA Rules not processed for user `c085d3f9ba9a46848db9882fa360bc77`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:19.393989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6b91dc5a-a29b-460f-833d-302da752c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:19.468271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1175/2359] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:01:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:01:19.469118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3914f-e72e-4fea-bbba-3db03db59515 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:19.479247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:19.542674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3914f-e72e-4fea-bbba-3db03db59515 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:19.547722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2770ad7-5f94-4ccc-81e4-9f041f67f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:19.548372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2770ad7-5f94-4ccc-81e4-9f041f67f2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.548662 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2770ad7-5f94-4ccc-81e4-9f041f67f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.548943 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2770ad7-5f94-4ccc-81e4-9f041f67f2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.550188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2770ad7-5f94-4ccc-81e4-9f041f67f2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:19.551538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2770ad7-5f94-4ccc-81e4-9f041f67f2c8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:19.583680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1185/2360] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:01:19 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:01:19.587819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91dc5a-a29b-460f-833d-302da752c047 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:19.599023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91dc5a-a29b-460f-833d-302da752c047 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:19.661197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60a80e-7211-47e3-bc64-931139eca0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:19.661921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60a80e-7211-47e3-bc64-931139eca0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.662207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60a80e-7211-47e3-bc64-931139eca0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.663073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60a80e-7211-47e3-bc64-931139eca0b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.663829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60a80e-7211-47e3-bc64-931139eca0b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:19.668791 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60a80e-7211-47e3-bc64-931139eca0b7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:19.701102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1176/2361] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:01:19 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:01:19.706069 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2770ad7-5f94-4ccc-81e4-9f041f67f2c8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:19.717546 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2770ad7-5f94-4ccc-81e4-9f041f67f2c8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:19.723161 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207feac-184d-41de-a48d-9a16672d091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:19.723831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207feac-184d-41de-a48d-9a16672d091b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.724437 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207feac-184d-41de-a48d-9a16672d091b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.724538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207feac-184d-41de-a48d-9a16672d091b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.725911 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207feac-184d-41de-a48d-9a16672d091b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:19.727432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207feac-184d-41de-a48d-9a16672d091b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:19.745196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1186/2362] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:01:19.747008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60a80e-7211-47e3-bc64-931139eca0b7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:19.760906 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60a80e-7211-47e3-bc64-931139eca0b7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:19.766890 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a9725-9956-4134-9fcf-5316b369b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:19.768091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a9725-9956-4134-9fcf-5316b369b504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.768625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a9725-9956-4134-9fcf-5316b369b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.769238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a9725-9956-4134-9fcf-5316b369b504 admin admin] PATH_INFO: `/v3/projects/0859a4bb2efd454eb541a2c805693c2b/users/ae4b217cd4594bf8b984c02ad056e5e5/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.789043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a9725-9956-4134-9fcf-5316b369b504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0859a4bb2efd454eb541a2c805693c2b, user_id=ae4b217cd4594bf8b984c02ad056e5e5, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:19.792395 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a9725-9956-4134-9fcf-5316b369b504 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:19.807952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:19.818540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1177/2363] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:01:19 2022] PUT /identity/v3/projects/0859a4bb2efd454eb541a2c805693c2b/users/ae4b217cd4594bf8b984c02ad056e5e5/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:01:19.823293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207feac-184d-41de-a48d-9a16672d091b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:19.838265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207feac-184d-41de-a48d-9a16672d091b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:19.909524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812cabd-b797-4adc-a4bc-da7d21725c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:19.910263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812cabd-b797-4adc-a4bc-da7d21725c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.910552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812cabd-b797-4adc-a4bc-da7d21725c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.910828 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812cabd-b797-4adc-a4bc-da7d21725c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.911532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812cabd-b797-4adc-a4bc-da7d21725c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:19.913194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812cabd-b797-4adc-a4bc-da7d21725c10 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:19.932359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1187/2364] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:01:19.936852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a9725-9956-4134-9fcf-5316b369b504 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:19.948633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a9725-9956-4134-9fcf-5316b369b504 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:19.954078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b94bc5-65a1-42eb-9ce9-383074a9e236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:19.954763 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b94bc5-65a1-42eb-9ce9-383074a9e236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.955043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b94bc5-65a1-42eb-9ce9-383074a9e236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.955314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b94bc5-65a1-42eb-9ce9-383074a9e236 admin admin] PATH_INFO: `/v3/projects/0859a4bb2efd454eb541a2c805693c2b/users/ae4b217cd4594bf8b984c02ad056e5e5/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:19.957595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b94bc5-65a1-42eb-9ce9-383074a9e236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0859a4bb2efd454eb541a2c805693c2b, user_id=ae4b217cd4594bf8b984c02ad056e5e5, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:19.960292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b94bc5-65a1-42eb-9ce9-383074a9e236 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:19.971510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1178/2365] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:01:19 2022] PUT /identity/v3/projects/0859a4bb2efd454eb541a2c805693c2b/users/ae4b217cd4594bf8b984c02ad056e5e5/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:01:19.982600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17646b-7c2b-4a28-afaa-142f72d63743 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:19.983375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17646b-7c2b-4a28-afaa-142f72d63743 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:19.983683 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17646b-7c2b-4a28-afaa-142f72d63743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:20.022239 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ad17646b-7c2b-4a28-afaa-142f72d63743 None None] MFA Rules not processed for user `ae4b217cd4594bf8b984c02ad056e5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:20.024378 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ad17646b-7c2b-4a28-afaa-142f72d63743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:20.101135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1188/2366] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:01:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:20.115137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b94bc5-65a1-42eb-9ce9-383074a9e236 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:20.117921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c2b94bc5-65a1-42eb-9ce9-383074a9e236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:20.222493 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b94bc5-65a1-42eb-9ce9-383074a9e236 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:20.227002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3c200-ae7a-4b63-9bb8-b3387739282f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:20.227434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3c200-ae7a-4b63-9bb8-b3387739282f service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:20.227796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3c200-ae7a-4b63-9bb8-b3387739282f service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:20.228162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3c200-ae7a-4b63-9bb8-b3387739282f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:20.239084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3c200-ae7a-4b63-9bb8-b3387739282f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:20.240589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3c200-ae7a-4b63-9bb8-b3387739282f service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:20.252453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1179/2367] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:20.344522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17646b-7c2b-4a28-afaa-142f72d63743 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:20.350110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:20.363358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17646b-7c2b-4a28-afaa-142f72d63743 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:20.367185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ffa11-e9ed-4319-9cff-729b9c241a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:20.368080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ffa11-e9ed-4319-9cff-729b9c241a16 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:20.368080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ffa11-e9ed-4319-9cff-729b9c241a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:20.368395 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ffa11-e9ed-4319-9cff-729b9c241a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:20.437453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ffa11-e9ed-4319-9cff-729b9c241a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:20.439749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ffa11-e9ed-4319-9cff-729b9c241a16 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:20.456247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1189/2368] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:20.657516 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bd718-5c7b-4801-9035-ca2149fa8e52 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:20.657810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bd718-5c7b-4801-9035-ca2149fa8e52 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:20.658093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bd718-5c7b-4801-9035-ca2149fa8e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:20.678839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d38bd718-5c7b-4801-9035-ca2149fa8e52 None None] MFA Rules not processed for user `f01062e92f974dc890897d19359e7e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:20.680142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d38bd718-5c7b-4801-9035-ca2149fa8e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:20.745428 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1180/2369] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:01:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:01:24.139802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c678a1-4de0-4342-b656-e6bcd8bfc331 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:24.140622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c678a1-4de0-4342-b656-e6bcd8bfc331 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:24.141411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c678a1-4de0-4342-b656-e6bcd8bfc331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:24.161313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d6c678a1-4de0-4342-b656-e6bcd8bfc331 None None] MFA Rules not processed for user `2b15c4ba64ca4097a4cdb653fdb94d78`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:24.162516 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d6c678a1-4de0-4342-b656-e6bcd8bfc331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:24.230116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1190/2370] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:01:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:30.737868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=57,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:34.216897 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=52 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:05.488729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bd718-5c7b-4801-9035-ca2149fa8e52 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:05.591812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bd718-5c7b-4801-9035-ca2149fa8e52 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:05.596781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:05.597414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:05.597688 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:05.597959 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] PATH_INFO: `/v3/users/c085d3f9ba9a46848db9882fa360bc77` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:05.599110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c085d3f9ba9a46848db9882fa360bc77)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:05.601165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:05.645860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c085d3f9ba9a46848db9882fa360bc77'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:05.646439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c085d3f9ba9a46848db9882fa360bc77'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:05.658251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c085d3f9ba9a46848db9882fa360bc77'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:05.666947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c085d3f9ba9a46848db9882fa360bc77'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:05.673868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c085d3f9ba9a46848db9882fa360bc77'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:05.680490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1181/2371] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:02:05 2022] DELETE /identity/v3/users/c085d3f9ba9a46848db9882fa360bc77 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:05.684977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260e345-c6c9-4731-a53c-ec3ed6c2d23b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:05.685474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260e345-c6c9-4731-a53c-ec3ed6c2d23b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:05.685590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260e345-c6c9-4731-a53c-ec3ed6c2d23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:05.735361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e260e345-c6c9-4731-a53c-ec3ed6c2d23b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:05.737241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e260e345-c6c9-4731-a53c-ec3ed6c2d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:05.793946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1191/2372] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:05.804194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:05.805659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:05.848381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:05.902823 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c19e5c-c3fa-4bee-9286-5b84f74940b0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:05.906341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf70e9-3bbc-42ed-8a73-43aac28c7b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:05.906955 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf70e9-3bbc-42ed-8a73-43aac28c7b08 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:05.907238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf70e9-3bbc-42ed-8a73-43aac28c7b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:05.907514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf70e9-3bbc-42ed-8a73-43aac28c7b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:05.917129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf70e9-3bbc-42ed-8a73-43aac28c7b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:05.918556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf70e9-3bbc-42ed-8a73-43aac28c7b08 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:05.927778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1182/2373] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:06.188871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260e345-c6c9-4731-a53c-ec3ed6c2d23b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:06.190847 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e260e345-c6c9-4731-a53c-ec3ed6c2d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:06.202815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260e345-c6c9-4731-a53c-ec3ed6c2d23b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:06.207631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:06.208309 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:06.208593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:06.208869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] PATH_INFO: `/v3/projects/4d6e21b482bf4c17ad5eff86bbcc7677` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:06.210218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6e21b482bf4c17ad5eff86bbcc7677)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:06.212154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:06.272725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6e21b482bf4c17ad5eff86bbcc7677', 'request_id': 'req-fe29449c-9f0a-4dee-b934-b190e68d1482'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.281900 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6e21b482bf4c17ad5eff86bbcc7677', 'request_id': 'req-fe29449c-9f0a-4dee-b934-b190e68d1482'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.292803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6e21b482bf4c17ad5eff86bbcc7677', 'request_id': 'req-fe29449c-9f0a-4dee-b934-b190e68d1482'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.305686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] The token cache is being invalidate because project 4d6e21b482bf4c17ad5eff86bbcc7677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:02:06.305980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.306649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.308197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1192/2374] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:02:06 2022] DELETE /identity/v3/projects/4d6e21b482bf4c17ad5eff86bbcc7677 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:06.312421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf70e9-3bbc-42ed-8a73-43aac28c7b08 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:06.322607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf70e9-3bbc-42ed-8a73-43aac28c7b08 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:06.382266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63989ca3-7296-4c2e-bda7-5c2db49bc0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:06.382940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63989ca3-7296-4c2e-bda7-5c2db49bc0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:06.383215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63989ca3-7296-4c2e-bda7-5c2db49bc0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:06.383492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63989ca3-7296-4c2e-bda7-5c2db49bc0f2 admin admin] PATH_INFO: `/v3/users/ae4b217cd4594bf8b984c02ad056e5e5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:06.384682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63989ca3-7296-4c2e-bda7-5c2db49bc0f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4b217cd4594bf8b984c02ad056e5e5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:06.386738 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63989ca3-7296-4c2e-bda7-5c2db49bc0f2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:06.431567 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-63989ca3-7296-4c2e-bda7-5c2db49bc0f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4b217cd4594bf8b984c02ad056e5e5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.432190 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-63989ca3-7296-4c2e-bda7-5c2db49bc0f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4b217cd4594bf8b984c02ad056e5e5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.444136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-63989ca3-7296-4c2e-bda7-5c2db49bc0f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4b217cd4594bf8b984c02ad056e5e5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.451645 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-63989ca3-7296-4c2e-bda7-5c2db49bc0f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4b217cd4594bf8b984c02ad056e5e5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.459405 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-63989ca3-7296-4c2e-bda7-5c2db49bc0f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4b217cd4594bf8b984c02ad056e5e5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.465286 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1183/2375] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:02:06 2022] DELETE /identity/v3/users/ae4b217cd4594bf8b984c02ad056e5e5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:02:06.740292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:06.741866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:06.757624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29449c-9f0a-4dee-b934-b190e68d1482 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:06.809843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:06.817413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48916e45-69b8-4289-8ec3-225c7b2c81b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:06.818081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48916e45-69b8-4289-8ec3-225c7b2c81b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:06.818576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48916e45-69b8-4289-8ec3-225c7b2c81b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:06.819036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48916e45-69b8-4289-8ec3-225c7b2c81b1 admin admin] PATH_INFO: `/v3/projects/0859a4bb2efd454eb541a2c805693c2b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:06.820712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48916e45-69b8-4289-8ec3-225c7b2c81b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0859a4bb2efd454eb541a2c805693c2b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:06.822902 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48916e45-69b8-4289-8ec3-225c7b2c81b1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:06.868073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-48916e45-69b8-4289-8ec3-225c7b2c81b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0859a4bb2efd454eb541a2c805693c2b', 'request_id': 'req-48916e45-69b8-4289-8ec3-225c7b2c81b1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.873523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-48916e45-69b8-4289-8ec3-225c7b2c81b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0859a4bb2efd454eb541a2c805693c2b', 'request_id': 'req-48916e45-69b8-4289-8ec3-225c7b2c81b1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.881628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-48916e45-69b8-4289-8ec3-225c7b2c81b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0859a4bb2efd454eb541a2c805693c2b', 'request_id': 'req-48916e45-69b8-4289-8ec3-225c7b2c81b1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.893101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-48916e45-69b8-4289-8ec3-225c7b2c81b1 admin admin] The token cache is being invalidate because project 0859a4bb2efd454eb541a2c805693c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:02:06.893382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-48916e45-69b8-4289-8ec3-225c7b2c81b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.894009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-48916e45-69b8-4289-8ec3-225c7b2c81b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:06.895505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1193/2376] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:02:06 2022] DELETE /identity/v3/projects/0859a4bb2efd454eb541a2c805693c2b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:06.901278 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60a444-f8fc-465b-b984-a2686fc84516 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:06.901755 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60a444-f8fc-465b-b984-a2686fc84516 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:06.901935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60a444-f8fc-465b-b984-a2686fc84516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:06.935019 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:06.952336 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2a60a444-f8fc-465b-b984-a2686fc84516 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:06.953481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2a60a444-f8fc-465b-b984-a2686fc84516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:07.010988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1184/2377] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:02:07.018782 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54306-9926-493a-9159-e2ec10e429e6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.019101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54306-9926-493a-9159-e2ec10e429e6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.019380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54306-9926-493a-9159-e2ec10e429e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.041627 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e2d54306-9926-493a-9159-e2ec10e429e6 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:07.042851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e2d54306-9926-493a-9159-e2ec10e429e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:07.057014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1194/2378] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:07.061377 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60a444-f8fc-465b-b984-a2686fc84516 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:07.071243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60a444-f8fc-465b-b984-a2686fc84516 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:07.075938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c1f3d-a434-48ad-bb08-ea762c6c2e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:07.076599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1f3d-a434-48ad-bb08-ea762c6c2e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.076885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1f3d-a434-48ad-bb08-ea762c6c2e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.077165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1f3d-a434-48ad-bb08-ea762c6c2e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.077862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c1f3d-a434-48ad-bb08-ea762c6c2e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:07.078172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c1f3d-a434-48ad-bb08-ea762c6c2e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:07.079842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c1f3d-a434-48ad-bb08-ea762c6c2e20 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:07.092032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1185/2379] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:07.097014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d54306-9926-493a-9159-e2ec10e429e6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:07.106236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d54306-9926-493a-9159-e2ec10e429e6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:07.110839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63d97-f175-44de-a8de-3b6091443e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:07.111439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63d97-f175-44de-a8de-3b6091443e8e admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.111792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63d97-f175-44de-a8de-3b6091443e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.112596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63d97-f175-44de-a8de-3b6091443e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.113248 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63d97-f175-44de-a8de-3b6091443e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:07.115137 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63d97-f175-44de-a8de-3b6091443e8e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:07.141688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1195/2380] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:02:07 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:07.146118 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c1f3d-a434-48ad-bb08-ea762c6c2e20 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:07.157124 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c1f3d-a434-48ad-bb08-ea762c6c2e20 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:07.216351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27336e0-241e-4290-b2d2-225d6655223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:07.216919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27336e0-241e-4290-b2d2-225d6655223b admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.217256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27336e0-241e-4290-b2d2-225d6655223b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.217533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27336e0-241e-4290-b2d2-225d6655223b admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.218199 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27336e0-241e-4290-b2d2-225d6655223b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:07.220142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27336e0-241e-4290-b2d2-225d6655223b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:07.242023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1186/2381] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:02:07 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:07.254986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63d97-f175-44de-a8de-3b6091443e8e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:07.265576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63d97-f175-44de-a8de-3b6091443e8e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:07.270098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67112327-9218-431c-8a81-edee92bfc801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:07.270698 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67112327-9218-431c-8a81-edee92bfc801 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.270973 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67112327-9218-431c-8a81-edee92bfc801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.271244 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67112327-9218-431c-8a81-edee92bfc801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.272094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67112327-9218-431c-8a81-edee92bfc801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:07.273758 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67112327-9218-431c-8a81-edee92bfc801 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:07.284298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1196/2382] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:02:07.288346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27336e0-241e-4290-b2d2-225d6655223b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:07.298717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27336e0-241e-4290-b2d2-225d6655223b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:07.303945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd10ab-934b-456e-8e8a-cc64dcdf9b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:07.304597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd10ab-934b-456e-8e8a-cc64dcdf9b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.304908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd10ab-934b-456e-8e8a-cc64dcdf9b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.305167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd10ab-934b-456e-8e8a-cc64dcdf9b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.305855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd10ab-934b-456e-8e8a-cc64dcdf9b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:07.307457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd10ab-934b-456e-8e8a-cc64dcdf9b3c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:07.320081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1187/2383] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:07.324919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67112327-9218-431c-8a81-edee92bfc801 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:07.336907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67112327-9218-431c-8a81-edee92bfc801 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:07.343817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc08d5-e07a-415d-8176-26a4b7086e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:07.344885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc08d5-e07a-415d-8176-26a4b7086e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.345238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc08d5-e07a-415d-8176-26a4b7086e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.345517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc08d5-e07a-415d-8176-26a4b7086e99 admin admin] PATH_INFO: `/v3/projects/5163b45bb1f54cb6b5ace0c85b5e7d8e/users/d984b89ba92f492aa6de1a79ed528b8a/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.364099 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc08d5-e07a-415d-8176-26a4b7086e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5163b45bb1f54cb6b5ace0c85b5e7d8e, user_id=d984b89ba92f492aa6de1a79ed528b8a, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:07.366810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc08d5-e07a-415d-8176-26a4b7086e99 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:07.380661 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1197/2384] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:07 2022] PUT /identity/v3/projects/5163b45bb1f54cb6b5ace0c85b5e7d8e/users/d984b89ba92f492aa6de1a79ed528b8a/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:07.390977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bcda1-f919-45f9-adca-5bf460b70a0a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.391266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bcda1-f919-45f9-adca-5bf460b70a0a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.391546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bcda1-f919-45f9-adca-5bf460b70a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.421134 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-807bcda1-f919-45f9-adca-5bf460b70a0a None None] MFA Rules not processed for user `d984b89ba92f492aa6de1a79ed528b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:07.422367 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-807bcda1-f919-45f9-adca-5bf460b70a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:07.483822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:07.496274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1188/2385] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:07.499072 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc08d5-e07a-415d-8176-26a4b7086e99 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:07.560724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc08d5-e07a-415d-8176-26a4b7086e99 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:07.565433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406d9bc-8557-4fcc-93a0-1664ded883b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:07.566051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406d9bc-8557-4fcc-93a0-1664ded883b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.566334 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406d9bc-8557-4fcc-93a0-1664ded883b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.566610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406d9bc-8557-4fcc-93a0-1664ded883b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.567270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406d9bc-8557-4fcc-93a0-1664ded883b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:07.569236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406d9bc-8557-4fcc-93a0-1664ded883b4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:07.597614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1198/2386] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:02:07 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:07.601928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bcda1-f919-45f9-adca-5bf460b70a0a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:07.612671 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bcda1-f919-45f9-adca-5bf460b70a0a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:07.669637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bf123-977a-448d-b6df-2cedc488b81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:07.670266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bf123-977a-448d-b6df-2cedc488b81a admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.670551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bf123-977a-448d-b6df-2cedc488b81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.670829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bf123-977a-448d-b6df-2cedc488b81a admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.671517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bf123-977a-448d-b6df-2cedc488b81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:07.673492 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bf123-977a-448d-b6df-2cedc488b81a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:07.697195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1189/2387] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:02:07 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:07.702339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406d9bc-8557-4fcc-93a0-1664ded883b4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:07.714054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406d9bc-8557-4fcc-93a0-1664ded883b4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:07.719646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6187f7-599f-441c-8201-0d798e60d282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:07.720325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6187f7-599f-441c-8201-0d798e60d282 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.720607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6187f7-599f-441c-8201-0d798e60d282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.721472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6187f7-599f-441c-8201-0d798e60d282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.722197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6187f7-599f-441c-8201-0d798e60d282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:07.723802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6187f7-599f-441c-8201-0d798e60d282 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:07.726280 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:07.741678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1199/2388] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:07.743803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bf123-977a-448d-b6df-2cedc488b81a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:07.754122 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bf123-977a-448d-b6df-2cedc488b81a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:07.759004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850c28e-a571-48bd-b149-ee9308e7a97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:07.759687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850c28e-a571-48bd-b149-ee9308e7a97e admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.759973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850c28e-a571-48bd-b149-ee9308e7a97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.760289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850c28e-a571-48bd-b149-ee9308e7a97e admin admin] PATH_INFO: `/v3/projects/999a3b14bc864064a894254ae1d9c397/users/98483f13e657499ebc0954896c5298f9/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.776487 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850c28e-a571-48bd-b149-ee9308e7a97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=999a3b14bc864064a894254ae1d9c397, user_id=98483f13e657499ebc0954896c5298f9, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:07.779160 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850c28e-a571-48bd-b149-ee9308e7a97e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:07.793561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1190/2389] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:07 2022] PUT /identity/v3/projects/999a3b14bc864064a894254ae1d9c397/users/98483f13e657499ebc0954896c5298f9/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:07.797606 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6187f7-599f-441c-8201-0d798e60d282 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:07.808772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6187f7-599f-441c-8201-0d798e60d282 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:07.866817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dc064-5074-484e-968c-222081a0d073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:07.867448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dc064-5074-484e-968c-222081a0d073 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.867734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dc064-5074-484e-968c-222081a0d073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.868013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dc064-5074-484e-968c-222081a0d073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.868741 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dc064-5074-484e-968c-222081a0d073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:07.870417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dc064-5074-484e-968c-222081a0d073 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:07.881313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1200/2390] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:07.885325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850c28e-a571-48bd-b149-ee9308e7a97e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:07.896218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850c28e-a571-48bd-b149-ee9308e7a97e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:07.905204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39763219-2acf-4b05-a6f2-2415ce4d884b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:07.905887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39763219-2acf-4b05-a6f2-2415ce4d884b admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.906177 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39763219-2acf-4b05-a6f2-2415ce4d884b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.906463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39763219-2acf-4b05-a6f2-2415ce4d884b admin admin] PATH_INFO: `/v3/projects/999a3b14bc864064a894254ae1d9c397/users/98483f13e657499ebc0954896c5298f9/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.908509 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39763219-2acf-4b05-a6f2-2415ce4d884b admin admin] RBAC: Authorizing `identity:create_grant(project_id=999a3b14bc864064a894254ae1d9c397, user_id=98483f13e657499ebc0954896c5298f9, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:07.911281 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39763219-2acf-4b05-a6f2-2415ce4d884b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:07.921707 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1191/2391] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:07 2022] PUT /identity/v3/projects/999a3b14bc864064a894254ae1d9c397/users/98483f13e657499ebc0954896c5298f9/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:07.933127 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68ebd1-f2ed-4ddd-86b4-784a16d8b946 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:07.933424 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68ebd1-f2ed-4ddd-86b4-784a16d8b946 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:07.933712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68ebd1-f2ed-4ddd-86b4-784a16d8b946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:07.962278 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-af68ebd1-f2ed-4ddd-86b4-784a16d8b946 None None] MFA Rules not processed for user `98483f13e657499ebc0954896c5298f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:07.963484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-af68ebd1-f2ed-4ddd-86b4-784a16d8b946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:08.030996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1201/2392] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:02:08.042384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39763219-2acf-4b05-a6f2-2415ce4d884b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:08.044114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-39763219-2acf-4b05-a6f2-2415ce4d884b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:08.122818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39763219-2acf-4b05-a6f2-2415ce4d884b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:08.126406 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2c0a3-64fc-483c-bb15-9a3058babf98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:08.127017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2c0a3-64fc-483c-bb15-9a3058babf98 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:08.127809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2c0a3-64fc-483c-bb15-9a3058babf98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:08.128081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2c0a3-64fc-483c-bb15-9a3058babf98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:08.137055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2c0a3-64fc-483c-bb15-9a3058babf98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:08.138483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2c0a3-64fc-483c-bb15-9a3058babf98 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:08.148389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1192/2393] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:08.528405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68ebd1-f2ed-4ddd-86b4-784a16d8b946 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:08.593467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68ebd1-f2ed-4ddd-86b4-784a16d8b946 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:08.597902 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:08.598535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:08.598939 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:08.599193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] PATH_INFO: `/v3/users/d984b89ba92f492aa6de1a79ed528b8a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:08.600613 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d984b89ba92f492aa6de1a79ed528b8a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:08.602531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:08.623550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:08.648487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd984b89ba92f492aa6de1a79ed528b8a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:08.649154 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd984b89ba92f492aa6de1a79ed528b8a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:08.656524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd984b89ba92f492aa6de1a79ed528b8a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:08.668372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd984b89ba92f492aa6de1a79ed528b8a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:08.675203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd984b89ba92f492aa6de1a79ed528b8a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:08.681072 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1202/2394] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:02:08 2022] DELETE /identity/v3/users/d984b89ba92f492aa6de1a79ed528b8a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:08.685675 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212cbdf-5b63-4b01-88ca-640cbc77f986 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:08.685973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212cbdf-5b63-4b01-88ca-640cbc77f986 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:08.686252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212cbdf-5b63-4b01-88ca-640cbc77f986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:08.706146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0212cbdf-5b63-4b01-88ca-640cbc77f986 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:08.707600 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0212cbdf-5b63-4b01-88ca-640cbc77f986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:08.733878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:08.772689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1193/2395] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:08.782579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:08.783999 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:08.841055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90905617-af9d-48ba-866e-bde0c8b0d543 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:08.844720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84815810-fd67-4177-b562-2c57e5215f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:08.845268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84815810-fd67-4177-b562-2c57e5215f2b service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:08.845548 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84815810-fd67-4177-b562-2c57e5215f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:08.845820 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84815810-fd67-4177-b562-2c57e5215f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:08.854513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84815810-fd67-4177-b562-2c57e5215f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:08.855947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84815810-fd67-4177-b562-2c57e5215f2b service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:08.865483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1203/2396] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:09.129857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212cbdf-5b63-4b01-88ca-640cbc77f986 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:09.131374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0212cbdf-5b63-4b01-88ca-640cbc77f986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:09.143401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212cbdf-5b63-4b01-88ca-640cbc77f986 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:09.148359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:09.149012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:09.149294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:09.149569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] PATH_INFO: `/v3/projects/5163b45bb1f54cb6b5ace0c85b5e7d8e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:09.150727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5163b45bb1f54cb6b5ace0c85b5e7d8e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:09.152710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:09.200334 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5163b45bb1f54cb6b5ace0c85b5e7d8e', 'request_id': 'req-341a7eae-624f-41a7-9e0b-6cc760b611fd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.205878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5163b45bb1f54cb6b5ace0c85b5e7d8e', 'request_id': 'req-341a7eae-624f-41a7-9e0b-6cc760b611fd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.212366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5163b45bb1f54cb6b5ace0c85b5e7d8e', 'request_id': 'req-341a7eae-624f-41a7-9e0b-6cc760b611fd'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.225431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] The token cache is being invalidate because project 5163b45bb1f54cb6b5ace0c85b5e7d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:02:09.225730 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.226277 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.227865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1194/2397] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:02:09 2022] DELETE /identity/v3/projects/5163b45bb1f54cb6b5ace0c85b5e7d8e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:09.231889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84815810-fd67-4177-b562-2c57e5215f2b service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:09.242205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84815810-fd67-4177-b562-2c57e5215f2b service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:09.298092 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57289d52-0ceb-46b5-b78b-66e5f3cdd74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:09.298735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57289d52-0ceb-46b5-b78b-66e5f3cdd74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:09.299636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57289d52-0ceb-46b5-b78b-66e5f3cdd74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:09.299920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57289d52-0ceb-46b5-b78b-66e5f3cdd74c admin admin] PATH_INFO: `/v3/users/98483f13e657499ebc0954896c5298f9` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:09.301113 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57289d52-0ceb-46b5-b78b-66e5f3cdd74c admin admin] RBAC: Authorizing `identity:delete_user(user_id=98483f13e657499ebc0954896c5298f9)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:09.303076 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57289d52-0ceb-46b5-b78b-66e5f3cdd74c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:09.344850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:09.348519 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57289d52-0ceb-46b5-b78b-66e5f3cdd74c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98483f13e657499ebc0954896c5298f9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.349359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57289d52-0ceb-46b5-b78b-66e5f3cdd74c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98483f13e657499ebc0954896c5298f9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.357461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57289d52-0ceb-46b5-b78b-66e5f3cdd74c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98483f13e657499ebc0954896c5298f9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.369896 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57289d52-0ceb-46b5-b78b-66e5f3cdd74c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98483f13e657499ebc0954896c5298f9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.377300 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57289d52-0ceb-46b5-b78b-66e5f3cdd74c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98483f13e657499ebc0954896c5298f9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.383162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1204/2398] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:02:09 2022] DELETE /identity/v3/users/98483f13e657499ebc0954896c5298f9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:09.654666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:09.656105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:09.670082 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a7eae-624f-41a7-9e0b-6cc760b611fd admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:09.729149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29ff01-3394-4f33-8160-515fce9fa793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:09.729811 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29ff01-3394-4f33-8160-515fce9fa793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:09.730098 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29ff01-3394-4f33-8160-515fce9fa793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:09.730379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29ff01-3394-4f33-8160-515fce9fa793 admin admin] PATH_INFO: `/v3/projects/999a3b14bc864064a894254ae1d9c397` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:09.731531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29ff01-3394-4f33-8160-515fce9fa793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=999a3b14bc864064a894254ae1d9c397)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:09.733463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29ff01-3394-4f33-8160-515fce9fa793 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:09.778536 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4e29ff01-3394-4f33-8160-515fce9fa793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '999a3b14bc864064a894254ae1d9c397', 'request_id': 'req-4e29ff01-3394-4f33-8160-515fce9fa793'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.783199 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:09.785015 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4e29ff01-3394-4f33-8160-515fce9fa793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '999a3b14bc864064a894254ae1d9c397', 'request_id': 'req-4e29ff01-3394-4f33-8160-515fce9fa793'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.792714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4e29ff01-3394-4f33-8160-515fce9fa793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '999a3b14bc864064a894254ae1d9c397', 'request_id': 'req-4e29ff01-3394-4f33-8160-515fce9fa793'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.805660 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4e29ff01-3394-4f33-8160-515fce9fa793 admin admin] The token cache is being invalidate because project 999a3b14bc864064a894254ae1d9c397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:02:09.805863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4e29ff01-3394-4f33-8160-515fce9fa793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.806327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4e29ff01-3394-4f33-8160-515fce9fa793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:09.807961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1195/2399] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:02:09 2022] DELETE /identity/v3/projects/999a3b14bc864064a894254ae1d9c397 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:09.812955 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8dc74-6a81-4e8d-928e-546bc8aebf90 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:09.813382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8dc74-6a81-4e8d-928e-546bc8aebf90 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:09.813579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8dc74-6a81-4e8d-928e-546bc8aebf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:09.833494 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e2c8dc74-6a81-4e8d-928e-546bc8aebf90 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:09.834672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e2c8dc74-6a81-4e8d-928e-546bc8aebf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:09.894717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1205/2400] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:09.902865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459abc5b-9aad-42bf-b03c-0aca04a5e3ba None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:09.903104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459abc5b-9aad-42bf-b03c-0aca04a5e3ba None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:09.903386 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459abc5b-9aad-42bf-b03c-0aca04a5e3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:09.924810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-459abc5b-9aad-42bf-b03c-0aca04a5e3ba None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:09.926132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-459abc5b-9aad-42bf-b03c-0aca04a5e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:09.934426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1196/2401] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:09.938610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8dc74-6a81-4e8d-928e-546bc8aebf90 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:09.948633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8dc74-6a81-4e8d-928e-546bc8aebf90 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:09.953194 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cfb40-16b8-482d-8cab-d5952acffce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:09.953801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cfb40-16b8-482d-8cab-d5952acffce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:09.954112 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cfb40-16b8-482d-8cab-d5952acffce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:09.954387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cfb40-16b8-482d-8cab-d5952acffce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:09.955084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cfb40-16b8-482d-8cab-d5952acffce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:09.955879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cfb40-16b8-482d-8cab-d5952acffce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:09.957826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cfb40-16b8-482d-8cab-d5952acffce2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:09.969302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1206/2402] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:09.974265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459abc5b-9aad-42bf-b03c-0aca04a5e3ba None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:09.983601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459abc5b-9aad-42bf-b03c-0aca04a5e3ba None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:09.988403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2ea79-9222-411c-969a-ff65a79b1005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:09.989015 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2ea79-9222-411c-969a-ff65a79b1005 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:09.989301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2ea79-9222-411c-969a-ff65a79b1005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:09.989584 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2ea79-9222-411c-969a-ff65a79b1005 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:09.990257 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2ea79-9222-411c-969a-ff65a79b1005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:09.992209 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2ea79-9222-411c-969a-ff65a79b1005 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:10.019171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1197/2403] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:02:09 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:02:10.023218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cfb40-16b8-482d-8cab-d5952acffce2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:10.033128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cfb40-16b8-482d-8cab-d5952acffce2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:10.089177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30235dd9-a0ef-4c13-a84e-026853a9f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:10.089788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30235dd9-a0ef-4c13-a84e-026853a9f9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.090069 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30235dd9-a0ef-4c13-a84e-026853a9f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.090343 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30235dd9-a0ef-4c13-a84e-026853a9f9e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.090996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30235dd9-a0ef-4c13-a84e-026853a9f9e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:10.092960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30235dd9-a0ef-4c13-a84e-026853a9f9e9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:10.113871 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1207/2404] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:02:10 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:10.118256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2ea79-9222-411c-969a-ff65a79b1005 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:10.129024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2ea79-9222-411c-969a-ff65a79b1005 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:10.133637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1032104-c2e0-4ed8-920a-9723f7657d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:10.134246 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1032104-c2e0-4ed8-920a-9723f7657d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.134533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1032104-c2e0-4ed8-920a-9723f7657d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.134812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1032104-c2e0-4ed8-920a-9723f7657d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.135551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1032104-c2e0-4ed8-920a-9723f7657d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:10.137219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1032104-c2e0-4ed8-920a-9723f7657d6f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:10.147733 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1198/2405] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:10.152079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30235dd9-a0ef-4c13-a84e-026853a9f9e9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:10.162140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30235dd9-a0ef-4c13-a84e-026853a9f9e9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:10.166825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232c951-c518-4963-8329-f82d129cf4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:10.167438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232c951-c518-4963-8329-f82d129cf4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.167721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232c951-c518-4963-8329-f82d129cf4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.167997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232c951-c518-4963-8329-f82d129cf4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.168731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232c951-c518-4963-8329-f82d129cf4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:10.170337 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232c951-c518-4963-8329-f82d129cf4d5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:10.181409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1208/2406] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:10.185533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1032104-c2e0-4ed8-920a-9723f7657d6f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:10.198450 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1032104-c2e0-4ed8-920a-9723f7657d6f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:10.203441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f55528-6c67-4eed-a60f-896fae1b1a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:10.204253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f55528-6c67-4eed-a60f-896fae1b1a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.204545 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f55528-6c67-4eed-a60f-896fae1b1a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.204824 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f55528-6c67-4eed-a60f-896fae1b1a66 admin admin] PATH_INFO: `/v3/projects/4c9ec8fcfcba469d84184478aadbd480/users/c73480dab0a149599f062261834ba26b/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.222168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f55528-6c67-4eed-a60f-896fae1b1a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c9ec8fcfcba469d84184478aadbd480, user_id=c73480dab0a149599f062261834ba26b, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:10.224873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f55528-6c67-4eed-a60f-896fae1b1a66 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:10.237527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1199/2407] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:10 2022] PUT /identity/v3/projects/4c9ec8fcfcba469d84184478aadbd480/users/c73480dab0a149599f062261834ba26b/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:10.247732 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b9c8c-00b6-4b97-b2bd-a2076c905912 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.248022 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b9c8c-00b6-4b97-b2bd-a2076c905912 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.248328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b9c8c-00b6-4b97-b2bd-a2076c905912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.276507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-df1b9c8c-00b6-4b97-b2bd-a2076c905912 None None] MFA Rules not processed for user `c73480dab0a149599f062261834ba26b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:10.277784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-df1b9c8c-00b6-4b97-b2bd-a2076c905912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:10.290209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:10.342431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1209/2408] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:10.347008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f55528-6c67-4eed-a60f-896fae1b1a66 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:10.408484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f55528-6c67-4eed-a60f-896fae1b1a66 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:10.413118 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78b339-a105-46fb-afa4-b766b32eee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:10.413668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78b339-a105-46fb-afa4-b766b32eee14 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.413952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78b339-a105-46fb-afa4-b766b32eee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.414227 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78b339-a105-46fb-afa4-b766b32eee14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.414894 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78b339-a105-46fb-afa4-b766b32eee14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:10.416835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78b339-a105-46fb-afa4-b766b32eee14 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:10.445822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1200/2409] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:02:10 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:10.450014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b9c8c-00b6-4b97-b2bd-a2076c905912 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:10.461340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b9c8c-00b6-4b97-b2bd-a2076c905912 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:10.519643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0219fb-6ae3-4e24-a847-7a0e237fb4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:10.520313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0219fb-6ae3-4e24-a847-7a0e237fb4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.520594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0219fb-6ae3-4e24-a847-7a0e237fb4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.520867 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0219fb-6ae3-4e24-a847-7a0e237fb4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.521532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0219fb-6ae3-4e24-a847-7a0e237fb4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:10.523646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0219fb-6ae3-4e24-a847-7a0e237fb4e4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:10.544138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1210/2410] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:02:10 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:10.548195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78b339-a105-46fb-afa4-b766b32eee14 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:10.559324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78b339-a105-46fb-afa4-b766b32eee14 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:10.564328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea39ad9-7dea-4683-a50e-c67ef6b3d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:10.565513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea39ad9-7dea-4683-a50e-c67ef6b3d457 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.565796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea39ad9-7dea-4683-a50e-c67ef6b3d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.566418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea39ad9-7dea-4683-a50e-c67ef6b3d457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.567119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea39ad9-7dea-4683-a50e-c67ef6b3d457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:10.568761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea39ad9-7dea-4683-a50e-c67ef6b3d457 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:10.580854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1201/2411] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:10.585307 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0219fb-6ae3-4e24-a847-7a0e237fb4e4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:10.596287 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0219fb-6ae3-4e24-a847-7a0e237fb4e4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:10.601255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e924f0b-85be-4d51-8670-0465d3556828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:10.601949 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924f0b-85be-4d51-8670-0465d3556828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.602227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924f0b-85be-4d51-8670-0465d3556828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.602501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924f0b-85be-4d51-8670-0465d3556828 admin admin] PATH_INFO: `/v3/projects/c3aa6290c19f4840bc5a24a88cb0cbe0/users/10b1a0048b9e45ce922180b19820faa7/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.617633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e924f0b-85be-4d51-8670-0465d3556828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3aa6290c19f4840bc5a24a88cb0cbe0, user_id=10b1a0048b9e45ce922180b19820faa7, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:10.620377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e924f0b-85be-4d51-8670-0465d3556828 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:10.633727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1211/2412] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:10 2022] PUT /identity/v3/projects/c3aa6290c19f4840bc5a24a88cb0cbe0/users/10b1a0048b9e45ce922180b19820faa7/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:10.638464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea39ad9-7dea-4683-a50e-c67ef6b3d457 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:10.648808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea39ad9-7dea-4683-a50e-c67ef6b3d457 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:10.705925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:10.714874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f19cf1-8c86-49fc-b3b8-962e5d942d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:10.715652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f19cf1-8c86-49fc-b3b8-962e5d942d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.716165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f19cf1-8c86-49fc-b3b8-962e5d942d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.716460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f19cf1-8c86-49fc-b3b8-962e5d942d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.717388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f19cf1-8c86-49fc-b3b8-962e5d942d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:10.719003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f19cf1-8c86-49fc-b3b8-962e5d942d8c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:10.729491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1202/2413] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:10.733735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e924f0b-85be-4d51-8670-0465d3556828 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:10.747034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e924f0b-85be-4d51-8670-0465d3556828 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:10.751753 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e7f41-9de2-46e2-af14-8df09b3c0148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:10.752994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e7f41-9de2-46e2-af14-8df09b3c0148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.753274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e7f41-9de2-46e2-af14-8df09b3c0148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.753549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e7f41-9de2-46e2-af14-8df09b3c0148 admin admin] PATH_INFO: `/v3/projects/c3aa6290c19f4840bc5a24a88cb0cbe0/users/10b1a0048b9e45ce922180b19820faa7/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.755506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e7f41-9de2-46e2-af14-8df09b3c0148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3aa6290c19f4840bc5a24a88cb0cbe0, user_id=10b1a0048b9e45ce922180b19820faa7, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:10.758168 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e7f41-9de2-46e2-af14-8df09b3c0148 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:10.768453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1212/2414] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:10 2022] PUT /identity/v3/projects/c3aa6290c19f4840bc5a24a88cb0cbe0/users/10b1a0048b9e45ce922180b19820faa7/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:10.836919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af74a2-b703-4dab-88f7-bcab80e65a14 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.837240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af74a2-b703-4dab-88f7-bcab80e65a14 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.837526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af74a2-b703-4dab-88f7-bcab80e65a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.867104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c5af74a2-b703-4dab-88f7-bcab80e65a14 None None] MFA Rules not processed for user `10b1a0048b9e45ce922180b19820faa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:10.868361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c5af74a2-b703-4dab-88f7-bcab80e65a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:10.936663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1203/2415] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:10.947800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e7f41-9de2-46e2-af14-8df09b3c0148 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:10.949588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3d5e7f41-9de2-46e2-af14-8df09b3c0148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:11.008166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e7f41-9de2-46e2-af14-8df09b3c0148 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:11.011731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958295b-61e6-478e-96ac-5c59821ce417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:11.012377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958295b-61e6-478e-96ac-5c59821ce417 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:11.012657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958295b-61e6-478e-96ac-5c59821ce417 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:11.012928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958295b-61e6-478e-96ac-5c59821ce417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:11.021764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958295b-61e6-478e-96ac-5c59821ce417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:11.023195 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958295b-61e6-478e-96ac-5c59821ce417 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:11.032496 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1213/2416] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:11.447215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af74a2-b703-4dab-88f7-bcab80e65a14 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:11.509526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af74a2-b703-4dab-88f7-bcab80e65a14 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:11.514038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:11.514623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:11.514905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:11.515181 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] PATH_INFO: `/v3/users/c73480dab0a149599f062261834ba26b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:11.516384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c73480dab0a149599f062261834ba26b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:11.518832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:11.562761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73480dab0a149599f062261834ba26b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:11.563402 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73480dab0a149599f062261834ba26b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:11.575583 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73480dab0a149599f062261834ba26b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:11.583500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73480dab0a149599f062261834ba26b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:11.588980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:11.591173 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73480dab0a149599f062261834ba26b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:11.599030 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1204/2417] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:02:11 2022] DELETE /identity/v3/users/c73480dab0a149599f062261834ba26b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:11.603673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f6a55-b2a2-42a9-b07d-8b7bbb0a1d09 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:11.603966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f6a55-b2a2-42a9-b07d-8b7bbb0a1d09 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:11.604288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f6a55-b2a2-42a9-b07d-8b7bbb0a1d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:11.623483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a52f6a55-b2a2-42a9-b07d-8b7bbb0a1d09 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:11.624728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a52f6a55-b2a2-42a9-b07d-8b7bbb0a1d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:11.631113 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:11.697013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1214/2418] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:11.707667 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:11.709088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:11.765449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff51a1-ce99-4856-ad6a-7e0a2bdc2b1c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:11.769740 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b563c-f6bf-418d-bcd6-21477a2d5246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:11.770352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b563c-f6bf-418d-bcd6-21477a2d5246 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:11.770634 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b563c-f6bf-418d-bcd6-21477a2d5246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:11.770904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b563c-f6bf-418d-bcd6-21477a2d5246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:11.779711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b563c-f6bf-418d-bcd6-21477a2d5246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:11.781164 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b563c-f6bf-418d-bcd6-21477a2d5246 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:11.790511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1205/2419] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:12.062242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f6a55-b2a2-42a9-b07d-8b7bbb0a1d09 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:12.063796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a52f6a55-b2a2-42a9-b07d-8b7bbb0a1d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:12.076666 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f6a55-b2a2-42a9-b07d-8b7bbb0a1d09 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:12.081264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:12.082151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:12.082432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:12.082711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] PATH_INFO: `/v3/projects/4c9ec8fcfcba469d84184478aadbd480` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:12.083868 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c9ec8fcfcba469d84184478aadbd480)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:12.085990 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:12.133241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c9ec8fcfcba469d84184478aadbd480', 'request_id': 'req-17e4af34-0659-4972-8c9a-c57cbaaa9743'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.138945 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c9ec8fcfcba469d84184478aadbd480', 'request_id': 'req-17e4af34-0659-4972-8c9a-c57cbaaa9743'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.145972 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c9ec8fcfcba469d84184478aadbd480', 'request_id': 'req-17e4af34-0659-4972-8c9a-c57cbaaa9743'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.157087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] The token cache is being invalidate because project 4c9ec8fcfcba469d84184478aadbd480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:02:12.157381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.158013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.159564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1215/2420] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:02:12 2022] DELETE /identity/v3/projects/4c9ec8fcfcba469d84184478aadbd480 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:02:12.163726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b563c-f6bf-418d-bcd6-21477a2d5246 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:12.173338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b563c-f6bf-418d-bcd6-21477a2d5246 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:12.229616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e08947-8032-4051-9180-d107db55804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:12.230250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e08947-8032-4051-9180-d107db55804d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:12.230531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e08947-8032-4051-9180-d107db55804d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:12.230806 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e08947-8032-4051-9180-d107db55804d admin admin] PATH_INFO: `/v3/users/10b1a0048b9e45ce922180b19820faa7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:12.231942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e08947-8032-4051-9180-d107db55804d admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b1a0048b9e45ce922180b19820faa7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:12.233868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e08947-8032-4051-9180-d107db55804d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:12.278918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-88e08947-8032-4051-9180-d107db55804d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b1a0048b9e45ce922180b19820faa7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.279609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-88e08947-8032-4051-9180-d107db55804d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b1a0048b9e45ce922180b19820faa7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.292276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-88e08947-8032-4051-9180-d107db55804d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b1a0048b9e45ce922180b19820faa7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.300324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-88e08947-8032-4051-9180-d107db55804d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b1a0048b9e45ce922180b19820faa7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.307259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-88e08947-8032-4051-9180-d107db55804d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b1a0048b9e45ce922180b19820faa7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.313067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1206/2421] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:02:12 2022] DELETE /identity/v3/users/10b1a0048b9e45ce922180b19820faa7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:12.583130 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:12.585136 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:12.600015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4af34-0659-4972-8c9a-c57cbaaa9743 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:12.658838 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f313359-9088-440d-8cfd-982de017c2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:12.659479 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f313359-9088-440d-8cfd-982de017c2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:12.659759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f313359-9088-440d-8cfd-982de017c2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:12.660029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f313359-9088-440d-8cfd-982de017c2e3 admin admin] PATH_INFO: `/v3/projects/c3aa6290c19f4840bc5a24a88cb0cbe0` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:12.661199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f313359-9088-440d-8cfd-982de017c2e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3aa6290c19f4840bc5a24a88cb0cbe0)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:12.663104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f313359-9088-440d-8cfd-982de017c2e3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:12.704659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:12.722034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f313359-9088-440d-8cfd-982de017c2e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3aa6290c19f4840bc5a24a88cb0cbe0', 'request_id': 'req-0f313359-9088-440d-8cfd-982de017c2e3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.727847 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f313359-9088-440d-8cfd-982de017c2e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3aa6290c19f4840bc5a24a88cb0cbe0', 'request_id': 'req-0f313359-9088-440d-8cfd-982de017c2e3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.735414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f313359-9088-440d-8cfd-982de017c2e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3aa6290c19f4840bc5a24a88cb0cbe0', 'request_id': 'req-0f313359-9088-440d-8cfd-982de017c2e3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.747363 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f313359-9088-440d-8cfd-982de017c2e3 admin admin] The token cache is being invalidate because project c3aa6290c19f4840bc5a24a88cb0cbe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:02:12.747646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f313359-9088-440d-8cfd-982de017c2e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.748300 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0f313359-9088-440d-8cfd-982de017c2e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:12.749796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1216/2422] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:02:12 2022] DELETE /identity/v3/projects/c3aa6290c19f4840bc5a24a88cb0cbe0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:12.755383 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed561-e817-440b-92c5-6af95e18ee61 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:12.755890 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed561-e817-440b-92c5-6af95e18ee61 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:12.755989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed561-e817-440b-92c5-6af95e18ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:12.775076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d7fed561-e817-440b-92c5-6af95e18ee61 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:12.776312 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d7fed561-e817-440b-92c5-6af95e18ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:12.788186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:12.838864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1207/2423] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:12.846506 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88080aba-a58d-419f-8149-2c63abb7879b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:12.846822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88080aba-a58d-419f-8149-2c63abb7879b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:12.847100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88080aba-a58d-419f-8149-2c63abb7879b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:12.867028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-88080aba-a58d-419f-8149-2c63abb7879b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:12.868270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-88080aba-a58d-419f-8149-2c63abb7879b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:12.876176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1217/2424] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:12.880968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed561-e817-440b-92c5-6af95e18ee61 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:12.890574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed561-e817-440b-92c5-6af95e18ee61 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:12.895132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e73efc-9726-46cc-8cab-876c0200c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:12.895743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e73efc-9726-46cc-8cab-876c0200c58d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:12.896027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e73efc-9726-46cc-8cab-876c0200c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:12.896340 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e73efc-9726-46cc-8cab-876c0200c58d admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:12.897039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e73efc-9726-46cc-8cab-876c0200c58d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:12.897373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e73efc-9726-46cc-8cab-876c0200c58d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:12.898954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e73efc-9726-46cc-8cab-876c0200c58d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:12.910304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1208/2425] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:12.914691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88080aba-a58d-419f-8149-2c63abb7879b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:12.924524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88080aba-a58d-419f-8149-2c63abb7879b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:12.929582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3912554-3e1a-4d04-9a02-00fb89c6c70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:12.930254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3912554-3e1a-4d04-9a02-00fb89c6c70d admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:12.930472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3912554-3e1a-4d04-9a02-00fb89c6c70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:12.930749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3912554-3e1a-4d04-9a02-00fb89c6c70d admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:12.931420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3912554-3e1a-4d04-9a02-00fb89c6c70d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:12.933368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3912554-3e1a-4d04-9a02-00fb89c6c70d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:12.960797 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1218/2426] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:02:12 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:12.965137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e73efc-9726-46cc-8cab-876c0200c58d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:12.975512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e73efc-9726-46cc-8cab-876c0200c58d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.035514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca17c8e-75c3-4730-879a-b91cb9222d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.036163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca17c8e-75c3-4730-879a-b91cb9222d6d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.036457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca17c8e-75c3-4730-879a-b91cb9222d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.036737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca17c8e-75c3-4730-879a-b91cb9222d6d admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.037418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca17c8e-75c3-4730-879a-b91cb9222d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.039368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca17c8e-75c3-4730-879a-b91cb9222d6d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.061087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1209/2427] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:02:12 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:13.065439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3912554-3e1a-4d04-9a02-00fb89c6c70d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:13.075772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3912554-3e1a-4d04-9a02-00fb89c6c70d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.080449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736f357-91bd-41a9-979b-3c320cbd04ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.081055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736f357-91bd-41a9-979b-3c320cbd04ba admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.081338 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736f357-91bd-41a9-979b-3c320cbd04ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.081615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736f357-91bd-41a9-979b-3c320cbd04ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.082590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736f357-91bd-41a9-979b-3c320cbd04ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.084232 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736f357-91bd-41a9-979b-3c320cbd04ba admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.094183 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1219/2428] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:13.098515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca17c8e-75c3-4730-879a-b91cb9222d6d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:13.108851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca17c8e-75c3-4730-879a-b91cb9222d6d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.114146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcba50-400d-45e9-9f3b-c71ec721ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.114754 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcba50-400d-45e9-9f3b-c71ec721ee3f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.115039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcba50-400d-45e9-9f3b-c71ec721ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.115318 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcba50-400d-45e9-9f3b-c71ec721ee3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.116040 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcba50-400d-45e9-9f3b-c71ec721ee3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.117648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcba50-400d-45e9-9f3b-c71ec721ee3f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.128165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1210/2429] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:13.132233 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736f357-91bd-41a9-979b-3c320cbd04ba admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:13.142270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736f357-91bd-41a9-979b-3c320cbd04ba admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.147068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91193c75-631b-44dc-9da6-35d4406fcf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.147728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91193c75-631b-44dc-9da6-35d4406fcf8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.148012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91193c75-631b-44dc-9da6-35d4406fcf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.148326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91193c75-631b-44dc-9da6-35d4406fcf8a admin admin] PATH_INFO: `/v3/projects/617f3685e9f54610bc6e653ef2e939dd/users/d7a373c594a84a07812d4a4e4bdd0c13/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.163311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91193c75-631b-44dc-9da6-35d4406fcf8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=617f3685e9f54610bc6e653ef2e939dd, user_id=d7a373c594a84a07812d4a4e4bdd0c13, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.166031 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91193c75-631b-44dc-9da6-35d4406fcf8a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.179555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1220/2430] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:13 2022] PUT /identity/v3/projects/617f3685e9f54610bc6e653ef2e939dd/users/d7a373c594a84a07812d4a4e4bdd0c13/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:13.190942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248bc6c-5170-4cc7-b930-35048fdecb4d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.191239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248bc6c-5170-4cc7-b930-35048fdecb4d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.191520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248bc6c-5170-4cc7-b930-35048fdecb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.218666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e248bc6c-5170-4cc7-b930-35048fdecb4d None None] MFA Rules not processed for user `d7a373c594a84a07812d4a4e4bdd0c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:13.219887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e248bc6c-5170-4cc7-b930-35048fdecb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:13.284051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1211/2431] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:13.288953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91193c75-631b-44dc-9da6-35d4406fcf8a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:13.351566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91193c75-631b-44dc-9da6-35d4406fcf8a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.356691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661bdfd-405c-44cc-8478-a1a0807fd6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.357334 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661bdfd-405c-44cc-8478-a1a0807fd6cf admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.357620 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661bdfd-405c-44cc-8478-a1a0807fd6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.357895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661bdfd-405c-44cc-8478-a1a0807fd6cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.358567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661bdfd-405c-44cc-8478-a1a0807fd6cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.360535 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661bdfd-405c-44cc-8478-a1a0807fd6cf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.390740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1221/2432] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:02:13 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:13.395506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248bc6c-5170-4cc7-b930-35048fdecb4d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:13.406700 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248bc6c-5170-4cc7-b930-35048fdecb4d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.416638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:13.466141 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbf30b-f92d-4fce-be3a-620a9c9aa12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.466767 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbf30b-f92d-4fce-be3a-620a9c9aa12a admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.467051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbf30b-f92d-4fce-be3a-620a9c9aa12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.467330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbf30b-f92d-4fce-be3a-620a9c9aa12a admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.467994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbf30b-f92d-4fce-be3a-620a9c9aa12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.469967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbf30b-f92d-4fce-be3a-620a9c9aa12a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.491283 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1212/2433] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:02:13 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:02:13.495374 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661bdfd-405c-44cc-8478-a1a0807fd6cf admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:13.505749 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661bdfd-405c-44cc-8478-a1a0807fd6cf admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.510326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c6697-fcd6-468c-b8e2-76ed9ab51abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.510935 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c6697-fcd6-468c-b8e2-76ed9ab51abc admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.511220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c6697-fcd6-468c-b8e2-76ed9ab51abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.511497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c6697-fcd6-468c-b8e2-76ed9ab51abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.512220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c6697-fcd6-468c-b8e2-76ed9ab51abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.513815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c6697-fcd6-468c-b8e2-76ed9ab51abc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.524858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1222/2434] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:13.528927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbf30b-f92d-4fce-be3a-620a9c9aa12a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:13.539572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbf30b-f92d-4fce-be3a-620a9c9aa12a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.544259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2523694-1fde-4dbf-a8dc-3c0bf8ae8b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.544952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2523694-1fde-4dbf-a8dc-3c0bf8ae8b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.545234 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2523694-1fde-4dbf-a8dc-3c0bf8ae8b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.545514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2523694-1fde-4dbf-a8dc-3c0bf8ae8b23 admin admin] PATH_INFO: `/v3/projects/3da135fa2cd44967928aa58c49b7e992/users/cfd7653bf7624a329b4296e86db0fbfd/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.560087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2523694-1fde-4dbf-a8dc-3c0bf8ae8b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da135fa2cd44967928aa58c49b7e992, user_id=cfd7653bf7624a329b4296e86db0fbfd, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.562887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2523694-1fde-4dbf-a8dc-3c0bf8ae8b23 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.576478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1213/2435] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:13 2022] PUT /identity/v3/projects/3da135fa2cd44967928aa58c49b7e992/users/cfd7653bf7624a329b4296e86db0fbfd/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:13.580880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c6697-fcd6-468c-b8e2-76ed9ab51abc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:13.591003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c6697-fcd6-468c-b8e2-76ed9ab51abc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.623401 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:13.650002 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7ce3a-1f0b-4772-8e9c-2aabf760c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.650624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7ce3a-1f0b-4772-8e9c-2aabf760c8be admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.650943 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7ce3a-1f0b-4772-8e9c-2aabf760c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.651222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7ce3a-1f0b-4772-8e9c-2aabf760c8be admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.651914 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7ce3a-1f0b-4772-8e9c-2aabf760c8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.653572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7ce3a-1f0b-4772-8e9c-2aabf760c8be admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.663933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1223/2436] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:02:13.668083 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2523694-1fde-4dbf-a8dc-3c0bf8ae8b23 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:13.678174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2523694-1fde-4dbf-a8dc-3c0bf8ae8b23 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.682821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1b7ee-479d-45df-b8df-a88d9d0bdf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.683507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1b7ee-479d-45df-b8df-a88d9d0bdf3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.683774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1b7ee-479d-45df-b8df-a88d9d0bdf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.684055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1b7ee-479d-45df-b8df-a88d9d0bdf3e admin admin] PATH_INFO: `/v3/projects/3da135fa2cd44967928aa58c49b7e992/users/cfd7653bf7624a329b4296e86db0fbfd/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.686037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1b7ee-479d-45df-b8df-a88d9d0bdf3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da135fa2cd44967928aa58c49b7e992, user_id=cfd7653bf7624a329b4296e86db0fbfd, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.688687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1b7ee-479d-45df-b8df-a88d9d0bdf3e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.699400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1214/2437] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:13 2022] PUT /identity/v3/projects/3da135fa2cd44967928aa58c49b7e992/users/cfd7653bf7624a329b4296e86db0fbfd/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:13.710440 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03818c42-4089-4f7f-9fee-6a8448860f0a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.710735 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03818c42-4089-4f7f-9fee-6a8448860f0a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.711020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03818c42-4089-4f7f-9fee-6a8448860f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.739850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-03818c42-4089-4f7f-9fee-6a8448860f0a None None] MFA Rules not processed for user `cfd7653bf7624a329b4296e86db0fbfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:13.741122 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-03818c42-4089-4f7f-9fee-6a8448860f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:13.815527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1224/2438] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:13.826240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1b7ee-479d-45df-b8df-a88d9d0bdf3e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:13.827972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-48e1b7ee-479d-45df-b8df-a88d9d0bdf3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:13.885589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1b7ee-479d-45df-b8df-a88d9d0bdf3e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.889118 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73ab47-9660-4fa0-a803-1b06a698e3be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.889730 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73ab47-9660-4fa0-a803-1b06a698e3be service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.890007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73ab47-9660-4fa0-a803-1b06a698e3be service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.890281 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73ab47-9660-4fa0-a803-1b06a698e3be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.899872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73ab47-9660-4fa0-a803-1b06a698e3be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.901320 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73ab47-9660-4fa0-a803-1b06a698e3be service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.910511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1215/2439] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:15.253201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03818c42-4089-4f7f-9fee-6a8448860f0a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:15.314913 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03818c42-4089-4f7f-9fee-6a8448860f0a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:15.319424 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:15.320062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:15.320376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:15.320654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] PATH_INFO: `/v3/users/d7a373c594a84a07812d4a4e4bdd0c13` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:15.321807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a373c594a84a07812d4a4e4bdd0c13)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:15.323763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:15.370305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a373c594a84a07812d4a4e4bdd0c13'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:15.370976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a373c594a84a07812d4a4e4bdd0c13'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:15.379933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a373c594a84a07812d4a4e4bdd0c13'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:15.384561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:15.394038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a373c594a84a07812d4a4e4bdd0c13'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:15.400731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a373c594a84a07812d4a4e4bdd0c13'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:15.406795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1225/2440] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:02:15 2022] DELETE /identity/v3/users/d7a373c594a84a07812d4a4e4bdd0c13 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:15.411849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20402c6-7535-4b38-85cd-003f2244973a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:15.412356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20402c6-7535-4b38-85cd-003f2244973a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:15.412545 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20402c6-7535-4b38-85cd-003f2244973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:15.431666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b20402c6-7535-4b38-85cd-003f2244973a None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:15.432840 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b20402c6-7535-4b38-85cd-003f2244973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:15.492036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1216/2441] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:15.501729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:15.503212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:15.560244 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa69a4-c397-4410-9958-052a346e35bf admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:15.563812 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc6e2d-2cd7-4ccf-a31d-49723eb5f715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:15.564484 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6e2d-2cd7-4ccf-a31d-49723eb5f715 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:15.564828 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6e2d-2cd7-4ccf-a31d-49723eb5f715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:15.565101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6e2d-2cd7-4ccf-a31d-49723eb5f715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:15.574242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc6e2d-2cd7-4ccf-a31d-49723eb5f715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:15.575686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc6e2d-2cd7-4ccf-a31d-49723eb5f715 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:15.585902 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1226/2442] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:15.912693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20402c6-7535-4b38-85cd-003f2244973a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:15.914200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b20402c6-7535-4b38-85cd-003f2244973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:15.926041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20402c6-7535-4b38-85cd-003f2244973a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:15.932497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:15.933361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:15.933830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:15.934356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] PATH_INFO: `/v3/projects/617f3685e9f54610bc6e653ef2e939dd` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:15.935847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] RBAC: Authorizing `identity:delete_project(project_id=617f3685e9f54610bc6e653ef2e939dd)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:15.937829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:15.940606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:15.994416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '617f3685e9f54610bc6e653ef2e939dd', 'request_id': 'req-77ff3ce7-2fb9-4054-919d-44d4488f970f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:15.999805 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '617f3685e9f54610bc6e653ef2e939dd', 'request_id': 'req-77ff3ce7-2fb9-4054-919d-44d4488f970f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.006849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '617f3685e9f54610bc6e653ef2e939dd', 'request_id': 'req-77ff3ce7-2fb9-4054-919d-44d4488f970f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.019933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] The token cache is being invalidate because project 617f3685e9f54610bc6e653ef2e939dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:02:16.020253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.020883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.022392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1217/2443] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:02:15 2022] DELETE /identity/v3/projects/617f3685e9f54610bc6e653ef2e939dd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:16.028004 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc6e2d-2cd7-4ccf-a31d-49723eb5f715 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.039098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc6e2d-2cd7-4ccf-a31d-49723eb5f715 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.107756 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf56bc0-9f76-4fd0-a6d0-97d6c854daf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.108434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf56bc0-9f76-4fd0-a6d0-97d6c854daf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.108724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf56bc0-9f76-4fd0-a6d0-97d6c854daf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.109007 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf56bc0-9f76-4fd0-a6d0-97d6c854daf2 admin admin] PATH_INFO: `/v3/users/cfd7653bf7624a329b4296e86db0fbfd` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.110228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf56bc0-9f76-4fd0-a6d0-97d6c854daf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd7653bf7624a329b4296e86db0fbfd)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.112212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf56bc0-9f76-4fd0-a6d0-97d6c854daf2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.157572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9cf56bc0-9f76-4fd0-a6d0-97d6c854daf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd7653bf7624a329b4296e86db0fbfd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.158241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9cf56bc0-9f76-4fd0-a6d0-97d6c854daf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd7653bf7624a329b4296e86db0fbfd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.165412 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9cf56bc0-9f76-4fd0-a6d0-97d6c854daf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd7653bf7624a329b4296e86db0fbfd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.177280 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9cf56bc0-9f76-4fd0-a6d0-97d6c854daf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd7653bf7624a329b4296e86db0fbfd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.184025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9cf56bc0-9f76-4fd0-a6d0-97d6c854daf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd7653bf7624a329b4296e86db0fbfd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.185482 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:16.191514 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1227/2444] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:02:16 2022] DELETE /identity/v3/users/cfd7653bf7624a329b4296e86db0fbfd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:16.471258 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.472957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:16.486693 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff3ce7-2fb9-4054-919d-44d4488f970f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.544275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.544912 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.545195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.545470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29 admin admin] PATH_INFO: `/v3/projects/3da135fa2cd44967928aa58c49b7e992` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.546666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da135fa2cd44967928aa58c49b7e992)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.548602 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.595299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da135fa2cd44967928aa58c49b7e992', 'request_id': 'req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.602564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da135fa2cd44967928aa58c49b7e992', 'request_id': 'req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.610307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da135fa2cd44967928aa58c49b7e992', 'request_id': 'req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.623394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29 admin admin] The token cache is being invalidate because project 3da135fa2cd44967928aa58c49b7e992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:02:16.623685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.624359 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-31f21073-60a7-46cd-9f24-b3e0e2ab8b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:16.625864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1218/2445] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:02:16 2022] DELETE /identity/v3/projects/3da135fa2cd44967928aa58c49b7e992 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:16.631326 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2fbe0-e3c1-4565-8294-c99035699ca4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.631873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2fbe0-e3c1-4565-8294-c99035699ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.631873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2fbe0-e3c1-4565-8294-c99035699ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.650879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-93c2fbe0-e3c1-4565-8294-c99035699ca4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:16.652099 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-93c2fbe0-e3c1-4565-8294-c99035699ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:16.711826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1228/2446] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:16.719674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9371e14-3727-4e68-84ab-7b051cb62dcf None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.719984 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9371e14-3727-4e68-84ab-7b051cb62dcf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.720304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9371e14-3727-4e68-84ab-7b051cb62dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.740251 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d9371e14-3727-4e68-84ab-7b051cb62dcf None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:16.741532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d9371e14-3727-4e68-84ab-7b051cb62dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:16.749390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1219/2447] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:16.754388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2fbe0-e3c1-4565-8294-c99035699ca4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.766996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2fbe0-e3c1-4565-8294-c99035699ca4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.773502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac7553-9bf3-4735-9cd1-1f3d06898cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.774380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac7553-9bf3-4735-9cd1-1f3d06898cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.774802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac7553-9bf3-4735-9cd1-1f3d06898cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.775209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac7553-9bf3-4735-9cd1-1f3d06898cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.776294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac7553-9bf3-4735-9cd1-1f3d06898cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:16.776760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac7553-9bf3-4735-9cd1-1f3d06898cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.779271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac7553-9bf3-4735-9cd1-1f3d06898cf9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.796020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1229/2448] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:16.801176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9371e14-3727-4e68-84ab-7b051cb62dcf None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.810540 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9371e14-3727-4e68-84ab-7b051cb62dcf None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.815233 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837d193-d5dc-4f71-8160-ab10f38c6b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.815860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837d193-d5dc-4f71-8160-ab10f38c6b64 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.816171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837d193-d5dc-4f71-8160-ab10f38c6b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.816452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837d193-d5dc-4f71-8160-ab10f38c6b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.817109 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837d193-d5dc-4f71-8160-ab10f38c6b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.819008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837d193-d5dc-4f71-8160-ab10f38c6b64 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.833991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:16.847662 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1220/2449] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:02:16 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:02:16.851898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac7553-9bf3-4735-9cd1-1f3d06898cf9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.861896 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac7553-9bf3-4735-9cd1-1f3d06898cf9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.918742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db933a-ddc5-4031-9277-b51e3bad7545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.919353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db933a-ddc5-4031-9277-b51e3bad7545 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.919637 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db933a-ddc5-4031-9277-b51e3bad7545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.919913 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db933a-ddc5-4031-9277-b51e3bad7545 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.920607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db933a-ddc5-4031-9277-b51e3bad7545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.922523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db933a-ddc5-4031-9277-b51e3bad7545 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.945201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1230/2450] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:02:16 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:16.949794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837d193-d5dc-4f71-8160-ab10f38c6b64 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.960403 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837d193-d5dc-4f71-8160-ab10f38c6b64 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.964999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebda8b-9ebe-40e0-a313-e8bef8f64aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.965609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebda8b-9ebe-40e0-a313-e8bef8f64aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.965896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebda8b-9ebe-40e0-a313-e8bef8f64aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.966174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebda8b-9ebe-40e0-a313-e8bef8f64aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.966871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebda8b-9ebe-40e0-a313-e8bef8f64aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.968504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebda8b-9ebe-40e0-a313-e8bef8f64aa7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.978882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1221/2451] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:16.982605 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db933a-ddc5-4031-9277-b51e3bad7545 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.993612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db933a-ddc5-4031-9277-b51e3bad7545 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.998621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b222a6b-3f2f-4eaf-966b-fe702da33af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.999237 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b222a6b-3f2f-4eaf-966b-fe702da33af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.999526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b222a6b-3f2f-4eaf-966b-fe702da33af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.999808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b222a6b-3f2f-4eaf-966b-fe702da33af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.000545 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b222a6b-3f2f-4eaf-966b-fe702da33af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:17.002153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b222a6b-3f2f-4eaf-966b-fe702da33af0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:17.013314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1231/2452] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:17.017573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebda8b-9ebe-40e0-a313-e8bef8f64aa7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:17.027598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebda8b-9ebe-40e0-a313-e8bef8f64aa7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:17.032276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea7a58-3006-42b4-983b-aab1f2b57d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:17.032944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7a58-3006-42b4-983b-aab1f2b57d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:17.033229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7a58-3006-42b4-983b-aab1f2b57d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:17.033512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7a58-3006-42b4-983b-aab1f2b57d24 admin admin] PATH_INFO: `/v3/projects/dc8af94bd0c0412c9761dec6d292465b/users/cc75d01d18544ce49f1c2c7ffe79d961/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.049924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea7a58-3006-42b4-983b-aab1f2b57d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8af94bd0c0412c9761dec6d292465b, user_id=cc75d01d18544ce49f1c2c7ffe79d961, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:17.053111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea7a58-3006-42b4-983b-aab1f2b57d24 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:17.066424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1222/2453] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:17 2022] PUT /identity/v3/projects/dc8af94bd0c0412c9761dec6d292465b/users/cc75d01d18544ce49f1c2c7ffe79d961/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:17.077764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfc36c-1910-4325-81d8-08e0658aeb4d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:17.078057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfc36c-1910-4325-81d8-08e0658aeb4d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:17.078336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfc36c-1910-4325-81d8-08e0658aeb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.107153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9cdfc36c-1910-4325-81d8-08e0658aeb4d None None] MFA Rules not processed for user `cc75d01d18544ce49f1c2c7ffe79d961`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:17.108401 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9cdfc36c-1910-4325-81d8-08e0658aeb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:17.164986 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:17.176447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1232/2454] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:17.180887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea7a58-3006-42b4-983b-aab1f2b57d24 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:17.242705 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea7a58-3006-42b4-983b-aab1f2b57d24 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:17.247372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc0766-b5c3-4ca3-bb9f-768c0b5dee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:17.247993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc0766-b5c3-4ca3-bb9f-768c0b5dee4f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:17.248310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc0766-b5c3-4ca3-bb9f-768c0b5dee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:17.248594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc0766-b5c3-4ca3-bb9f-768c0b5dee4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.249265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc0766-b5c3-4ca3-bb9f-768c0b5dee4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:17.251175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc0766-b5c3-4ca3-bb9f-768c0b5dee4f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:17.277558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1223/2455] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:02:17 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:17.281730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfc36c-1910-4325-81d8-08e0658aeb4d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:17.293029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfc36c-1910-4325-81d8-08e0658aeb4d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:17.348603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886c9a-ddda-4705-a54b-1dc81f3c3de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:17.349147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886c9a-ddda-4705-a54b-1dc81f3c3de0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:17.349433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886c9a-ddda-4705-a54b-1dc81f3c3de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:17.349714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886c9a-ddda-4705-a54b-1dc81f3c3de0 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.350373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886c9a-ddda-4705-a54b-1dc81f3c3de0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:17.352330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886c9a-ddda-4705-a54b-1dc81f3c3de0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:17.372536 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1233/2456] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:02:17 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:02:17.376485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc0766-b5c3-4ca3-bb9f-768c0b5dee4f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:17.386839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc0766-b5c3-4ca3-bb9f-768c0b5dee4f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:17.391431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6b418-b26b-4f9e-95a0-50abf3f9fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:17.392039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6b418-b26b-4f9e-95a0-50abf3f9fda5 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:17.392368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6b418-b26b-4f9e-95a0-50abf3f9fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:17.392649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6b418-b26b-4f9e-95a0-50abf3f9fda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.393347 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6b418-b26b-4f9e-95a0-50abf3f9fda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:17.395449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6b418-b26b-4f9e-95a0-50abf3f9fda5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:17.406013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1224/2457] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:17.410615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886c9a-ddda-4705-a54b-1dc81f3c3de0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:17.420671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886c9a-ddda-4705-a54b-1dc81f3c3de0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:17.425267 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34608d-1582-4190-bdcb-98c9f3064a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:17.425919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34608d-1582-4190-bdcb-98c9f3064a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:17.426204 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34608d-1582-4190-bdcb-98c9f3064a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:17.426480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34608d-1582-4190-bdcb-98c9f3064a48 admin admin] PATH_INFO: `/v3/projects/ed89529f2aa64bdc9798da8d97a2bf77/users/44d10406a92444e398b55aa117330b0f/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.441169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34608d-1582-4190-bdcb-98c9f3064a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed89529f2aa64bdc9798da8d97a2bf77, user_id=44d10406a92444e398b55aa117330b0f, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:17.443804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34608d-1582-4190-bdcb-98c9f3064a48 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:17.458226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1234/2458] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:17 2022] PUT /identity/v3/projects/ed89529f2aa64bdc9798da8d97a2bf77/users/44d10406a92444e398b55aa117330b0f/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:17.462172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6b418-b26b-4f9e-95a0-50abf3f9fda5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:17.472751 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6b418-b26b-4f9e-95a0-50abf3f9fda5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:17.528692 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743ab28-5a2c-48a0-ae08-266b102ba87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:17.529307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743ab28-5a2c-48a0-ae08-266b102ba87c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:17.529589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743ab28-5a2c-48a0-ae08-266b102ba87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:17.529862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743ab28-5a2c-48a0-ae08-266b102ba87c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.530549 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743ab28-5a2c-48a0-ae08-266b102ba87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:17.532163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743ab28-5a2c-48a0-ae08-266b102ba87c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:17.541788 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1225/2459] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:17.546164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34608d-1582-4190-bdcb-98c9f3064a48 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:17.556704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34608d-1582-4190-bdcb-98c9f3064a48 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:17.561305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3f35f-ee92-4c4f-b1d5-17a53c4d90a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:17.561969 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3f35f-ee92-4c4f-b1d5-17a53c4d90a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:17.562252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3f35f-ee92-4c4f-b1d5-17a53c4d90a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:17.562530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3f35f-ee92-4c4f-b1d5-17a53c4d90a4 admin admin] PATH_INFO: `/v3/projects/ed89529f2aa64bdc9798da8d97a2bf77/users/44d10406a92444e398b55aa117330b0f/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.564519 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3f35f-ee92-4c4f-b1d5-17a53c4d90a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed89529f2aa64bdc9798da8d97a2bf77, user_id=44d10406a92444e398b55aa117330b0f, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:17.567733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3f35f-ee92-4c4f-b1d5-17a53c4d90a4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:17.577825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1235/2460] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:17 2022] PUT /identity/v3/projects/ed89529f2aa64bdc9798da8d97a2bf77/users/44d10406a92444e398b55aa117330b0f/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:17.588626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11024db7-e5c7-4d86-917d-0489e5cacc7c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:17.588919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11024db7-e5c7-4d86-917d-0489e5cacc7c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:17.589223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11024db7-e5c7-4d86-917d-0489e5cacc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.616042 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-11024db7-e5c7-4d86-917d-0489e5cacc7c None None] MFA Rules not processed for user `44d10406a92444e398b55aa117330b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:17.617193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-11024db7-e5c7-4d86-917d-0489e5cacc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:17.634920 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:17.685955 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1226/2461] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:17.697901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3f35f-ee92-4c4f-b1d5-17a53c4d90a4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:17.699815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dba3f35f-ee92-4c4f-b1d5-17a53c4d90a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:17.759850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3f35f-ee92-4c4f-b1d5-17a53c4d90a4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:17.769398 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c73524-2a2a-46dc-af87-4a13c7829f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:17.770031 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c73524-2a2a-46dc-af87-4a13c7829f73 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:17.770311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c73524-2a2a-46dc-af87-4a13c7829f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:17.770588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c73524-2a2a-46dc-af87-4a13c7829f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.779928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c73524-2a2a-46dc-af87-4a13c7829f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:17.781387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c73524-2a2a-46dc-af87-4a13c7829f73 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:17.790597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1236/2462] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:17.872363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11024db7-e5c7-4d86-917d-0489e5cacc7c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:17.882546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11024db7-e5c7-4d86-917d-0489e5cacc7c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:17.886059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06da0-f4af-41c4-81eb-376e4b9059b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:17.886661 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06da0-f4af-41c4-81eb-376e4b9059b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:17.886940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06da0-f4af-41c4-81eb-376e4b9059b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:17.887211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06da0-f4af-41c4-81eb-376e4b9059b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.942859 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec06da0-f4af-41c4-81eb-376e4b9059b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:17.944312 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec06da0-f4af-41c4-81eb-376e4b9059b2 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:17.953008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1227/2463] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:22.660265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c73524-2a2a-46dc-af87-4a13c7829f73 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:22.710712 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:22.726102 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c73524-2a2a-46dc-af87-4a13c7829f73 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:22.730929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:22.731574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:22.731932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:22.732250 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] PATH_INFO: `/v3/users/cc75d01d18544ce49f1c2c7ffe79d961` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:22.733441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc75d01d18544ce49f1c2c7ffe79d961)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:22.735428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:22.781415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc75d01d18544ce49f1c2c7ffe79d961'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:22.781997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc75d01d18544ce49f1c2c7ffe79d961'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:22.789886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc75d01d18544ce49f1c2c7ffe79d961'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:22.802556 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc75d01d18544ce49f1c2c7ffe79d961'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:22.811437 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc75d01d18544ce49f1c2c7ffe79d961'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:22.817763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1237/2464] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:02:22 2022] DELETE /identity/v3/users/cc75d01d18544ce49f1c2c7ffe79d961 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:22.823208 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84cf0d-7f14-4fbe-b1f4-b4d24b9c7ac5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:22.823722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84cf0d-7f14-4fbe-b1f4-b4d24b9c7ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:22.823839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84cf0d-7f14-4fbe-b1f4-b4d24b9c7ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:22.845354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-db84cf0d-7f14-4fbe-b1f4-b4d24b9c7ac5 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:22.846570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-db84cf0d-7f14-4fbe-b1f4-b4d24b9c7ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:22.905360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1228/2465] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:22.915464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:22.916896 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:22.976220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e69b4-b8e0-4730-9a76-31e79b024a7e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:22.979922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32768c6-3960-4f59-a1fd-a35d46ca8ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:22.980579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32768c6-3960-4f59-a1fd-a35d46ca8ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:22.980895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32768c6-3960-4f59-a1fd-a35d46ca8ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:22.981198 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32768c6-3960-4f59-a1fd-a35d46ca8ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:22.992430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32768c6-3960-4f59-a1fd-a35d46ca8ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:22.992740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32768c6-3960-4f59-a1fd-a35d46ca8ff1 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:23.002620 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1238/2466] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:23.271822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84cf0d-7f14-4fbe-b1f4-b4d24b9c7ac5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:23.273475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-db84cf0d-7f14-4fbe-b1f4-b4d24b9c7ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:23.287274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84cf0d-7f14-4fbe-b1f4-b4d24b9c7ac5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:23.292351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:23.293037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.293320 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.293599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] PATH_INFO: `/v3/projects/dc8af94bd0c0412c9761dec6d292465b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.294802 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8af94bd0c0412c9761dec6d292465b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:23.296982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:23.342256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:23.343486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8af94bd0c0412c9761dec6d292465b', 'request_id': 'req-f140f0f3-7895-4132-b65b-bddcbbe0ae40'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.350284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8af94bd0c0412c9761dec6d292465b', 'request_id': 'req-f140f0f3-7895-4132-b65b-bddcbbe0ae40'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.356391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8af94bd0c0412c9761dec6d292465b', 'request_id': 'req-f140f0f3-7895-4132-b65b-bddcbbe0ae40'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.369522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] The token cache is being invalidate because project dc8af94bd0c0412c9761dec6d292465b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:02:23.369812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.370430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.371927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1229/2467] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:02:23 2022] DELETE /identity/v3/projects/dc8af94bd0c0412c9761dec6d292465b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:23.376035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32768c6-3960-4f59-a1fd-a35d46ca8ff1 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:23.385929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32768c6-3960-4f59-a1fd-a35d46ca8ff1 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:23.443251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fb2c6-e2e7-4ac7-9a8f-f0b6f3192ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:23.443890 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fb2c6-e2e7-4ac7-9a8f-f0b6f3192ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.444214 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fb2c6-e2e7-4ac7-9a8f-f0b6f3192ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.444582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fb2c6-e2e7-4ac7-9a8f-f0b6f3192ce1 admin admin] PATH_INFO: `/v3/users/44d10406a92444e398b55aa117330b0f` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.445744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fb2c6-e2e7-4ac7-9a8f-f0b6f3192ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d10406a92444e398b55aa117330b0f)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:23.447684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fb2c6-e2e7-4ac7-9a8f-f0b6f3192ce1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:23.461524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:23.495501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f63fb2c6-e2e7-4ac7-9a8f-f0b6f3192ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d10406a92444e398b55aa117330b0f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.496170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f63fb2c6-e2e7-4ac7-9a8f-f0b6f3192ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d10406a92444e398b55aa117330b0f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.503808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f63fb2c6-e2e7-4ac7-9a8f-f0b6f3192ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d10406a92444e398b55aa117330b0f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.517232 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f63fb2c6-e2e7-4ac7-9a8f-f0b6f3192ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d10406a92444e398b55aa117330b0f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.524782 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f63fb2c6-e2e7-4ac7-9a8f-f0b6f3192ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d10406a92444e398b55aa117330b0f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.530693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1239/2468] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:02:23 2022] DELETE /identity/v3/users/44d10406a92444e398b55aa117330b0f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:23.805314 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:23.806760 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:23.823114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140f0f3-7895-4132-b65b-bddcbbe0ae40 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:23.881290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935aede-7f62-4070-b4cd-fb05b9fe4661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:23.881937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935aede-7f62-4070-b4cd-fb05b9fe4661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.882216 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935aede-7f62-4070-b4cd-fb05b9fe4661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.882499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935aede-7f62-4070-b4cd-fb05b9fe4661 admin admin] PATH_INFO: `/v3/projects/ed89529f2aa64bdc9798da8d97a2bf77` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.883661 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935aede-7f62-4070-b4cd-fb05b9fe4661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed89529f2aa64bdc9798da8d97a2bf77)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:23.885601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935aede-7f62-4070-b4cd-fb05b9fe4661 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:23.932176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d935aede-7f62-4070-b4cd-fb05b9fe4661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed89529f2aa64bdc9798da8d97a2bf77', 'request_id': 'req-d935aede-7f62-4070-b4cd-fb05b9fe4661'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.937657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d935aede-7f62-4070-b4cd-fb05b9fe4661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed89529f2aa64bdc9798da8d97a2bf77', 'request_id': 'req-d935aede-7f62-4070-b4cd-fb05b9fe4661'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.943855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d935aede-7f62-4070-b4cd-fb05b9fe4661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed89529f2aa64bdc9798da8d97a2bf77', 'request_id': 'req-d935aede-7f62-4070-b4cd-fb05b9fe4661'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.957643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d935aede-7f62-4070-b4cd-fb05b9fe4661 admin admin] The token cache is being invalidate because project ed89529f2aa64bdc9798da8d97a2bf77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:02:23.957934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d935aede-7f62-4070-b4cd-fb05b9fe4661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.958569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d935aede-7f62-4070-b4cd-fb05b9fe4661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:23.960071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1230/2469] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:02:23 2022] DELETE /identity/v3/projects/ed89529f2aa64bdc9798da8d97a2bf77 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:02:23.965027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d864c6d-56f0-413c-a4ba-5892c646c3b5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.965480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d864c6d-56f0-413c-a4ba-5892c646c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.965622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d864c6d-56f0-413c-a4ba-5892c646c3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.985726 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0d864c6d-56f0-413c-a4ba-5892c646c3b5 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:23.986920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0d864c6d-56f0-413c-a4ba-5892c646c3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:24.046270 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1240/2470] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:24.054890 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baffaa4-8cd4-4fbe-9217-2eb9bf28399f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.055123 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baffaa4-8cd4-4fbe-9217-2eb9bf28399f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.055409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baffaa4-8cd4-4fbe-9217-2eb9bf28399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.076904 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6baffaa4-8cd4-4fbe-9217-2eb9bf28399f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:24.078120 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6baffaa4-8cd4-4fbe-9217-2eb9bf28399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:24.086802 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1231/2471] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:24.090801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d864c6d-56f0-413c-a4ba-5892c646c3b5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:24.100876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d864c6d-56f0-413c-a4ba-5892c646c3b5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:24.105562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b929-160c-4c74-b9d5-854879c7a297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:24.106184 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b929-160c-4c74-b9d5-854879c7a297 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.106472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b929-160c-4c74-b9d5-854879c7a297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.106754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b929-160c-4c74-b9d5-854879c7a297 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.107451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88b929-160c-4c74-b9d5-854879c7a297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:24.107761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88b929-160c-4c74-b9d5-854879c7a297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:24.109405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88b929-160c-4c74-b9d5-854879c7a297 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:24.122361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1241/2472] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:24.128772 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baffaa4-8cd4-4fbe-9217-2eb9bf28399f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:24.138038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baffaa4-8cd4-4fbe-9217-2eb9bf28399f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:24.143360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc039d6c-cdc5-4161-8a98-2a41d49ee9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:24.143979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc039d6c-cdc5-4161-8a98-2a41d49ee9cf admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.144310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc039d6c-cdc5-4161-8a98-2a41d49ee9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.144592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc039d6c-cdc5-4161-8a98-2a41d49ee9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.145250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc039d6c-cdc5-4161-8a98-2a41d49ee9cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:24.147151 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc039d6c-cdc5-4161-8a98-2a41d49ee9cf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:24.178321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1232/2473] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:02:24 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:24.179819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b929-160c-4c74-b9d5-854879c7a297 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:24.190046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b929-160c-4c74-b9d5-854879c7a297 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:24.248249 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dd94-3945-453d-be45-329fa195ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:24.248867 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dd94-3945-453d-be45-329fa195ff55 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.249153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dd94-3945-453d-be45-329fa195ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.249432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dd94-3945-453d-be45-329fa195ff55 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.250088 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dd94-3945-453d-be45-329fa195ff55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:24.252004 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dd94-3945-453d-be45-329fa195ff55 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:24.272480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1242/2474] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:02:24 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:24.276616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc039d6c-cdc5-4161-8a98-2a41d49ee9cf admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:24.287475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc039d6c-cdc5-4161-8a98-2a41d49ee9cf admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:24.292091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800cacc-2e9f-40b2-97a5-521654bd18b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:24.292737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800cacc-2e9f-40b2-97a5-521654bd18b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.293023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800cacc-2e9f-40b2-97a5-521654bd18b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.293301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800cacc-2e9f-40b2-97a5-521654bd18b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.293991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800cacc-2e9f-40b2-97a5-521654bd18b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:24.295612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800cacc-2e9f-40b2-97a5-521654bd18b8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:24.306882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1233/2475] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:24.310802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dd94-3945-453d-be45-329fa195ff55 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:24.321091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dd94-3945-453d-be45-329fa195ff55 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:24.325622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d3dea-f1ea-484b-8251-b2aa5dcb5951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:24.326221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d3dea-f1ea-484b-8251-b2aa5dcb5951 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.326500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d3dea-f1ea-484b-8251-b2aa5dcb5951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.326773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d3dea-f1ea-484b-8251-b2aa5dcb5951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.327463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d3dea-f1ea-484b-8251-b2aa5dcb5951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:24.329086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d3dea-f1ea-484b-8251-b2aa5dcb5951 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:24.330329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:24.341682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1243/2476] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:24.345280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800cacc-2e9f-40b2-97a5-521654bd18b8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:24.355603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800cacc-2e9f-40b2-97a5-521654bd18b8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:24.360035 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a27e7-df84-46a0-a19a-9620a478ea36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:24.360766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a27e7-df84-46a0-a19a-9620a478ea36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.361006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a27e7-df84-46a0-a19a-9620a478ea36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.361279 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a27e7-df84-46a0-a19a-9620a478ea36 admin admin] PATH_INFO: `/v3/projects/bfcc49719f3b4f43ae98e8229af82c03/users/f74c13ed9b4740129f9315a739ecbdef/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.376060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a27e7-df84-46a0-a19a-9620a478ea36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcc49719f3b4f43ae98e8229af82c03, user_id=f74c13ed9b4740129f9315a739ecbdef, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:24.378702 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a27e7-df84-46a0-a19a-9620a478ea36 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:24.391436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1234/2477] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:24 2022] PUT /identity/v3/projects/bfcc49719f3b4f43ae98e8229af82c03/users/f74c13ed9b4740129f9315a739ecbdef/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:02:24.396639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70daa-0f53-4bd5-bf1d-232f5bb93695 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.396934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70daa-0f53-4bd5-bf1d-232f5bb93695 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.397215 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70daa-0f53-4bd5-bf1d-232f5bb93695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.416929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-46e70daa-0f53-4bd5-bf1d-232f5bb93695 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:24.418176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-46e70daa-0f53-4bd5-bf1d-232f5bb93695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:24.477649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1244/2478] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:24.487353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a27e7-df84-46a0-a19a-9620a478ea36 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:24.489822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-010a27e7-df84-46a0-a19a-9620a478ea36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:24.495189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:24.548831 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a27e7-df84-46a0-a19a-9620a478ea36 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:24.553089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf26467-dc07-4c34-a0f2-455a6d4fa49c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:24.553711 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf26467-dc07-4c34-a0f2-455a6d4fa49c service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.553996 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf26467-dc07-4c34-a0f2-455a6d4fa49c service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.554276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf26467-dc07-4c34-a0f2-455a6d4fa49c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.563399 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf26467-dc07-4c34-a0f2-455a6d4fa49c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:24.564872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf26467-dc07-4c34-a0f2-455a6d4fa49c service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:24.574899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1235/2479] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:25.720469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35dd1c-fa58-4d34-acc7-b16850bb1b22 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:25.721046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35dd1c-fa58-4d34-acc7-b16850bb1b22 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:25.721046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35dd1c-fa58-4d34-acc7-b16850bb1b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:25.751302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bf35dd1c-fa58-4d34-acc7-b16850bb1b22 None None] MFA Rules not processed for user `f74c13ed9b4740129f9315a739ecbdef`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:25.752566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bf35dd1c-fa58-4d34-acc7-b16850bb1b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:25.837116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1245/2480] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:25.841281 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf26467-dc07-4c34-a0f2-455a6d4fa49c service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:25.851652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf26467-dc07-4c34-a0f2-455a6d4fa49c service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:25.856395 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5901e-5e93-404a-ba64-d4f5e29d9c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:25.856929 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5901e-5e93-404a-ba64-d4f5e29d9c61 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:25.857218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5901e-5e93-404a-ba64-d4f5e29d9c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:25.857499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5901e-5e93-404a-ba64-d4f5e29d9c61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:25.858300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5901e-5e93-404a-ba64-d4f5e29d9c61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:25.860211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5901e-5e93-404a-ba64-d4f5e29d9c61 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:25.889345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1236/2481] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:02:25 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:25.893082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35dd1c-fa58-4d34-acc7-b16850bb1b22 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:25.903858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35dd1c-fa58-4d34-acc7-b16850bb1b22 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:25.960539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394ae9-87f7-40d9-a27a-0a123720e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:25.961159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394ae9-87f7-40d9-a27a-0a123720e564 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:25.961445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394ae9-87f7-40d9-a27a-0a123720e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:25.961725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394ae9-87f7-40d9-a27a-0a123720e564 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:25.962399 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394ae9-87f7-40d9-a27a-0a123720e564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:25.964359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394ae9-87f7-40d9-a27a-0a123720e564 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:25.986603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1246/2482] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:02:25 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:25.991589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5901e-5e93-404a-ba64-d4f5e29d9c61 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:26.001723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5901e-5e93-404a-ba64-d4f5e29d9c61 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:26.006513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f98155-24f3-4827-b523-08c2db2861a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:26.007132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98155-24f3-4827-b523-08c2db2861a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:26.007418 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98155-24f3-4827-b523-08c2db2861a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:26.007731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98155-24f3-4827-b523-08c2db2861a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:26.008510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f98155-24f3-4827-b523-08c2db2861a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:26.010106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f98155-24f3-4827-b523-08c2db2861a8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:26.020976 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1237/2483] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:26.025132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394ae9-87f7-40d9-a27a-0a123720e564 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:26.035554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394ae9-87f7-40d9-a27a-0a123720e564 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:26.040220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90ed9f-4b51-4841-952f-5b47497e3d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:26.040879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90ed9f-4b51-4841-952f-5b47497e3d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:26.041166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90ed9f-4b51-4841-952f-5b47497e3d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:26.041445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90ed9f-4b51-4841-952f-5b47497e3d10 admin admin] PATH_INFO: `/v3/projects/1f86ff11f24e415e927629fee9f7ea44/users/b15e642ad7d7493994c9c99b69fa9481/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:26.054202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:26.057769 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90ed9f-4b51-4841-952f-5b47497e3d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f86ff11f24e415e927629fee9f7ea44, user_id=b15e642ad7d7493994c9c99b69fa9481, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:26.061237 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90ed9f-4b51-4841-952f-5b47497e3d10 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:26.074107 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1247/2484] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:26 2022] PUT /identity/v3/projects/1f86ff11f24e415e927629fee9f7ea44/users/b15e642ad7d7493994c9c99b69fa9481/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:26.078014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f98155-24f3-4827-b523-08c2db2861a8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:26.088335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f98155-24f3-4827-b523-08c2db2861a8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:26.145343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268e726-705e-41ef-a1e2-96da93872603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:26.145966 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268e726-705e-41ef-a1e2-96da93872603 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:26.146250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268e726-705e-41ef-a1e2-96da93872603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:26.146569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268e726-705e-41ef-a1e2-96da93872603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:26.147303 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268e726-705e-41ef-a1e2-96da93872603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:26.149001 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268e726-705e-41ef-a1e2-96da93872603 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:26.158735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1238/2485] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:02:26.163698 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90ed9f-4b51-4841-952f-5b47497e3d10 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:26.173849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90ed9f-4b51-4841-952f-5b47497e3d10 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:26.178383 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8362781-3446-4dbd-90ce-d974b3b69739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:26.179040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8362781-3446-4dbd-90ce-d974b3b69739 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:26.179323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8362781-3446-4dbd-90ce-d974b3b69739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:26.179597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8362781-3446-4dbd-90ce-d974b3b69739 admin admin] PATH_INFO: `/v3/projects/1f86ff11f24e415e927629fee9f7ea44/users/b15e642ad7d7493994c9c99b69fa9481/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:26.181691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8362781-3446-4dbd-90ce-d974b3b69739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f86ff11f24e415e927629fee9f7ea44, user_id=b15e642ad7d7493994c9c99b69fa9481, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:26.184325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8362781-3446-4dbd-90ce-d974b3b69739 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:26.194257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1248/2486] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:02:26 2022] PUT /identity/v3/projects/1f86ff11f24e415e927629fee9f7ea44/users/b15e642ad7d7493994c9c99b69fa9481/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:26.846050 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a80a5-72ec-487e-90bf-9ea6fe811396 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:26.846637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a80a5-72ec-487e-90bf-9ea6fe811396 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:26.846637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a80a5-72ec-487e-90bf-9ea6fe811396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:26.879684 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9c9a80a5-72ec-487e-90bf-9ea6fe811396 None None] MFA Rules not processed for user `b15e642ad7d7493994c9c99b69fa9481`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:26.880949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9c9a80a5-72ec-487e-90bf-9ea6fe811396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:26.949231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:26.961457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1239/2487] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:02:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:26.972687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8362781-3446-4dbd-90ce-d974b3b69739 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:26.974365 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c8362781-3446-4dbd-90ce-d974b3b69739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:27.034537 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8362781-3446-4dbd-90ce-d974b3b69739 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:27.038131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0176-4b04-4f38-a350-9c92acdaf8b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:27.038746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0176-4b04-4f38-a350-9c92acdaf8b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:27.039044 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0176-4b04-4f38-a350-9c92acdaf8b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:27.039303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0176-4b04-4f38-a350-9c92acdaf8b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:27.095031 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0176-4b04-4f38-a350-9c92acdaf8b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:27.096555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0176-4b04-4f38-a350-9c92acdaf8b6 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:27.105514 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1249/2488] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:28.451956 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a80a5-72ec-487e-90bf-9ea6fe811396 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:28.453984 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9c9a80a5-72ec-487e-90bf-9ea6fe811396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:28.467445 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a80a5-72ec-487e-90bf-9ea6fe811396 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:28.471129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae22e5-9f2f-433c-8a9a-386adf550e44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:28.471829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae22e5-9f2f-433c-8a9a-386adf550e44 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:28.472149 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae22e5-9f2f-433c-8a9a-386adf550e44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:28.472432 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae22e5-9f2f-433c-8a9a-386adf550e44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:28.482069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae22e5-9f2f-433c-8a9a-386adf550e44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:28.483499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae22e5-9f2f-433c-8a9a-386adf550e44 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:28.493488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1240/2489] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:28.537868 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0176-4b04-4f38-a350-9c92acdaf8b6 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:28.539370 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-26bc0176-4b04-4f38-a350-9c92acdaf8b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:28.666477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0176-4b04-4f38-a350-9c92acdaf8b6 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:28.671932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48d8e8-3ce3-4458-893d-5280a0c54df2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:28.672593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48d8e8-3ce3-4458-893d-5280a0c54df2 service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:28.672876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48d8e8-3ce3-4458-893d-5280a0c54df2 service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:28.673289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48d8e8-3ce3-4458-893d-5280a0c54df2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:28.675886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5a48d8e8-3ce3-4458-893d-5280a0c54df2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:28.688477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48d8e8-3ce3-4458-893d-5280a0c54df2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:28.690080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48d8e8-3ce3-4458-893d-5280a0c54df2 service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:28.703126 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1250/2490] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:38.489498 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=9 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:38.697259 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:41.231111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae22e5-9f2f-433c-8a9a-386adf550e44 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:41.232678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-10ae22e5-9f2f-433c-8a9a-386adf550e44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:41.247648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae22e5-9f2f-433c-8a9a-386adf550e44 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:41.252727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953cef2-4046-49e2-a7b0-e5b46b12e9a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:41.253852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953cef2-4046-49e2-a7b0-e5b46b12e9a0 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:41.254141 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953cef2-4046-49e2-a7b0-e5b46b12e9a0 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:41.254422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953cef2-4046-49e2-a7b0-e5b46b12e9a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:41.256168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2953cef2-4046-49e2-a7b0-e5b46b12e9a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:41.268203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953cef2-4046-49e2-a7b0-e5b46b12e9a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:41.269779 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953cef2-4046-49e2-a7b0-e5b46b12e9a0 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:41.280254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1241/2491] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:41.856135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48d8e8-3ce3-4458-893d-5280a0c54df2 service placement] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:41.928625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48d8e8-3ce3-4458-893d-5280a0c54df2 service placement] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:41.933164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:41.933805 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:41.934080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:41.934351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] PATH_INFO: `/v3/users/f74c13ed9b4740129f9315a739ecbdef` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:41.935515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74c13ed9b4740129f9315a739ecbdef)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:41.937608 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:41.987744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74c13ed9b4740129f9315a739ecbdef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:41.988421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74c13ed9b4740129f9315a739ecbdef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:41.998327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74c13ed9b4740129f9315a739ecbdef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.010630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74c13ed9b4740129f9315a739ecbdef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.017392 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74c13ed9b4740129f9315a739ecbdef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.023828 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1251/2492] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:02:41 2022] DELETE /identity/v3/users/f74c13ed9b4740129f9315a739ecbdef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:42.294476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953cef2-4046-49e2-a7b0-e5b46b12e9a0 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:42.305932 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953cef2-4046-49e2-a7b0-e5b46b12e9a0 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:42.374998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:42.375770 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:42.376370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:42.376744 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] PATH_INFO: `/v3/projects/bfcc49719f3b4f43ae98e8229af82c03` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:42.379399 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfcc49719f3b4f43ae98e8229af82c03)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:42.381612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:42.439152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfcc49719f3b4f43ae98e8229af82c03', 'request_id': 'req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.451253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfcc49719f3b4f43ae98e8229af82c03', 'request_id': 'req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.460630 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfcc49719f3b4f43ae98e8229af82c03', 'request_id': 'req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.476908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] The token cache is being invalidate because project bfcc49719f3b4f43ae98e8229af82c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:02:42.477311 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.478079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.483037 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1242/2493] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:02:42 2022] DELETE /identity/v3/projects/bfcc49719f3b4f43ae98e8229af82c03 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:42.484331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:42.485845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:42.500702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3df315-f197-4377-8a6f-942ad877d043 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:42.568930 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e32e9-d8f4-468d-8b0c-f4d5aafa40ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:42.569746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e32e9-d8f4-468d-8b0c-f4d5aafa40ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:42.570058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e32e9-d8f4-468d-8b0c-f4d5aafa40ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:42.570387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e32e9-d8f4-468d-8b0c-f4d5aafa40ab admin admin] PATH_INFO: `/v3/users/b15e642ad7d7493994c9c99b69fa9481` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:42.572207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e32e9-d8f4-468d-8b0c-f4d5aafa40ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15e642ad7d7493994c9c99b69fa9481)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:42.574169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e32e9-d8f4-468d-8b0c-f4d5aafa40ab admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:42.596727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:42.622777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7e7e32e9-d8f4-468d-8b0c-f4d5aafa40ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15e642ad7d7493994c9c99b69fa9481'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.623386 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7e7e32e9-d8f4-468d-8b0c-f4d5aafa40ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15e642ad7d7493994c9c99b69fa9481'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.631164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7e7e32e9-d8f4-468d-8b0c-f4d5aafa40ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15e642ad7d7493994c9c99b69fa9481'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.643981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7e7e32e9-d8f4-468d-8b0c-f4d5aafa40ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15e642ad7d7493994c9c99b69fa9481'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.650956 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7e7e32e9-d8f4-468d-8b0c-f4d5aafa40ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15e642ad7d7493994c9c99b69fa9481'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.656880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1252/2494] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:02:42 2022] DELETE /identity/v3/users/b15e642ad7d7493994c9c99b69fa9481 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:02:42.832854 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:42.834293 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:42.847686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5ccd9-4da9-48d2-b17b-ee86f92e6766 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:42.905435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:42.905992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:42.906271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:42.906541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] PATH_INFO: `/v3/projects/1f86ff11f24e415e927629fee9f7ea44` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:42.907674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f86ff11f24e415e927629fee9f7ea44)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:42.909728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:42.930421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:42.956237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f86ff11f24e415e927629fee9f7ea44', 'request_id': 'req-89c18c58-d703-4076-a774-1d848664078f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.961889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f86ff11f24e415e927629fee9f7ea44', 'request_id': 'req-89c18c58-d703-4076-a774-1d848664078f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.967874 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f86ff11f24e415e927629fee9f7ea44', 'request_id': 'req-89c18c58-d703-4076-a774-1d848664078f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.979680 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] The token cache is being invalidate because project 1f86ff11f24e415e927629fee9f7ea44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:02:42.979963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.980604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:02:42.982110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1243/2495] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:02:42 2022] DELETE /identity/v3/projects/1f86ff11f24e415e927629fee9f7ea44 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:52.653426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:52.976844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:58.989273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3896d-d887-4f58-8d33-611f6b9f6ebe None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:58.989824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3896d-d887-4f58-8d33-611f6b9f6ebe None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:58.989824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3896d-d887-4f58-8d33-611f6b9f6ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.020641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a5c3896d-d887-4f58-8d33-611f6b9f6ebe None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:59.021861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a5c3896d-d887-4f58-8d33-611f6b9f6ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:59.083202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1253/2496] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 09:02:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:59.130450 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:59.131832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:59.202256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c18c58-d703-4076-a774-1d848664078f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:59.207637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c174b-31de-46a6-8e0c-1248fa73a3d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:59.208290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c174b-31de-46a6-8e0c-1248fa73a3d6 service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:59.208647 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c174b-31de-46a6-8e0c-1248fa73a3d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:59.208928 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c174b-31de-46a6-8e0c-1248fa73a3d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.217911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c174b-31de-46a6-8e0c-1248fa73a3d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:59.219533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c174b-31de-46a6-8e0c-1248fa73a3d6 service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:59.228236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1244/2497] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 09:02:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:03:09.076096 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=32 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:09.224968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=32 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:14.241842 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa482b-ef90-4c84-925b-a00582b1dd27 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.242416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa482b-ef90-4c84-925b-a00582b1dd27 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.242416 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa482b-ef90-4c84-925b-a00582b1dd27 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.243740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1254/2498] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 09:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:14.251321 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf9e4c-2ced-4138-a4e1-723ca8fe420f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.251821 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf9e4c-2ced-4138-a4e1-723ca8fe420f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.252042 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf9e4c-2ced-4138-a4e1-723ca8fe420f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.292053 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-79cf9e4c-2ced-4138-a4e1-723ca8fe420f None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:14.293006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-79cf9e4c-2ced-4138-a4e1-723ca8fe420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:14.381727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1245/2499] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:14.392864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa482b-ef90-4c84-925b-a00582b1dd27 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:14.394554 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-39fa482b-ef90-4c84-925b-a00582b1dd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:14.454159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa482b-ef90-4c84-925b-a00582b1dd27 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:14.458962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45356c49-43da-426e-a23e-99938701321d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b08a946b43f08028c5da415d4e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:14.459564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45356c49-43da-426e-a23e-99938701321d service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.459884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45356c49-43da-426e-a23e-99938701321d service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.460287 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45356c49-43da-426e-a23e-99938701321d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.470908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45356c49-43da-426e-a23e-99938701321d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:14.472414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45356c49-43da-426e-a23e-99938701321d service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:14.483216 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1255/2500] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:14.551120 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937314c-11d0-4ce3-9889-78bbccea8dbc None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.551941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937314c-11d0-4ce3-9889-78bbccea8dbc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.552253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937314c-11d0-4ce3-9889-78bbccea8dbc None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.553669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1246/2501] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 09:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:14.558380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fd5dd-08d5-4a5a-8320-b8ed72231886 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.558671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fd5dd-08d5-4a5a-8320-b8ed72231886 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.558952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fd5dd-08d5-4a5a-8320-b8ed72231886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.579057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-042fd5dd-08d5-4a5a-8320-b8ed72231886 None None] MFA Rules not processed for user `c9162dcfb8d542679c7217fae8f5c185`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:14.580294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-042fd5dd-08d5-4a5a-8320-b8ed72231886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:14.631280 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1256/2502] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:14.643017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937314c-11d0-4ce3-9889-78bbccea8dbc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:14.644697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0937314c-11d0-4ce3-9889-78bbccea8dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:14.657658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937314c-11d0-4ce3-9889-78bbccea8dbc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:14.661183 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cb9b9-826b-4ac2-a9db-d657ba326cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:14.661825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cb9b9-826b-4ac2-a9db-d657ba326cea service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.662103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cb9b9-826b-4ac2-a9db-d657ba326cea service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.662376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cb9b9-826b-4ac2-a9db-d657ba326cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.669408 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cb9b9-826b-4ac2-a9db-d657ba326cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:14.670814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cb9b9-826b-4ac2-a9db-d657ba326cea service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:14.678991 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1247/2503] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:14.763699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ee9c4-ccd3-4787-a93d-221ce038f584 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.763994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ee9c4-ccd3-4787-a93d-221ce038f584 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.764313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ee9c4-ccd3-4787-a93d-221ce038f584 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.765654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1257/2504] 10.222.0.17 () {54 vars in 921 bytes} [Tue Aug 2 09:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:14.770683 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548c39-c1d0-4b01-bd9a-8e1f51a118a8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.770980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548c39-c1d0-4b01-bd9a-8e1f51a118a8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.771264 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548c39-c1d0-4b01-bd9a-8e1f51a118a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.790642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-96548c39-c1d0-4b01-bd9a-8e1f51a118a8 None None] MFA Rules not processed for user `e1de289ba7ae4140a421127b8f18901f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:14.791827 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-96548c39-c1d0-4b01-bd9a-8e1f51a118a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:14.801207 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1248/2505] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Aug 2 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:14.813090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ee9c4-ccd3-4787-a93d-221ce038f584 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:14.814918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-999ee9c4-ccd3-4787-a93d-221ce038f584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:14.829277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ee9c4-ccd3-4787-a93d-221ce038f584 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:14.833151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c3eee-1f74-46c7-a220-2b5f187cde44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:14.833760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c3eee-1f74-46c7-a220-2b5f187cde44 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.834046 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c3eee-1f74-46c7-a220-2b5f187cde44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.834325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c3eee-1f74-46c7-a220-2b5f187cde44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.844694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c3eee-1f74-46c7-a220-2b5f187cde44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:14.846144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c3eee-1f74-46c7-a220-2b5f187cde44 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:14.857699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1258/2506] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:16.771940 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb693d-1faf-4148-be0e-6b75587578bb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.772444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb693d-1faf-4148-be0e-6b75587578bb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.772570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb693d-1faf-4148-be0e-6b75587578bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.791651 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3dfb693d-1faf-4148-be0e-6b75587578bb None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:16.792864 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3dfb693d-1faf-4148-be0e-6b75587578bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:16.800466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1249/2507] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 09:03:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:16.812427 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c3eee-1f74-46c7-a220-2b5f187cde44 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:16.823792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c3eee-1f74-46c7-a220-2b5f187cde44 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:16.828746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c47934-870e-4e17-aa04-23f31b063436 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:16.829349 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c47934-870e-4e17-aa04-23f31b063436 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.829660 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c47934-870e-4e17-aa04-23f31b063436 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.829936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c47934-870e-4e17-aa04-23f31b063436 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.838603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c47934-870e-4e17-aa04-23f31b063436 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:16.840205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c47934-870e-4e17-aa04-23f31b063436 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:16.848724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1259/2508] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 09:03:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:03:26.786028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=52 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:26.845050 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=61 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:36.952399 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb693d-1faf-4148-be0e-6b75587578bb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:36.962475 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb693d-1faf-4148-be0e-6b75587578bb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:36.966019 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b166bcf-a76d-412b-bf72-6334cc081d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:36.966629 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b166bcf-a76d-412b-bf72-6334cc081d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:36.966915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b166bcf-a76d-412b-bf72-6334cc081d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:36.967191 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b166bcf-a76d-412b-bf72-6334cc081d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:36.968971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1b166bcf-a76d-412b-bf72-6334cc081d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:36.982555 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b166bcf-a76d-412b-bf72-6334cc081d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:36.983976 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b166bcf-a76d-412b-bf72-6334cc081d7f service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:36.994792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1250/2509] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:38.181673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c47934-870e-4e17-aa04-23f31b063436 service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:38.191828 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c47934-870e-4e17-aa04-23f31b063436 service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:38.195513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150af079-55dc-4e85-b4d8-3c85b10d3e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:38.196157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150af079-55dc-4e85-b4d8-3c85b10d3e5c service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.196559 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150af079-55dc-4e85-b4d8-3c85b10d3e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.197061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150af079-55dc-4e85-b4d8-3c85b10d3e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.199724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-150af079-55dc-4e85-b4d8-3c85b10d3e5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:38.214376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150af079-55dc-4e85-b4d8-3c85b10d3e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:38.215811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150af079-55dc-4e85-b4d8-3c85b10d3e5c service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:38.229701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1260/2510] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:38.395416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a585b51-d43f-4dda-95e6-7d95016a15d8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.395882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a585b51-d43f-4dda-95e6-7d95016a15d8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.396141 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a585b51-d43f-4dda-95e6-7d95016a15d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.415968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4a585b51-d43f-4dda-95e6-7d95016a15d8 None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:38.417255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4a585b51-d43f-4dda-95e6-7d95016a15d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:38.424362 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1251/2511] 10.222.0.17 () {58 vars in 967 bytes} [Tue Aug 2 09:03:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:38.436906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150af079-55dc-4e85-b4d8-3c85b10d3e5c service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:38.448984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150af079-55dc-4e85-b4d8-3c85b10d3e5c service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:38.453889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8e052-d3fc-4598-9c14-c9d27f85dcc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:38.454491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8e052-d3fc-4598-9c14-c9d27f85dcc9 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.454773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8e052-d3fc-4598-9c14-c9d27f85dcc9 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.455047 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8e052-d3fc-4598-9c14-c9d27f85dcc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.464651 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8e052-d3fc-4598-9c14-c9d27f85dcc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:38.466252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8e052-d3fc-4598-9c14-c9d27f85dcc9 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:38.474216 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1261/2512] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 09:03:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:03:39.369663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a585b51-d43f-4dda-95e6-7d95016a15d8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:39.371059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4a585b51-d43f-4dda-95e6-7d95016a15d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:39.386910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a585b51-d43f-4dda-95e6-7d95016a15d8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:39.392263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cacdf-7aa2-4dc6-9fb6-8912b3495edd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:39.392871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cacdf-7aa2-4dc6-9fb6-8912b3495edd service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:39.393152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cacdf-7aa2-4dc6-9fb6-8912b3495edd service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:39.393427 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cacdf-7aa2-4dc6-9fb6-8912b3495edd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:39.395221 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-997cacdf-7aa2-4dc6-9fb6-8912b3495edd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:39.476215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cacdf-7aa2-4dc6-9fb6-8912b3495edd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:39.478354 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cacdf-7aa2-4dc6-9fb6-8912b3495edd service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:39.497686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1252/2513] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:48.471092 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=12 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:49.495092 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=50 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:54.507715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb4cfb-6a8e-4ddd-9e1c-0dcfffeb01c8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.508257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb4cfb-6a8e-4ddd-9e1c-0dcfffeb01c8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.508507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb4cfb-6a8e-4ddd-9e1c-0dcfffeb01c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.527139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4afb4cfb-6a8e-4ddd-9e1c-0dcfffeb01c8 None None] MFA Rules not processed for user `f01062e92f974dc890897d19359e7e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:54.528363 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4afb4cfb-6a8e-4ddd-9e1c-0dcfffeb01c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:54.582931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1262/2514] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:03:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:58.065862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cacdf-7aa2-4dc6-9fb6-8912b3495edd service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:58.076919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cacdf-7aa2-4dc6-9fb6-8912b3495edd service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:58.080585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46a9f8-7290-48da-aa81-99098f35fa67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:58.081515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46a9f8-7290-48da-aa81-99098f35fa67 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:58.081923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46a9f8-7290-48da-aa81-99098f35fa67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:58.082326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46a9f8-7290-48da-aa81-99098f35fa67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.084095 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5f46a9f8-7290-48da-aa81-99098f35fa67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:58.094308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46a9f8-7290-48da-aa81-99098f35fa67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:58.095717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46a9f8-7290-48da-aa81-99098f35fa67 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:58.103832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1253/2515] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:02.609015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb4cfb-6a8e-4ddd-9e1c-0dcfffeb01c8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:02.619421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb4cfb-6a8e-4ddd-9e1c-0dcfffeb01c8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:02.623075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca7d2-c6e7-4fdd-a5da-ee6df958c188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:02.623685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca7d2-c6e7-4fdd-a5da-ee6df958c188 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:02.623970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca7d2-c6e7-4fdd-a5da-ee6df958c188 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:02.624284 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca7d2-c6e7-4fdd-a5da-ee6df958c188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:02.626071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9a9ca7d2-c6e7-4fdd-a5da-ee6df958c188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:02.689979 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ca7d2-c6e7-4fdd-a5da-ee6df958c188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:02.691551 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ca7d2-c6e7-4fdd-a5da-ee6df958c188 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:02.702253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1263/2516] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:06.091625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46a9f8-7290-48da-aa81-99098f35fa67 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.093047 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5f46a9f8-7290-48da-aa81-99098f35fa67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:06.107829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46a9f8-7290-48da-aa81-99098f35fa67 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.112579 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abe3ea-b086-462e-bed1-65d26c9fee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.113208 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abe3ea-b086-462e-bed1-65d26c9fee3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.113455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abe3ea-b086-462e-bed1-65d26c9fee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.113731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abe3ea-b086-462e-bed1-65d26c9fee3d admin admin] PATH_INFO: `/v3/users/2b15c4ba64ca4097a4cdb653fdb94d78` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.131607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abe3ea-b086-462e-bed1-65d26c9fee3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b15c4ba64ca4097a4cdb653fdb94d78)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.133608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abe3ea-b086-462e-bed1-65d26c9fee3d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.182960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-64abe3ea-b086-462e-bed1-65d26c9fee3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b15c4ba64ca4097a4cdb653fdb94d78'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:06.183611 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-64abe3ea-b086-462e-bed1-65d26c9fee3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b15c4ba64ca4097a4cdb653fdb94d78'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:06.202327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-64abe3ea-b086-462e-bed1-65d26c9fee3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b15c4ba64ca4097a4cdb653fdb94d78'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:06.209877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-64abe3ea-b086-462e-bed1-65d26c9fee3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b15c4ba64ca4097a4cdb653fdb94d78'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:06.216672 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-64abe3ea-b086-462e-bed1-65d26c9fee3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b15c4ba64ca4097a4cdb653fdb94d78'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:06.222484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1254/2517] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:06 2022] DELETE /identity/v3/users/2b15c4ba64ca4097a4cdb653fdb94d78 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:06.398870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca7d2-c6e7-4fdd-a5da-ee6df958c188 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.409215 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca7d2-c6e7-4fdd-a5da-ee6df958c188 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.477758 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.478418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.478697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.478971 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014 admin admin] PATH_INFO: `/v3/projects/7f068d1fec9a4e55b60cd782cf4ecf89` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.490590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f068d1fec9a4e55b60cd782cf4ecf89)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.493168 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.528778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:06.543166 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f068d1fec9a4e55b60cd782cf4ecf89', 'request_id': 'req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:06.548633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f068d1fec9a4e55b60cd782cf4ecf89', 'request_id': 'req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:06.557424 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f068d1fec9a4e55b60cd782cf4ecf89', 'request_id': 'req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:06.569584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014 admin admin] The token cache is being invalidate because project 7f068d1fec9a4e55b60cd782cf4ecf89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:06.569873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:06.570504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-11f7bf7e-0b09-42b4-9bb2-47aea32d3014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:06.572026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1264/2518] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:06 2022] DELETE /identity/v3/projects/7f068d1fec9a4e55b60cd782cf4ecf89 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:06.576937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9948e9-e6f9-46a8-940b-0e2072f4de37 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.577256 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9948e9-e6f9-46a8-940b-0e2072f4de37 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.577537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9948e9-e6f9-46a8-940b-0e2072f4de37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.597136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ae9948e9-e6f9-46a8-940b-0e2072f4de37 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:06.598329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ae9948e9-e6f9-46a8-940b-0e2072f4de37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:06.657262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1255/2519] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:06.665511 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255103d3-9404-4005-bbfc-b735ea2095f6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.665785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255103d3-9404-4005-bbfc-b735ea2095f6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.666064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255103d3-9404-4005-bbfc-b735ea2095f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.685841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-255103d3-9404-4005-bbfc-b735ea2095f6 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:06.687053 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-255103d3-9404-4005-bbfc-b735ea2095f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:06.694997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1265/2520] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:06.699186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9948e9-e6f9-46a8-940b-0e2072f4de37 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.709159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9948e9-e6f9-46a8-940b-0e2072f4de37 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.717466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bd857-8596-453d-a7f0-c1ed93b5110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.718079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bd857-8596-453d-a7f0-c1ed93b5110a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.718364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bd857-8596-453d-a7f0-c1ed93b5110a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.718636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bd857-8596-453d-a7f0-c1ed93b5110a admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.719326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bd857-8596-453d-a7f0-c1ed93b5110a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:06.719630 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bd857-8596-453d-a7f0-c1ed93b5110a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.721277 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bd857-8596-453d-a7f0-c1ed93b5110a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.733785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1256/2521] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:06.739571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255103d3-9404-4005-bbfc-b735ea2095f6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.749664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255103d3-9404-4005-bbfc-b735ea2095f6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.754228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750cab9-8e7e-4d91-8361-c060cf6f276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.754829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750cab9-8e7e-4d91-8361-c060cf6f276b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.755108 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750cab9-8e7e-4d91-8361-c060cf6f276b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.755380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750cab9-8e7e-4d91-8361-c060cf6f276b admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.756032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750cab9-8e7e-4d91-8361-c060cf6f276b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.757977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750cab9-8e7e-4d91-8361-c060cf6f276b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.795069 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1266/2522] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:06 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:06.799409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bd857-8596-453d-a7f0-c1ed93b5110a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.810356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bd857-8596-453d-a7f0-c1ed93b5110a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.842728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:06.870450 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b37f-3f5d-4634-97e9-3a3b08d083ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.871066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b37f-3f5d-4634-97e9-3a3b08d083ec admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.871349 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b37f-3f5d-4634-97e9-3a3b08d083ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.871632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b37f-3f5d-4634-97e9-3a3b08d083ec admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.872461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82b37f-3f5d-4634-97e9-3a3b08d083ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.874395 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82b37f-3f5d-4634-97e9-3a3b08d083ec admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.895794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1257/2523] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:06 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:06.900483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750cab9-8e7e-4d91-8361-c060cf6f276b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.910870 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750cab9-8e7e-4d91-8361-c060cf6f276b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.916065 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c474850-d745-46fa-aea0-df4db6598d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.916709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c474850-d745-46fa-aea0-df4db6598d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.916995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c474850-d745-46fa-aea0-df4db6598d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.917273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c474850-d745-46fa-aea0-df4db6598d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.918005 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c474850-d745-46fa-aea0-df4db6598d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.919601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c474850-d745-46fa-aea0-df4db6598d5f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.929615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1267/2524] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:06.933483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b37f-3f5d-4634-97e9-3a3b08d083ec admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.943131 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b37f-3f5d-4634-97e9-3a3b08d083ec admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.947646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd153c6d-7f57-4615-a6d0-42bb002b5e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.948274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd153c6d-7f57-4615-a6d0-42bb002b5e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.948556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd153c6d-7f57-4615-a6d0-42bb002b5e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.948825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd153c6d-7f57-4615-a6d0-42bb002b5e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.949504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd153c6d-7f57-4615-a6d0-42bb002b5e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.951059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd153c6d-7f57-4615-a6d0-42bb002b5e33 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.961712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1258/2525] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:06.965924 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c474850-d745-46fa-aea0-df4db6598d5f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.976452 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c474850-d745-46fa-aea0-df4db6598d5f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.981058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86011e6-a7a8-4c1b-839c-d58b24bcf4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.981709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86011e6-a7a8-4c1b-839c-d58b24bcf4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.981990 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86011e6-a7a8-4c1b-839c-d58b24bcf4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.982265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86011e6-a7a8-4c1b-839c-d58b24bcf4ed admin admin] PATH_INFO: `/v3/projects/7ea58a3594cd43bab55f7608e4353eee/users/2901b4e7ec274441ab951e7c87e2df2d/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.996515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86011e6-a7a8-4c1b-839c-d58b24bcf4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea58a3594cd43bab55f7608e4353eee, user_id=2901b4e7ec274441ab951e7c87e2df2d, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.999157 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86011e6-a7a8-4c1b-839c-d58b24bcf4ed admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:07.012722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1268/2526] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:06 2022] PUT /identity/v3/projects/7ea58a3594cd43bab55f7608e4353eee/users/2901b4e7ec274441ab951e7c87e2df2d/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:04:07.023318 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78f77-2b7e-4cf1-b930-e3349a3cea6e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:07.023636 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78f77-2b7e-4cf1-b930-e3349a3cea6e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:07.023910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78f77-2b7e-4cf1-b930-e3349a3cea6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:07.052020 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cbc78f77-2b7e-4cf1-b930-e3349a3cea6e None None] MFA Rules not processed for user `2901b4e7ec274441ab951e7c87e2df2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:07.053269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cbc78f77-2b7e-4cf1-b930-e3349a3cea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:07.116698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1259/2527] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:07.129391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86011e6-a7a8-4c1b-839c-d58b24bcf4ed admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:07.131230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b86011e6-a7a8-4c1b-839c-d58b24bcf4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:07.206679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86011e6-a7a8-4c1b-839c-d58b24bcf4ed admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:07.212303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786014e6-97d6-4f95-b043-97a96f2117ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:07.212925 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786014e6-97d6-4f95-b043-97a96f2117ac service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:07.213206 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786014e6-97d6-4f95-b043-97a96f2117ac service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:07.213483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786014e6-97d6-4f95-b043-97a96f2117ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:07.221602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786014e6-97d6-4f95-b043-97a96f2117ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:07.223208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786014e6-97d6-4f95-b043-97a96f2117ac service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:07.233068 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1269/2528] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:10.003581 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc78f77-2b7e-4cf1-b930-e3349a3cea6e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:10.062625 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc78f77-2b7e-4cf1-b930-e3349a3cea6e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.066972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.067597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.067884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.068186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] PATH_INFO: `/v3/users/2901b4e7ec274441ab951e7c87e2df2d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.069333 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2901b4e7ec274441ab951e7c87e2df2d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:10.071380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.115052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:10.116746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2901b4e7ec274441ab951e7c87e2df2d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:10.117472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2901b4e7ec274441ab951e7c87e2df2d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:10.131218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2901b4e7ec274441ab951e7c87e2df2d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:10.138233 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2901b4e7ec274441ab951e7c87e2df2d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:10.145185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2901b4e7ec274441ab951e7c87e2df2d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:10.151845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1260/2529] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:10 2022] DELETE /identity/v3/users/2901b4e7ec274441ab951e7c87e2df2d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:10.156334 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f7a4-cfcf-49ca-b09f-1bc2b31838b9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.156811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f7a4-cfcf-49ca-b09f-1bc2b31838b9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.156912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f7a4-cfcf-49ca-b09f-1bc2b31838b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.176048 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9ca0f7a4-cfcf-49ca-b09f-1bc2b31838b9 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:10.177279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9ca0f7a4-cfcf-49ca-b09f-1bc2b31838b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:10.211227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:10.244863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1270/2530] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:10.254477 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:10.255886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:10.312227 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de626d-a965-445c-a5c4-a7ce6a57a2a8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.316453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b8275-712b-4e79-837c-fa51993fa9d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.317024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8275-712b-4e79-837c-fa51993fa9d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.317295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8275-712b-4e79-837c-fa51993fa9d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.317566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8275-712b-4e79-837c-fa51993fa9d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.326844 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b8275-712b-4e79-837c-fa51993fa9d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:10.328274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b8275-712b-4e79-837c-fa51993fa9d5 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.338673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1261/2531] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:10.608991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0f7a4-cfcf-49ca-b09f-1bc2b31838b9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:10.610411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9ca0f7a4-cfcf-49ca-b09f-1bc2b31838b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:10.622549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0f7a4-cfcf-49ca-b09f-1bc2b31838b9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.627191 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.627839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.628230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.628515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2 admin admin] PATH_INFO: `/v3/projects/7ea58a3594cd43bab55f7608e4353eee` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.629701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea58a3594cd43bab55f7608e4353eee)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:10.631779 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.678950 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea58a3594cd43bab55f7608e4353eee', 'request_id': 'req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:10.685799 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea58a3594cd43bab55f7608e4353eee', 'request_id': 'req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:10.693770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea58a3594cd43bab55f7608e4353eee', 'request_id': 'req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:10.704983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2 admin admin] The token cache is being invalidate because project 7ea58a3594cd43bab55f7608e4353eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:10.705518 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:10.706152 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-245ad0a6-d0d3-428a-bcc9-c84b34924dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:10.707648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1271/2532] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:10 2022] DELETE /identity/v3/projects/7ea58a3594cd43bab55f7608e4353eee => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:10.713055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb385f-051b-401f-b1a2-786dcd97805e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.713370 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb385f-051b-401f-b1a2-786dcd97805e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.713649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb385f-051b-401f-b1a2-786dcd97805e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.733715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0bcb385f-051b-401f-b1a2-786dcd97805e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:10.734919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0bcb385f-051b-401f-b1a2-786dcd97805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:10.793919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1262/2533] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:10.801909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aeda6-0185-4115-887c-70a60d9dee89 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.802196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aeda6-0185-4115-887c-70a60d9dee89 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.802475 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aeda6-0185-4115-887c-70a60d9dee89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.821955 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c18aeda6-0185-4115-887c-70a60d9dee89 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:10.823143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c18aeda6-0185-4115-887c-70a60d9dee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:10.831448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1272/2534] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:10.836377 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb385f-051b-401f-b1a2-786dcd97805e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:10.846201 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb385f-051b-401f-b1a2-786dcd97805e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.851376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f287c6-5873-44c8-aaa1-c8a33b436460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.852041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f287c6-5873-44c8-aaa1-c8a33b436460 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.852310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f287c6-5873-44c8-aaa1-c8a33b436460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.852590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f287c6-5873-44c8-aaa1-c8a33b436460 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.853288 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f287c6-5873-44c8-aaa1-c8a33b436460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:10.853598 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f287c6-5873-44c8-aaa1-c8a33b436460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:10.855593 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f287c6-5873-44c8-aaa1-c8a33b436460 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.872468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1263/2535] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:10.878296 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aeda6-0185-4115-887c-70a60d9dee89 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:10.887798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aeda6-0185-4115-887c-70a60d9dee89 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.892507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2cbe5-f4e4-43c5-a5b8-9972745fbd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.893131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2cbe5-f4e4-43c5-a5b8-9972745fbd52 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.893400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2cbe5-f4e4-43c5-a5b8-9972745fbd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.893675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2cbe5-f4e4-43c5-a5b8-9972745fbd52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.894369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2cbe5-f4e4-43c5-a5b8-9972745fbd52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:10.896339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2cbe5-f4e4-43c5-a5b8-9972745fbd52 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.923642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1273/2536] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:10 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:10.928849 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f287c6-5873-44c8-aaa1-c8a33b436460 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:10.938764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f287c6-5873-44c8-aaa1-c8a33b436460 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.986921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:10.997381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf65a8f-c6a7-450e-a0b6-2e58a434e6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.998005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf65a8f-c6a7-450e-a0b6-2e58a434e6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.998294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf65a8f-c6a7-450e-a0b6-2e58a434e6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.998573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf65a8f-c6a7-450e-a0b6-2e58a434e6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.999230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf65a8f-c6a7-450e-a0b6-2e58a434e6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.001184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf65a8f-c6a7-450e-a0b6-2e58a434e6b0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.022059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1264/2537] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:10 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:04:11.026888 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2cbe5-f4e4-43c5-a5b8-9972745fbd52 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.037618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2cbe5-f4e4-43c5-a5b8-9972745fbd52 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.042328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742ec5f-e78f-40b5-943c-6d87d89e156f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.042931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742ec5f-e78f-40b5-943c-6d87d89e156f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.043208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742ec5f-e78f-40b5-943c-6d87d89e156f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.043481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742ec5f-e78f-40b5-943c-6d87d89e156f admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.044240 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742ec5f-e78f-40b5-943c-6d87d89e156f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.045819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742ec5f-e78f-40b5-943c-6d87d89e156f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.055864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1274/2538] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:04:11.059712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf65a8f-c6a7-450e-a0b6-2e58a434e6b0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.070183 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf65a8f-c6a7-450e-a0b6-2e58a434e6b0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.074831 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03ce00-505d-4763-ae6c-7fb6da94240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.075472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03ce00-505d-4763-ae6c-7fb6da94240d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.075758 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03ce00-505d-4763-ae6c-7fb6da94240d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.076035 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03ce00-505d-4763-ae6c-7fb6da94240d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.076770 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03ce00-505d-4763-ae6c-7fb6da94240d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.078357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03ce00-505d-4763-ae6c-7fb6da94240d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.089727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1265/2539] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:11.093691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742ec5f-e78f-40b5-943c-6d87d89e156f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.103552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742ec5f-e78f-40b5-943c-6d87d89e156f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.108045 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fc4ef-03f4-4db2-b593-c87a0ca7aa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.108733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fc4ef-03f4-4db2-b593-c87a0ca7aa28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.109018 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fc4ef-03f4-4db2-b593-c87a0ca7aa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.109297 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fc4ef-03f4-4db2-b593-c87a0ca7aa28 admin admin] PATH_INFO: `/v3/projects/d9827114879e458fb1ad1cd1d19aebf6/users/d3b0f6cc454247da82ea869662a100de/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.123610 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fc4ef-03f4-4db2-b593-c87a0ca7aa28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9827114879e458fb1ad1cd1d19aebf6, user_id=d3b0f6cc454247da82ea869662a100de, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.126298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fc4ef-03f4-4db2-b593-c87a0ca7aa28 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.139477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1275/2540] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:11 2022] PUT /identity/v3/projects/d9827114879e458fb1ad1cd1d19aebf6/users/d3b0f6cc454247da82ea869662a100de/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:11.155515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7c40a-c50f-44cf-98bd-5fa5d1bdaf73 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.155809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7c40a-c50f-44cf-98bd-5fa5d1bdaf73 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.156094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7c40a-c50f-44cf-98bd-5fa5d1bdaf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.185958 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2cc7c40a-c50f-44cf-98bd-5fa5d1bdaf73 None None] MFA Rules not processed for user `d3b0f6cc454247da82ea869662a100de`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:11.187189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2cc7c40a-c50f-44cf-98bd-5fa5d1bdaf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:11.250525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1266/2541] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:11.255104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fc4ef-03f4-4db2-b593-c87a0ca7aa28 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.306351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:11.318566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fc4ef-03f4-4db2-b593-c87a0ca7aa28 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.324187 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947391e-76ea-48ba-ba00-454bf8ca266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.324809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947391e-76ea-48ba-ba00-454bf8ca266a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.325631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947391e-76ea-48ba-ba00-454bf8ca266a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.325631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947391e-76ea-48ba-ba00-454bf8ca266a admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.326021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947391e-76ea-48ba-ba00-454bf8ca266a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.327963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947391e-76ea-48ba-ba00-454bf8ca266a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.354729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1276/2542] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:11 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:11.358752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7c40a-c50f-44cf-98bd-5fa5d1bdaf73 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.369972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7c40a-c50f-44cf-98bd-5fa5d1bdaf73 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.424765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c314cb6-9ca1-454d-99bb-34782460d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.425376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c314cb6-9ca1-454d-99bb-34782460d8df admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.425724 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c314cb6-9ca1-454d-99bb-34782460d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.425938 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c314cb6-9ca1-454d-99bb-34782460d8df admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.426572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c314cb6-9ca1-454d-99bb-34782460d8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.429017 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c314cb6-9ca1-454d-99bb-34782460d8df admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.450705 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1267/2543] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:11 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:11.455901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947391e-76ea-48ba-ba00-454bf8ca266a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.468863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947391e-76ea-48ba-ba00-454bf8ca266a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.473593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fad63-c8d9-46ab-b213-764b3a2fa227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.474209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fad63-c8d9-46ab-b213-764b3a2fa227 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.474494 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fad63-c8d9-46ab-b213-764b3a2fa227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.474773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fad63-c8d9-46ab-b213-764b3a2fa227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.475523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3fad63-c8d9-46ab-b213-764b3a2fa227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.477164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3fad63-c8d9-46ab-b213-764b3a2fa227 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.487808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1277/2544] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:11.492686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c314cb6-9ca1-454d-99bb-34782460d8df admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.502529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c314cb6-9ca1-454d-99bb-34782460d8df admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.507943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c45b96-b0fc-4609-ab92-45e91b802ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.508626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c45b96-b0fc-4609-ab92-45e91b802ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.508906 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c45b96-b0fc-4609-ab92-45e91b802ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.509177 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c45b96-b0fc-4609-ab92-45e91b802ca9 admin admin] PATH_INFO: `/v3/projects/f7487852d9f645079730f6e7a0a622da/users/bc03cb61da6e425eb54b77a37f184d20/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.523572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c45b96-b0fc-4609-ab92-45e91b802ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7487852d9f645079730f6e7a0a622da, user_id=bc03cb61da6e425eb54b77a37f184d20, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.526232 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c45b96-b0fc-4609-ab92-45e91b802ca9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.539535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1268/2545] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:11 2022] PUT /identity/v3/projects/f7487852d9f645079730f6e7a0a622da/users/bc03cb61da6e425eb54b77a37f184d20/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:11.543580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fad63-c8d9-46ab-b213-764b3a2fa227 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.554202 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fad63-c8d9-46ab-b213-764b3a2fa227 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.609810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a52d0a-d93c-4ece-b02a-6445f81f9ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.610352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a52d0a-d93c-4ece-b02a-6445f81f9ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.610633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a52d0a-d93c-4ece-b02a-6445f81f9ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.610907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a52d0a-d93c-4ece-b02a-6445f81f9ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.611595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a52d0a-d93c-4ece-b02a-6445f81f9ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.613281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a52d0a-d93c-4ece-b02a-6445f81f9ca5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.623466 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1278/2546] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:11.627799 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c45b96-b0fc-4609-ab92-45e91b802ca9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.638697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c45b96-b0fc-4609-ab92-45e91b802ca9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.643412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84093f5e-e7a8-4293-8cc7-181a6cd13eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.643971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84093f5e-e7a8-4293-8cc7-181a6cd13eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.644290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84093f5e-e7a8-4293-8cc7-181a6cd13eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.644571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84093f5e-e7a8-4293-8cc7-181a6cd13eeb admin admin] PATH_INFO: `/v3/projects/f7487852d9f645079730f6e7a0a622da/users/bc03cb61da6e425eb54b77a37f184d20/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.646505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84093f5e-e7a8-4293-8cc7-181a6cd13eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7487852d9f645079730f6e7a0a622da, user_id=bc03cb61da6e425eb54b77a37f184d20, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.649178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84093f5e-e7a8-4293-8cc7-181a6cd13eeb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.659300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1269/2547] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:11 2022] PUT /identity/v3/projects/f7487852d9f645079730f6e7a0a622da/users/bc03cb61da6e425eb54b77a37f184d20/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:11.669380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fd354-1053-4c92-9266-e8aceca51743 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.669672 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fd354-1053-4c92-9266-e8aceca51743 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.669951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fd354-1053-4c92-9266-e8aceca51743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.699635 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a23fd354-1053-4c92-9266-e8aceca51743 None None] MFA Rules not processed for user `bc03cb61da6e425eb54b77a37f184d20`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:11.700882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a23fd354-1053-4c92-9266-e8aceca51743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:11.769843 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1279/2548] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:11.781123 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84093f5e-e7a8-4293-8cc7-181a6cd13eeb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.782888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-84093f5e-e7a8-4293-8cc7-181a6cd13eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:11.798130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:11.842822 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84093f5e-e7a8-4293-8cc7-181a6cd13eeb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.846575 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0024ad-cf24-40dd-ba22-f96b543d73bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.847198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0024ad-cf24-40dd-ba22-f96b543d73bd service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.847485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0024ad-cf24-40dd-ba22-f96b543d73bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.847763 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0024ad-cf24-40dd-ba22-f96b543d73bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.857193 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0024ad-cf24-40dd-ba22-f96b543d73bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.858631 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0024ad-cf24-40dd-ba22-f96b543d73bd service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.868759 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1270/2549] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:11.940960 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fd354-1053-4c92-9266-e8aceca51743 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.950710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fd354-1053-4c92-9266-e8aceca51743 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.954349 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eec483-6675-45b6-84f2-e9550c193a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.954955 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eec483-6675-45b6-84f2-e9550c193a4c service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.955495 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eec483-6675-45b6-84f2-e9550c193a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.955770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eec483-6675-45b6-84f2-e9550c193a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:12.000446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:12.012941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eec483-6675-45b6-84f2-e9550c193a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:12.014368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eec483-6675-45b6-84f2-e9550c193a4c service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:12.023019 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1280/2550] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:21.849547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0024ad-cf24-40dd-ba22-f96b543d73bd service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:21.850993 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ec0024ad-cf24-40dd-ba22-f96b543d73bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:21.909466 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0024ad-cf24-40dd-ba22-f96b543d73bd service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:21.913108 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f846ff-29c5-4c71-a13b-43ad55411db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:21.913731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f846ff-29c5-4c71-a13b-43ad55411db8 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:21.914008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f846ff-29c5-4c71-a13b-43ad55411db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:21.914280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f846ff-29c5-4c71-a13b-43ad55411db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:21.916052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a8f846ff-29c5-4c71-a13b-43ad55411db8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:21.977269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f846ff-29c5-4c71-a13b-43ad55411db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:21.978632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f846ff-29c5-4c71-a13b-43ad55411db8 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:21.987794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1271/2551] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:22.019102 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:22.896522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eec483-6675-45b6-84f2-e9550c193a4c service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:22.963228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eec483-6675-45b6-84f2-e9550c193a4c service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:22.967864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:22.968571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:22.968851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:22.969127 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] PATH_INFO: `/v3/users/d3b0f6cc454247da82ea869662a100de` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:22.970287 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b0f6cc454247da82ea869662a100de)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:22.972265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:23.019811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b0f6cc454247da82ea869662a100de'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.021034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b0f6cc454247da82ea869662a100de'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.029153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b0f6cc454247da82ea869662a100de'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.046019 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b0f6cc454247da82ea869662a100de'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.054010 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b0f6cc454247da82ea869662a100de'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.066647 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5edc8-4c9c-4c84-95e0-09e3398acffd None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.067151 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5edc8-4c9c-4c84-95e0-09e3398acffd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.067505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5edc8-4c9c-4c84-95e0-09e3398acffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.071478 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1281/2552] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:22 2022] DELETE /identity/v3/users/d3b0f6cc454247da82ea869662a100de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:23.084241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:23.085903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:23.092187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4da5edc8-4c9c-4c84-95e0-09e3398acffd None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:23.093419 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4da5edc8-4c9c-4c84-95e0-09e3398acffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:23.177503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f9ba0-0699-4d7f-aaaf-83264fda90be admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:23.184649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf6223-cf76-4c13-a114-ea6a01644736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:23.185287 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf6223-cf76-4c13-a114-ea6a01644736 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.185649 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf6223-cf76-4c13-a114-ea6a01644736 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.186115 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf6223-cf76-4c13-a114-ea6a01644736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.188272 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1272/2553] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:23.189355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9eaf6223-cf76-4c13-a114-ea6a01644736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:23.197447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5edc8-4c9c-4c84-95e0-09e3398acffd None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:23.198665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4da5edc8-4c9c-4c84-95e0-09e3398acffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:23.203480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf6223-cf76-4c13-a114-ea6a01644736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:23.205447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf6223-cf76-4c13-a114-ea6a01644736 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:23.216796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:23.232775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1282/2554] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:04:23.271701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5edc8-4c9c-4c84-95e0-09e3398acffd None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:23.277883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cfbd8-1dcf-4699-8be9-023462c89074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:23.280000 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cfbd8-1dcf-4699-8be9-023462c89074 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.280396 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cfbd8-1dcf-4699-8be9-023462c89074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.280858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cfbd8-1dcf-4699-8be9-023462c89074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.291913 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cfbd8-1dcf-4699-8be9-023462c89074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:23.293425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cfbd8-1dcf-4699-8be9-023462c89074 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:23.306260 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1273/2555] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:23.670576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf6223-cf76-4c13-a114-ea6a01644736 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:23.672248 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9eaf6223-cf76-4c13-a114-ea6a01644736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:23.682639 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:23.687779 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf6223-cf76-4c13-a114-ea6a01644736 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:23.693868 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:23.694819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.695243 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.695671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] PATH_INFO: `/v3/projects/d9827114879e458fb1ad1cd1d19aebf6` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.698134 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9827114879e458fb1ad1cd1d19aebf6)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:23.701388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:23.750573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9827114879e458fb1ad1cd1d19aebf6', 'request_id': 'req-0e60e018-4013-4c62-a685-53feb0a39799'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.756141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9827114879e458fb1ad1cd1d19aebf6', 'request_id': 'req-0e60e018-4013-4c62-a685-53feb0a39799'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.764742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9827114879e458fb1ad1cd1d19aebf6', 'request_id': 'req-0e60e018-4013-4c62-a685-53feb0a39799'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.777277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] The token cache is being invalidate because project d9827114879e458fb1ad1cd1d19aebf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:23.777569 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.778324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.779839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1283/2556] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:23 2022] DELETE /identity/v3/projects/d9827114879e458fb1ad1cd1d19aebf6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:23.783829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cfbd8-1dcf-4699-8be9-023462c89074 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:23.794840 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cfbd8-1dcf-4699-8be9-023462c89074 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:23.860175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf8d98-54a7-497a-acc9-3875b1916b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:23.860814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf8d98-54a7-497a-acc9-3875b1916b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.861096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf8d98-54a7-497a-acc9-3875b1916b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.861372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf8d98-54a7-497a-acc9-3875b1916b8a admin admin] PATH_INFO: `/v3/users/bc03cb61da6e425eb54b77a37f184d20` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.862526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf8d98-54a7-497a-acc9-3875b1916b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc03cb61da6e425eb54b77a37f184d20)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:23.864480 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf8d98-54a7-497a-acc9-3875b1916b8a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:23.916201 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-debf8d98-54a7-497a-acc9-3875b1916b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc03cb61da6e425eb54b77a37f184d20'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.916882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-debf8d98-54a7-497a-acc9-3875b1916b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc03cb61da6e425eb54b77a37f184d20'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.933005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-debf8d98-54a7-497a-acc9-3875b1916b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc03cb61da6e425eb54b77a37f184d20'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.950723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-debf8d98-54a7-497a-acc9-3875b1916b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc03cb61da6e425eb54b77a37f184d20'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.958687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-debf8d98-54a7-497a-acc9-3875b1916b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc03cb61da6e425eb54b77a37f184d20'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:23.966330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1274/2557] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:23 2022] DELETE /identity/v3/users/bc03cb61da6e425eb54b77a37f184d20 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:24.244256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:24.245912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:24.260051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60e018-4013-4c62-a685-53feb0a39799 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:24.318877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fdcfd-44da-49de-a6d1-4361517d6053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:24.319520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fdcfd-44da-49de-a6d1-4361517d6053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.319803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fdcfd-44da-49de-a6d1-4361517d6053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.320079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fdcfd-44da-49de-a6d1-4361517d6053 admin admin] PATH_INFO: `/v3/projects/f7487852d9f645079730f6e7a0a622da` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.321993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fdcfd-44da-49de-a6d1-4361517d6053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7487852d9f645079730f6e7a0a622da)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:24.323898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fdcfd-44da-49de-a6d1-4361517d6053 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:24.370555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ae1fdcfd-44da-49de-a6d1-4361517d6053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7487852d9f645079730f6e7a0a622da', 'request_id': 'req-ae1fdcfd-44da-49de-a6d1-4361517d6053'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:24.376263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ae1fdcfd-44da-49de-a6d1-4361517d6053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7487852d9f645079730f6e7a0a622da', 'request_id': 'req-ae1fdcfd-44da-49de-a6d1-4361517d6053'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:24.384448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ae1fdcfd-44da-49de-a6d1-4361517d6053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7487852d9f645079730f6e7a0a622da', 'request_id': 'req-ae1fdcfd-44da-49de-a6d1-4361517d6053'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:24.395473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ae1fdcfd-44da-49de-a6d1-4361517d6053 admin admin] The token cache is being invalidate because project f7487852d9f645079730f6e7a0a622da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:24.395764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ae1fdcfd-44da-49de-a6d1-4361517d6053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:24.396414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ae1fdcfd-44da-49de-a6d1-4361517d6053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:24.397911 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1284/2558] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:24 2022] DELETE /identity/v3/projects/f7487852d9f645079730f6e7a0a622da => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:04:24.402881 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2bdbb-2c1e-4b4b-82e3-6ae6dfd9bdc7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.403345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2bdbb-2c1e-4b4b-82e3-6ae6dfd9bdc7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.403439 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2bdbb-2c1e-4b4b-82e3-6ae6dfd9bdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.423156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-eaa2bdbb-2c1e-4b4b-82e3-6ae6dfd9bdc7 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:24.424411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-eaa2bdbb-2c1e-4b4b-82e3-6ae6dfd9bdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:24.454606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:24.488553 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1275/2559] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:24.496767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f95ee-dbc2-4883-98e4-e4c9414cf21c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.497063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f95ee-dbc2-4883-98e4-e4c9414cf21c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.497372 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f95ee-dbc2-4883-98e4-e4c9414cf21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.518563 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c44f95ee-dbc2-4883-98e4-e4c9414cf21c None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:24.519779 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c44f95ee-dbc2-4883-98e4-e4c9414cf21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:24.529236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1285/2560] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:24.533546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2bdbb-2c1e-4b4b-82e3-6ae6dfd9bdc7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:24.544257 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2bdbb-2c1e-4b4b-82e3-6ae6dfd9bdc7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:24.548860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c30561-53d2-4856-b22c-1f37bdfdaf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:24.549590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c30561-53d2-4856-b22c-1f37bdfdaf2e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.549871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c30561-53d2-4856-b22c-1f37bdfdaf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.550146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c30561-53d2-4856-b22c-1f37bdfdaf2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.550960 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c30561-53d2-4856-b22c-1f37bdfdaf2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:24.551276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c30561-53d2-4856-b22c-1f37bdfdaf2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:24.552931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c30561-53d2-4856-b22c-1f37bdfdaf2e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:24.568804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1276/2561] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:24.569995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f95ee-dbc2-4883-98e4-e4c9414cf21c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:24.579318 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f95ee-dbc2-4883-98e4-e4c9414cf21c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:24.584321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddecf9e-13fc-4090-af08-ccc6ee15a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:24.584933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddecf9e-13fc-4090-af08-ccc6ee15a7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.585245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddecf9e-13fc-4090-af08-ccc6ee15a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.585517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddecf9e-13fc-4090-af08-ccc6ee15a7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.586176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddecf9e-13fc-4090-af08-ccc6ee15a7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:24.588063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddecf9e-13fc-4090-af08-ccc6ee15a7d3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:24.598722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:24.620863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1286/2562] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:24 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:24.624574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c30561-53d2-4856-b22c-1f37bdfdaf2e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:24.634962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c30561-53d2-4856-b22c-1f37bdfdaf2e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:24.821136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59ec38-8537-403b-913f-64b616424818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:24.821765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59ec38-8537-403b-913f-64b616424818 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.822048 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59ec38-8537-403b-913f-64b616424818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.822325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59ec38-8537-403b-913f-64b616424818 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.822992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59ec38-8537-403b-913f-64b616424818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:24.824929 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59ec38-8537-403b-913f-64b616424818 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:24.846480 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1277/2563] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:24 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:04:24.850638 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddecf9e-13fc-4090-af08-ccc6ee15a7d3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:24.861947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddecf9e-13fc-4090-af08-ccc6ee15a7d3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:24.866497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ecd8d-52f2-4e30-b904-c5f827361ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:24.867105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ecd8d-52f2-4e30-b904-c5f827361ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.867389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ecd8d-52f2-4e30-b904-c5f827361ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.867685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ecd8d-52f2-4e30-b904-c5f827361ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.868409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ecd8d-52f2-4e30-b904-c5f827361ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:24.870006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ecd8d-52f2-4e30-b904-c5f827361ac9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:24.880080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1287/2564] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:24.883695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59ec38-8537-403b-913f-64b616424818 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:24.893538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59ec38-8537-403b-913f-64b616424818 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:24.898066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158628b6-ad06-4f20-9bbc-23f78573c334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:24.898664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158628b6-ad06-4f20-9bbc-23f78573c334 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.899455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158628b6-ad06-4f20-9bbc-23f78573c334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.899727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158628b6-ad06-4f20-9bbc-23f78573c334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.900496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158628b6-ad06-4f20-9bbc-23f78573c334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:24.902104 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158628b6-ad06-4f20-9bbc-23f78573c334 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:24.914107 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1278/2565] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:24.919144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ecd8d-52f2-4e30-b904-c5f827361ac9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:24.929173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ecd8d-52f2-4e30-b904-c5f827361ac9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:24.933764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6bf72-be33-4841-ad43-a1e33bf42a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:24.934419 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6bf72-be33-4841-ad43-a1e33bf42a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.934704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6bf72-be33-4841-ad43-a1e33bf42a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.934982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6bf72-be33-4841-ad43-a1e33bf42a2d admin admin] PATH_INFO: `/v3/projects/9f162e2f1f0f4801beb5e3912bab4dea/users/24f1127a4e944a25bcf248de52a2f5c6/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.949402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6bf72-be33-4841-ad43-a1e33bf42a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f162e2f1f0f4801beb5e3912bab4dea, user_id=24f1127a4e944a25bcf248de52a2f5c6, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:24.952069 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6bf72-be33-4841-ad43-a1e33bf42a2d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:24.968281 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1288/2566] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:24 2022] PUT /identity/v3/projects/9f162e2f1f0f4801beb5e3912bab4dea/users/24f1127a4e944a25bcf248de52a2f5c6/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:24.980757 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f608c1-84db-4efe-ab7f-1405e342a48e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.980975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f608c1-84db-4efe-ab7f-1405e342a48e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.981253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f608c1-84db-4efe-ab7f-1405e342a48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.008282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-98f608c1-84db-4efe-ab7f-1405e342a48e None None] MFA Rules not processed for user `24f1127a4e944a25bcf248de52a2f5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:25.009467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-98f608c1-84db-4efe-ab7f-1405e342a48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:25.071219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1279/2567] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:25.075831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6bf72-be33-4841-ad43-a1e33bf42a2d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:25.138343 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6bf72-be33-4841-ad43-a1e33bf42a2d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:25.143120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665f249-6c44-4fa6-8032-e4b9a2e891e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:25.143726 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665f249-6c44-4fa6-8032-e4b9a2e891e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.144035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665f249-6c44-4fa6-8032-e4b9a2e891e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.144325 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665f249-6c44-4fa6-8032-e4b9a2e891e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.144977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665f249-6c44-4fa6-8032-e4b9a2e891e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:25.146957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665f249-6c44-4fa6-8032-e4b9a2e891e7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:25.177477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1289/2568] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:25 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:25.178751 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f608c1-84db-4efe-ab7f-1405e342a48e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:25.189254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f608c1-84db-4efe-ab7f-1405e342a48e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:25.215858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:25.245426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e4567-2555-4c2d-ac0f-c50c64b54b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:25.245971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e4567-2555-4c2d-ac0f-c50c64b54b55 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.246250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e4567-2555-4c2d-ac0f-c50c64b54b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.246517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e4567-2555-4c2d-ac0f-c50c64b54b55 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.247161 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e4567-2555-4c2d-ac0f-c50c64b54b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:25.249061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e4567-2555-4c2d-ac0f-c50c64b54b55 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:25.270705 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1280/2569] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:25 2022] POST /identity/v3/users => generated 307 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:25.275646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665f249-6c44-4fa6-8032-e4b9a2e891e7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:25.285899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665f249-6c44-4fa6-8032-e4b9a2e891e7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:25.290688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df563d-ca8f-45eb-b117-eb989c0c924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:25.291302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df563d-ca8f-45eb-b117-eb989c0c924d admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.291587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df563d-ca8f-45eb-b117-eb989c0c924d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.291858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df563d-ca8f-45eb-b117-eb989c0c924d admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.292594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df563d-ca8f-45eb-b117-eb989c0c924d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:25.294206 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df563d-ca8f-45eb-b117-eb989c0c924d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:25.309499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1290/2570] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:25.313429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e4567-2555-4c2d-ac0f-c50c64b54b55 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:25.325211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e4567-2555-4c2d-ac0f-c50c64b54b55 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:25.330142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dead0b-3465-404f-82f0-aa813626c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:25.330893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dead0b-3465-404f-82f0-aa813626c081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.331175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dead0b-3465-404f-82f0-aa813626c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.331447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dead0b-3465-404f-82f0-aa813626c081 admin admin] PATH_INFO: `/v3/projects/576725a6fd864bfe834c55fb121c3226/users/2afe17eb453a44c4945fabc3dfe3bb09/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.347313 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dead0b-3465-404f-82f0-aa813626c081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576725a6fd864bfe834c55fb121c3226, user_id=2afe17eb453a44c4945fabc3dfe3bb09, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:25.349973 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dead0b-3465-404f-82f0-aa813626c081 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:25.364893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1281/2571] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:25 2022] PUT /identity/v3/projects/576725a6fd864bfe834c55fb121c3226/users/2afe17eb453a44c4945fabc3dfe3bb09/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:25.368882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df563d-ca8f-45eb-b117-eb989c0c924d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:25.380710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df563d-ca8f-45eb-b117-eb989c0c924d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:25.445541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4aef0-64dc-480a-acf4-29bd61c30024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:25.446755 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4aef0-64dc-480a-acf4-29bd61c30024 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.447039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4aef0-64dc-480a-acf4-29bd61c30024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.447396 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4aef0-64dc-480a-acf4-29bd61c30024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.448097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4aef0-64dc-480a-acf4-29bd61c30024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:25.449737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4aef0-64dc-480a-acf4-29bd61c30024 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:25.465570 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1291/2572] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:25.466725 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dead0b-3465-404f-82f0-aa813626c081 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:25.479560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dead0b-3465-404f-82f0-aa813626c081 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:25.484434 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaa06b-2308-449a-82b7-322f28924664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:25.485498 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa06b-2308-449a-82b7-322f28924664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.485498 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa06b-2308-449a-82b7-322f28924664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.485741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa06b-2308-449a-82b7-322f28924664 admin admin] PATH_INFO: `/v3/projects/576725a6fd864bfe834c55fb121c3226/users/2afe17eb453a44c4945fabc3dfe3bb09/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.487770 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aaa06b-2308-449a-82b7-322f28924664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576725a6fd864bfe834c55fb121c3226, user_id=2afe17eb453a44c4945fabc3dfe3bb09, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:25.490494 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aaa06b-2308-449a-82b7-322f28924664 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:25.502526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1282/2573] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:25 2022] PUT /identity/v3/projects/576725a6fd864bfe834c55fb121c3226/users/2afe17eb453a44c4945fabc3dfe3bb09/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:25.513328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c62442-3037-4510-9a46-137e4a7bd9a6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.513542 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c62442-3037-4510-9a46-137e4a7bd9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.513742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c62442-3037-4510-9a46-137e4a7bd9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.545059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-93c62442-3037-4510-9a46-137e4a7bd9a6 None None] MFA Rules not processed for user `2afe17eb453a44c4945fabc3dfe3bb09`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:25.546445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-93c62442-3037-4510-9a46-137e4a7bd9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:25.560056 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:25.624810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1292/2574] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:25 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:25.637518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaa06b-2308-449a-82b7-322f28924664 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:25.639197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c3aaa06b-2308-449a-82b7-322f28924664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:25.700903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaa06b-2308-449a-82b7-322f28924664 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:25.704652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ff7cb-3a02-408c-8eb1-251dd449d0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:25.705515 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ff7cb-3a02-408c-8eb1-251dd449d0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.705796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ff7cb-3a02-408c-8eb1-251dd449d0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.706091 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ff7cb-3a02-408c-8eb1-251dd449d0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.715971 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ff7cb-3a02-408c-8eb1-251dd449d0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:25.717506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ff7cb-3a02-408c-8eb1-251dd449d0b4 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:25.731865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1283/2575] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:25 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:25.793562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c62442-3037-4510-9a46-137e4a7bd9a6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:25.795618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-93c62442-3037-4510-9a46-137e4a7bd9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:25.836106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ff7cb-3a02-408c-8eb1-251dd449d0b4 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:25.853436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ff7cb-3a02-408c-8eb1-251dd449d0b4 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:25.857175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac521d30-d96e-4769-81c5-2adbf1ff9503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:25.859009 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac521d30-d96e-4769-81c5-2adbf1ff9503 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.859387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac521d30-d96e-4769-81c5-2adbf1ff9503 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.859737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac521d30-d96e-4769-81c5-2adbf1ff9503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.901252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c62442-3037-4510-9a46-137e4a7bd9a6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:25.907191 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff0e4d-78c1-4b5a-80fc-52dbf878983e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:25.907929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff0e4d-78c1-4b5a-80fc-52dbf878983e service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.908352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff0e4d-78c1-4b5a-80fc-52dbf878983e service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.908739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff0e4d-78c1-4b5a-80fc-52dbf878983e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.910631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-66ff0e4d-78c1-4b5a-80fc-52dbf878983e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:25.924499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff0e4d-78c1-4b5a-80fc-52dbf878983e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:25.926156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff0e4d-78c1-4b5a-80fc-52dbf878983e service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:25.930917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac521d30-d96e-4769-81c5-2adbf1ff9503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:25.932415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac521d30-d96e-4769-81c5-2adbf1ff9503 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:25.937985 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1293/2576] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:25.941448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1284/2577] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:27.148034 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff0e4d-78c1-4b5a-80fc-52dbf878983e service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:27.150324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-66ff0e4d-78c1-4b5a-80fc-52dbf878983e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:27.207444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff0e4d-78c1-4b5a-80fc-52dbf878983e service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:27.210952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f69a-2b19-4c44-bb76-e788aa8ddcd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:27.212084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f69a-2b19-4c44-bb76-e788aa8ddcd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:27.212394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f69a-2b19-4c44-bb76-e788aa8ddcd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:27.212665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f69a-2b19-4c44-bb76-e788aa8ddcd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:27.214405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c043f69a-2b19-4c44-bb76-e788aa8ddcd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:27.261799 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:27.278697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f69a-2b19-4c44-bb76-e788aa8ddcd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:27.282251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f69a-2b19-4c44-bb76-e788aa8ddcd2 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:27.293578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1294/2578] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:04:31.160838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac521d30-d96e-4769-81c5-2adbf1ff9503 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.171943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac521d30-d96e-4769-81c5-2adbf1ff9503 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.176536 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:31.177163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.177444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.177719 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] PATH_INFO: `/v3/users/24f1127a4e944a25bcf248de52a2f5c6` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.178861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f1127a4e944a25bcf248de52a2f5c6)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:31.180887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:31.197299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:31.233431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f1127a4e944a25bcf248de52a2f5c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:31.234181 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f1127a4e944a25bcf248de52a2f5c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:31.246325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f1127a4e944a25bcf248de52a2f5c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:31.259025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f1127a4e944a25bcf248de52a2f5c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:31.266786 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f1127a4e944a25bcf248de52a2f5c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:31.272814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1285/2579] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:31 2022] DELETE /identity/v3/users/24f1127a4e944a25bcf248de52a2f5c6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:31.278098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b318ec-a3e2-4a73-81e1-0ae7c8d74f46 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.278561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b318ec-a3e2-4a73-81e1-0ae7c8d74f46 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.278722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b318ec-a3e2-4a73-81e1-0ae7c8d74f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.297692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c4b318ec-a3e2-4a73-81e1-0ae7c8d74f46 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:31.299153 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c4b318ec-a3e2-4a73-81e1-0ae7c8d74f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:31.360566 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1295/2580] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:31.370500 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.371972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:31.447919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7842d-5318-4e3b-92d9-2decefdac4e2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.451650 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47a5c8-86b5-42c2-ab35-8d6c3c495f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:31.452368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47a5c8-86b5-42c2-ab35-8d6c3c495f4d service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.452909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47a5c8-86b5-42c2-ab35-8d6c3c495f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.453195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47a5c8-86b5-42c2-ab35-8d6c3c495f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.465066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47a5c8-86b5-42c2-ab35-8d6c3c495f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:31.466828 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47a5c8-86b5-42c2-ab35-8d6c3c495f4d service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:31.482556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1286/2581] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:31.785474 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b318ec-a3e2-4a73-81e1-0ae7c8d74f46 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.786946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c4b318ec-a3e2-4a73-81e1-0ae7c8d74f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:31.800706 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b318ec-a3e2-4a73-81e1-0ae7c8d74f46 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.807667 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:31.808442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.813189 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.813574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] PATH_INFO: `/v3/projects/9f162e2f1f0f4801beb5e3912bab4dea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.814997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f162e2f1f0f4801beb5e3912bab4dea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:31.816963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:31.870024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f162e2f1f0f4801beb5e3912bab4dea', 'request_id': 'req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:31.876038 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f162e2f1f0f4801beb5e3912bab4dea', 'request_id': 'req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:31.884097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f162e2f1f0f4801beb5e3912bab4dea', 'request_id': 'req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:31.896369 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] The token cache is being invalidate because project 9f162e2f1f0f4801beb5e3912bab4dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:31.896550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:31.897113 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:31.899580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1296/2582] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:31 2022] DELETE /identity/v3/projects/9f162e2f1f0f4801beb5e3912bab4dea => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:31.903379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47a5c8-86b5-42c2-ab35-8d6c3c495f4d service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.912939 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47a5c8-86b5-42c2-ab35-8d6c3c495f4d service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.980538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a2707-eca8-4554-8252-7031e90340ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:31.981306 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a2707-eca8-4554-8252-7031e90340ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.981572 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a2707-eca8-4554-8252-7031e90340ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.981851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a2707-eca8-4554-8252-7031e90340ad admin admin] PATH_INFO: `/v3/users/2afe17eb453a44c4945fabc3dfe3bb09` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.983056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a2707-eca8-4554-8252-7031e90340ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=2afe17eb453a44c4945fabc3dfe3bb09)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:31.985103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a2707-eca8-4554-8252-7031e90340ad admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.031437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:32.044312 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bb3a2707-eca8-4554-8252-7031e90340ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2afe17eb453a44c4945fabc3dfe3bb09'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:32.045592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bb3a2707-eca8-4554-8252-7031e90340ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2afe17eb453a44c4945fabc3dfe3bb09'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:32.061809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bb3a2707-eca8-4554-8252-7031e90340ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2afe17eb453a44c4945fabc3dfe3bb09'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:32.069966 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bb3a2707-eca8-4554-8252-7031e90340ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2afe17eb453a44c4945fabc3dfe3bb09'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:32.079263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-bb3a2707-eca8-4554-8252-7031e90340ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2afe17eb453a44c4945fabc3dfe3bb09'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:32.086606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1287/2583] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:31 2022] DELETE /identity/v3/users/2afe17eb453a44c4945fabc3dfe3bb09 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:32.386675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:32.388829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:32.403831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b33bd-c3c9-47c5-9ece-aac58f75ca5c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:32.472443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3122b-d41c-4e23-a286-168fc13a6ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.473394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3122b-d41c-4e23-a286-168fc13a6ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.473873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3122b-d41c-4e23-a286-168fc13a6ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.474054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3122b-d41c-4e23-a286-168fc13a6ba0 admin admin] PATH_INFO: `/v3/projects/576725a6fd864bfe834c55fb121c3226` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.475527 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3122b-d41c-4e23-a286-168fc13a6ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=576725a6fd864bfe834c55fb121c3226)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.478625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3122b-d41c-4e23-a286-168fc13a6ba0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.493861 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:32.547132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-71b3122b-d41c-4e23-a286-168fc13a6ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576725a6fd864bfe834c55fb121c3226', 'request_id': 'req-71b3122b-d41c-4e23-a286-168fc13a6ba0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:32.553145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-71b3122b-d41c-4e23-a286-168fc13a6ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576725a6fd864bfe834c55fb121c3226', 'request_id': 'req-71b3122b-d41c-4e23-a286-168fc13a6ba0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:32.561351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-71b3122b-d41c-4e23-a286-168fc13a6ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576725a6fd864bfe834c55fb121c3226', 'request_id': 'req-71b3122b-d41c-4e23-a286-168fc13a6ba0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:32.573483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-71b3122b-d41c-4e23-a286-168fc13a6ba0 admin admin] The token cache is being invalidate because project 576725a6fd864bfe834c55fb121c3226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:32.573777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-71b3122b-d41c-4e23-a286-168fc13a6ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:32.574428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-71b3122b-d41c-4e23-a286-168fc13a6ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:32.575944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1297/2584] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:32 2022] DELETE /identity/v3/projects/576725a6fd864bfe834c55fb121c3226 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:32.582134 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff6e3b-02bb-4fb1-beff-dc822bacd4ea None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.582682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff6e3b-02bb-4fb1-beff-dc822bacd4ea None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.582682 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff6e3b-02bb-4fb1-beff-dc822bacd4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.603080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d2ff6e3b-02bb-4fb1-beff-dc822bacd4ea None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:32.604375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d2ff6e3b-02bb-4fb1-beff-dc822bacd4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:32.674390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1288/2585] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:32.684296 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e4082-57e3-496b-8fdf-e289e2488517 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.684589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e4082-57e3-496b-8fdf-e289e2488517 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.684877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e4082-57e3-496b-8fdf-e289e2488517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.705298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-007e4082-57e3-496b-8fdf-e289e2488517 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:32.706531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-007e4082-57e3-496b-8fdf-e289e2488517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:32.714598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1298/2586] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:32.719158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff6e3b-02bb-4fb1-beff-dc822bacd4ea None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:32.729827 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff6e3b-02bb-4fb1-beff-dc822bacd4ea None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:32.735436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4ed94-8f16-42b8-9ddb-a0a60af34d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.736062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4ed94-8f16-42b8-9ddb-a0a60af34d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.736455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4ed94-8f16-42b8-9ddb-a0a60af34d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.736878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4ed94-8f16-42b8-9ddb-a0a60af34d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.737594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4ed94-8f16-42b8-9ddb-a0a60af34d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:32.737915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4ed94-8f16-42b8-9ddb-a0a60af34d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.739501 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4ed94-8f16-42b8-9ddb-a0a60af34d22 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.752887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1289/2587] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:32.757341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e4082-57e3-496b-8fdf-e289e2488517 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:32.766774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e4082-57e3-496b-8fdf-e289e2488517 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:32.771448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cf181-2b1c-43c4-8319-acf79f0f411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.772063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cf181-2b1c-43c4-8319-acf79f0f411a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.772383 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cf181-2b1c-43c4-8319-acf79f0f411a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.772664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cf181-2b1c-43c4-8319-acf79f0f411a admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.773344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cf181-2b1c-43c4-8319-acf79f0f411a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.775293 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cf181-2b1c-43c4-8319-acf79f0f411a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.803788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1299/2588] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:32 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:32.808478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4ed94-8f16-42b8-9ddb-a0a60af34d22 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:32.821729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4ed94-8f16-42b8-9ddb-a0a60af34d22 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:32.894977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e80f97-6747-40c8-95f3-aa7e29de903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.895609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e80f97-6747-40c8-95f3-aa7e29de903b admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.895893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e80f97-6747-40c8-95f3-aa7e29de903b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.896205 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e80f97-6747-40c8-95f3-aa7e29de903b admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.896889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e80f97-6747-40c8-95f3-aa7e29de903b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.898848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e80f97-6747-40c8-95f3-aa7e29de903b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.928501 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1290/2589] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:32 2022] POST /identity/v3/users => generated 280 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:32.933794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cf181-2b1c-43c4-8319-acf79f0f411a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:32.947104 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cf181-2b1c-43c4-8319-acf79f0f411a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:32.952196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f568db-fb49-4b03-b35d-5948bedfdf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.952951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f568db-fb49-4b03-b35d-5948bedfdf92 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.953294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f568db-fb49-4b03-b35d-5948bedfdf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.953618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f568db-fb49-4b03-b35d-5948bedfdf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.954348 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f568db-fb49-4b03-b35d-5948bedfdf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.956954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f568db-fb49-4b03-b35d-5948bedfdf92 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.969082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1300/2590] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:32.973989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e80f97-6747-40c8-95f3-aa7e29de903b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:32.985871 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e80f97-6747-40c8-95f3-aa7e29de903b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:32.991209 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1272f8f-cab9-42b9-90eb-035383cfee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.991898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1272f8f-cab9-42b9-90eb-035383cfee8e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.992863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1272f8f-cab9-42b9-90eb-035383cfee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.993211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1272f8f-cab9-42b9-90eb-035383cfee8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.993861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1272f8f-cab9-42b9-90eb-035383cfee8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.995568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1272f8f-cab9-42b9-90eb-035383cfee8e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:33.006975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1291/2591] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:33.011702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f568db-fb49-4b03-b35d-5948bedfdf92 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:33.031354 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f568db-fb49-4b03-b35d-5948bedfdf92 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:33.037966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8fb9c-c354-42dd-a8b4-5f445c5bba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:33.038682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8fb9c-c354-42dd-a8b4-5f445c5bba51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:33.038970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8fb9c-c354-42dd-a8b4-5f445c5bba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:33.039950 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8fb9c-c354-42dd-a8b4-5f445c5bba51 admin admin] PATH_INFO: `/v3/projects/421743163016414fb7c78f4fed30d107/users/147b5d5000994508b2a314df218dd849/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:33.056697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8fb9c-c354-42dd-a8b4-5f445c5bba51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421743163016414fb7c78f4fed30d107, user_id=147b5d5000994508b2a314df218dd849, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:33.059539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8fb9c-c354-42dd-a8b4-5f445c5bba51 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:33.073501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1301/2592] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:33 2022] PUT /identity/v3/projects/421743163016414fb7c78f4fed30d107/users/147b5d5000994508b2a314df218dd849/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:33.084617 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9eac6-ca38-4c2d-8e98-573eb9debbef None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:33.085483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9eac6-ca38-4c2d-8e98-573eb9debbef None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:33.085775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9eac6-ca38-4c2d-8e98-573eb9debbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:33.116364 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-05d9eac6-ca38-4c2d-8e98-573eb9debbef None None] MFA Rules not processed for user `147b5d5000994508b2a314df218dd849`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:33.118227 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-05d9eac6-ca38-4c2d-8e98-573eb9debbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:33.130076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:33.198905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1292/2593] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:33.236295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8fb9c-c354-42dd-a8b4-5f445c5bba51 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:33.236963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cff8fb9c-c354-42dd-a8b4-5f445c5bba51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:33.305368 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8fb9c-c354-42dd-a8b4-5f445c5bba51 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:33.309646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d95a1-b41a-4d13-a23a-7de55ed28f8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:33.309845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d95a1-b41a-4d13-a23a-7de55ed28f8a service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:33.310124 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d95a1-b41a-4d13-a23a-7de55ed28f8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:33.310400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d95a1-b41a-4d13-a23a-7de55ed28f8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:33.325352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d95a1-b41a-4d13-a23a-7de55ed28f8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:33.326909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d95a1-b41a-4d13-a23a-7de55ed28f8a service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:33.339341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1302/2594] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:33.355413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9eac6-ca38-4c2d-8e98-573eb9debbef None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:33.443358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9eac6-ca38-4c2d-8e98-573eb9debbef None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:33.449007 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:33.449685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:33.449968 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:33.450244 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] PATH_INFO: `/v3/users/147b5d5000994508b2a314df218dd849` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:33.451473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147b5d5000994508b2a314df218dd849)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:33.453539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:33.529547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147b5d5000994508b2a314df218dd849'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:33.530685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147b5d5000994508b2a314df218dd849'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:33.552583 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147b5d5000994508b2a314df218dd849'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:33.569024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147b5d5000994508b2a314df218dd849'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:33.580860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147b5d5000994508b2a314df218dd849'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:33.591696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1293/2595] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:33 2022] DELETE /identity/v3/users/147b5d5000994508b2a314df218dd849 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:33.593463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1418ff-4a84-428d-962b-afe91f3d432f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:33.593851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1418ff-4a84-428d-962b-afe91f3d432f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:33.594203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1418ff-4a84-428d-962b-afe91f3d432f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:33.619711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9c1418ff-4a84-428d-962b-afe91f3d432f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:33.621434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9c1418ff-4a84-428d-962b-afe91f3d432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:33.671600 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:33.714061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1303/2596] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:04:33.725997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:33.727564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:33.768690 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:33.809726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b3c97-e33f-423e-ae93-e06c2fdffc96 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:33.816435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a9ddc-1b4b-47a9-9b5c-5627df8d9cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:33.817096 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a9ddc-1b4b-47a9-9b5c-5627df8d9cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:33.817789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a9ddc-1b4b-47a9-9b5c-5627df8d9cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:33.817789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a9ddc-1b4b-47a9-9b5c-5627df8d9cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:33.831036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a9ddc-1b4b-47a9-9b5c-5627df8d9cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:33.832531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a9ddc-1b4b-47a9-9b5c-5627df8d9cd4 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:33.849008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1294/2597] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:33.941933 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1418ff-4a84-428d-962b-afe91f3d432f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:33.943816 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9c1418ff-4a84-428d-962b-afe91f3d432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:33.961070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1418ff-4a84-428d-962b-afe91f3d432f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:33.966352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:33.967047 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:33.967336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:33.967613 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] PATH_INFO: `/v3/users/e2cc95918e4f457f955161df0dd0ebde` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:33.968944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cc95918e4f457f955161df0dd0ebde)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:33.972472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:34.026850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cc95918e4f457f955161df0dd0ebde'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.027501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cc95918e4f457f955161df0dd0ebde'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.036016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cc95918e4f457f955161df0dd0ebde'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.050286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cc95918e4f457f955161df0dd0ebde'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.064297 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cc95918e4f457f955161df0dd0ebde'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.071490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1304/2598] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:33 2022] DELETE /identity/v3/users/e2cc95918e4f457f955161df0dd0ebde => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:34.157712 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a9ddc-1b4b-47a9-9b5c-5627df8d9cd4 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.159166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-909a9ddc-1b4b-47a9-9b5c-5627df8d9cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:34.173771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a9ddc-1b4b-47a9-9b5c-5627df8d9cd4 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.247233 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.247877 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.248323 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.248624 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c admin admin] PATH_INFO: `/v3/projects/421743163016414fb7c78f4fed30d107` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.249888 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=421743163016414fb7c78f4fed30d107)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:34.251845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:34.272303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.273829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:34.288576 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea5128-8c83-47f5-be4d-42f1267e28fa admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.294425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.295734 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.296066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.296400 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] PATH_INFO: `/v3/projects/8e34c8b3cec84078bbb2121ae4a279de` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.297585 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e34c8b3cec84078bbb2121ae4a279de)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:34.299701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:34.322460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421743163016414fb7c78f4fed30d107', 'request_id': 'req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.328460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421743163016414fb7c78f4fed30d107', 'request_id': 'req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.335607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421743163016414fb7c78f4fed30d107', 'request_id': 'req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.348429 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c admin admin] The token cache is being invalidate because project 421743163016414fb7c78f4fed30d107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:34.348723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.349381 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b8f504ac-591e-4c13-a2b2-2ef0edb62d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.349558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e34c8b3cec84078bbb2121ae4a279de', 'request_id': 'req-c67e7096-f87f-4695-8de0-965b7ffa0722'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.352773 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1295/2599] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:34 2022] DELETE /identity/v3/projects/421743163016414fb7c78f4fed30d107 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:34.357677 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91b69-dffa-4e79-a5cd-cc53be63157f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.358250 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91b69-dffa-4e79-a5cd-cc53be63157f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.358558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91b69-dffa-4e79-a5cd-cc53be63157f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.360001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e34c8b3cec84078bbb2121ae4a279de', 'request_id': 'req-c67e7096-f87f-4695-8de0-965b7ffa0722'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.368467 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e34c8b3cec84078bbb2121ae4a279de', 'request_id': 'req-c67e7096-f87f-4695-8de0-965b7ffa0722'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.379330 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1bb91b69-dffa-4e79-a5cd-cc53be63157f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:34.380212 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] The token cache is being invalidate because project 8e34c8b3cec84078bbb2121ae4a279de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:34.380505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.380621 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1bb91b69-dffa-4e79-a5cd-cc53be63157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:34.381151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.382669 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1305/2600] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:34 2022] DELETE /identity/v3/projects/8e34c8b3cec84078bbb2121ae4a279de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:04:34.386659 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.388012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:34.425990 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:34.442471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1296/2601] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:34.450185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9250f54-b657-401a-9d12-76402955bc41 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.450473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9250f54-b657-401a-9d12-76402955bc41 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.450752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9250f54-b657-401a-9d12-76402955bc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.459369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:34.459561 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e7096-f87f-4695-8de0-965b7ffa0722 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.464886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.465588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.465983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.466183 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] PATH_INFO: `/v3/users/8ed4e38b08ba4cd5baaa7890697a851c` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.467681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed4e38b08ba4cd5baaa7890697a851c)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:34.469750 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:34.473295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a9250f54-b657-401a-9d12-76402955bc41 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:34.475047 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a9250f54-b657-401a-9d12-76402955bc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:34.484387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1297/2602] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:04:34.488589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9250f54-b657-401a-9d12-76402955bc41 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.498254 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9250f54-b657-401a-9d12-76402955bc41 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.503262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f1ca1-6885-486d-86c8-a74f53d25de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.503845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f1ca1-6885-486d-86c8-a74f53d25de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.504297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f1ca1-6885-486d-86c8-a74f53d25de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.504569 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f1ca1-6885-486d-86c8-a74f53d25de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.505259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f1ca1-6885-486d-86c8-a74f53d25de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:34.505564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f1ca1-6885-486d-86c8-a74f53d25de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:34.507131 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f1ca1-6885-486d-86c8-a74f53d25de4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:34.518764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1298/2603] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:34.520129 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed4e38b08ba4cd5baaa7890697a851c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.520822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed4e38b08ba4cd5baaa7890697a851c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.523001 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f1ca1-6885-486d-86c8-a74f53d25de4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.528640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed4e38b08ba4cd5baaa7890697a851c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.533462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f1ca1-6885-486d-86c8-a74f53d25de4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.538208 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319944ed-2442-4bcc-9f40-613d4d2c82bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.538807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319944ed-2442-4bcc-9f40-613d4d2c82bf admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.539642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319944ed-2442-4bcc-9f40-613d4d2c82bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.539941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319944ed-2442-4bcc-9f40-613d4d2c82bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.540630 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319944ed-2442-4bcc-9f40-613d4d2c82bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:34.542381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed4e38b08ba4cd5baaa7890697a851c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.542605 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319944ed-2442-4bcc-9f40-613d4d2c82bf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:34.549533 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed4e38b08ba4cd5baaa7890697a851c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.557167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1306/2604] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:34 2022] DELETE /identity/v3/users/8ed4e38b08ba4cd5baaa7890697a851c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:04:34.573476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1299/2605] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:34 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:04:34.574593 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.575996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:34.644504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e04bc9-db31-42b6-982b-a4265367a9f1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.704110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91134fd-7e77-4e24-919e-0e90c679858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.705061 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91134fd-7e77-4e24-919e-0e90c679858e admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.705340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91134fd-7e77-4e24-919e-0e90c679858e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.705614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91134fd-7e77-4e24-919e-0e90c679858e admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.706276 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91134fd-7e77-4e24-919e-0e90c679858e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:34.708232 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91134fd-7e77-4e24-919e-0e90c679858e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:34.716887 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:34.735253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1307/2606] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:34 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:04:34.736372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319944ed-2442-4bcc-9f40-613d4d2c82bf admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.737926 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-319944ed-2442-4bcc-9f40-613d4d2c82bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:34.741062 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91134fd-7e77-4e24-919e-0e90c679858e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.751186 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91134fd-7e77-4e24-919e-0e90c679858e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.757311 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a31f0-bd25-4223-856d-44880e632639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.758081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a31f0-bd25-4223-856d-44880e632639 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.758358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a31f0-bd25-4223-856d-44880e632639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.758727 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a31f0-bd25-4223-856d-44880e632639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.759335 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a31f0-bd25-4223-856d-44880e632639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:34.760978 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a31f0-bd25-4223-856d-44880e632639 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:34.769550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319944ed-2442-4bcc-9f40-613d4d2c82bf admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.771318 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1308/2607] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:34.775297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.775795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a31f0-bd25-4223-856d-44880e632639 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.776350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.776703 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.777051 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c admin admin] PATH_INFO: `/v3/projects/e6f332980ae440069caad14ecc2acf3d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.778369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f332980ae440069caad14ecc2acf3d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:34.780377 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:34.785631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a31f0-bd25-4223-856d-44880e632639 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.791601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c23f20-b89f-445a-b02b-a430f650c645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.792295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c23f20-b89f-445a-b02b-a430f650c645 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.792582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c23f20-b89f-445a-b02b-a430f650c645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.792905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c23f20-b89f-445a-b02b-a430f650c645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.793596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c23f20-b89f-445a-b02b-a430f650c645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:34.795169 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c23f20-b89f-445a-b02b-a430f650c645 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:34.808085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1309/2608] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:04:34.812574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c23f20-b89f-445a-b02b-a430f650c645 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.822345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c23f20-b89f-445a-b02b-a430f650c645 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.832673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f332980ae440069caad14ecc2acf3d', 'request_id': 'req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.838815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f332980ae440069caad14ecc2acf3d', 'request_id': 'req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.845122 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f332980ae440069caad14ecc2acf3d', 'request_id': 'req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.858623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c admin admin] The token cache is being invalidate because project e6f332980ae440069caad14ecc2acf3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:34.858843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.859486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6b2e05e1-c9e4-4fa9-b679-a94436dc1a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:34.861299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1300/2609] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:34 2022] DELETE /identity/v3/projects/e6f332980ae440069caad14ecc2acf3d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:34.883472 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1dd4cd-5e77-40bb-9530-70cf5829107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.884224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dd4cd-5e77-40bb-9530-70cf5829107f admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.884493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dd4cd-5e77-40bb-9530-70cf5829107f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.885268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dd4cd-5e77-40bb-9530-70cf5829107f admin admin] PATH_INFO: `/v3/projects/8d27c7726c4446f1a9b3f03bc382ab7b/users/d684b4afc05448c5a51eb4c9e2d8eb53/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.902422 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1dd4cd-5e77-40bb-9530-70cf5829107f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d27c7726c4446f1a9b3f03bc382ab7b, user_id=d684b4afc05448c5a51eb4c9e2d8eb53, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:34.905159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1dd4cd-5e77-40bb-9530-70cf5829107f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:34.922018 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1310/2610] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:34 2022] PUT /identity/v3/projects/8d27c7726c4446f1a9b3f03bc382ab7b/users/d684b4afc05448c5a51eb4c9e2d8eb53/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:04:34.934229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f76d-97f8-4214-a6b2-3ee085b0b9f0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.934517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f76d-97f8-4214-a6b2-3ee085b0b9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.934793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f76d-97f8-4214-a6b2-3ee085b0b9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.966223 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7fc1f76d-97f8-4214-a6b2-3ee085b0b9f0 None None] MFA Rules not processed for user `d684b4afc05448c5a51eb4c9e2d8eb53`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:34.967453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7fc1f76d-97f8-4214-a6b2-3ee085b0b9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:35.041108 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1301/2611] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:04:35.045837 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1dd4cd-5e77-40bb-9530-70cf5829107f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.047686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8b1dd4cd-5e77-40bb-9530-70cf5829107f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:35.116574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1dd4cd-5e77-40bb-9530-70cf5829107f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.121884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef6613-0c4e-4acf-be72-7a8ce04ae12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.122529 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef6613-0c4e-4acf-be72-7a8ce04ae12a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.122811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef6613-0c4e-4acf-be72-7a8ce04ae12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.123087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef6613-0c4e-4acf-be72-7a8ce04ae12a admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.123780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef6613-0c4e-4acf-be72-7a8ce04ae12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.125772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef6613-0c4e-4acf-be72-7a8ce04ae12a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.153636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1311/2612] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:35 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:35.157875 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f76d-97f8-4214-a6b2-3ee085b0b9f0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.169024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f76d-97f8-4214-a6b2-3ee085b0b9f0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.201012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:35.227202 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961b85b-75f7-4cb9-a559-7c4c08b6c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.227808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961b85b-75f7-4cb9-a559-7c4c08b6c477 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.228089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961b85b-75f7-4cb9-a559-7c4c08b6c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.228402 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961b85b-75f7-4cb9-a559-7c4c08b6c477 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.229061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961b85b-75f7-4cb9-a559-7c4c08b6c477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.230948 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961b85b-75f7-4cb9-a559-7c4c08b6c477 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.252644 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1302/2613] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:35 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:35.256901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef6613-0c4e-4acf-be72-7a8ce04ae12a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.267461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef6613-0c4e-4acf-be72-7a8ce04ae12a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.272295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe26e56-4cbc-4442-b134-303447f8ff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.272929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26e56-4cbc-4442-b134-303447f8ff18 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.273254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26e56-4cbc-4442-b134-303447f8ff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.273520 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26e56-4cbc-4442-b134-303447f8ff18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.274246 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe26e56-4cbc-4442-b134-303447f8ff18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.275910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe26e56-4cbc-4442-b134-303447f8ff18 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.286596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1312/2614] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:35.291063 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961b85b-75f7-4cb9-a559-7c4c08b6c477 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.300975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961b85b-75f7-4cb9-a559-7c4c08b6c477 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.306194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8dd62-f3f1-42a4-9a03-f1ac025a6659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.306795 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8dd62-f3f1-42a4-9a03-f1ac025a6659 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.307076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8dd62-f3f1-42a4-9a03-f1ac025a6659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.307349 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8dd62-f3f1-42a4-9a03-f1ac025a6659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.308035 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8dd62-f3f1-42a4-9a03-f1ac025a6659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.309642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8dd62-f3f1-42a4-9a03-f1ac025a6659 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.319768 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1303/2615] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:35.323778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe26e56-4cbc-4442-b134-303447f8ff18 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.334048 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe26e56-4cbc-4442-b134-303447f8ff18 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.339193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36fe1-868d-4aab-a69b-ec8d4d16953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.339849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36fe1-868d-4aab-a69b-ec8d4d16953f admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.340163 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36fe1-868d-4aab-a69b-ec8d4d16953f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.340450 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36fe1-868d-4aab-a69b-ec8d4d16953f admin admin] PATH_INFO: `/v3/projects/414050060c09494bbc0b2b3e29cb49b3/users/3189764cec6948899f6361ba1f184b1f/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.357139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc36fe1-868d-4aab-a69b-ec8d4d16953f admin admin] RBAC: Authorizing `identity:create_grant(project_id=414050060c09494bbc0b2b3e29cb49b3, user_id=3189764cec6948899f6361ba1f184b1f, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.359790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc36fe1-868d-4aab-a69b-ec8d4d16953f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.368619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:35.374739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1313/2616] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:35 2022] PUT /identity/v3/projects/414050060c09494bbc0b2b3e29cb49b3/users/3189764cec6948899f6361ba1f184b1f/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:35.388650 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bf5d4-24b1-4c36-82ee-667f7d586290 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.388944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bf5d4-24b1-4c36-82ee-667f7d586290 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.389396 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bf5d4-24b1-4c36-82ee-667f7d586290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.418295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-207bf5d4-24b1-4c36-82ee-667f7d586290 None None] MFA Rules not processed for user `3189764cec6948899f6361ba1f184b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:35.419685 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-207bf5d4-24b1-4c36-82ee-667f7d586290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:35.486334 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1304/2617] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:35.490814 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36fe1-868d-4aab-a69b-ec8d4d16953f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.552615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36fe1-868d-4aab-a69b-ec8d4d16953f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.557252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22859fb-8cea-462b-9909-eb6fb50cb3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.557898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22859fb-8cea-462b-9909-eb6fb50cb3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.558183 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22859fb-8cea-462b-9909-eb6fb50cb3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.558455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22859fb-8cea-462b-9909-eb6fb50cb3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.559109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22859fb-8cea-462b-9909-eb6fb50cb3a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.561047 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22859fb-8cea-462b-9909-eb6fb50cb3a9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.587405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1314/2618] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:35 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:35.591546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bf5d4-24b1-4c36-82ee-667f7d586290 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.602901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bf5d4-24b1-4c36-82ee-667f7d586290 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.659273 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815134b9-ce32-44b8-9b59-421d36605b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.659826 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815134b9-ce32-44b8-9b59-421d36605b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.660136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815134b9-ce32-44b8-9b59-421d36605b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.660421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815134b9-ce32-44b8-9b59-421d36605b74 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.661102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815134b9-ce32-44b8-9b59-421d36605b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.663376 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815134b9-ce32-44b8-9b59-421d36605b74 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.686259 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1305/2619] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:35 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:35.690345 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22859fb-8cea-462b-9909-eb6fb50cb3a9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.701406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22859fb-8cea-462b-9909-eb6fb50cb3a9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.706265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c0265-8d14-47f9-94c6-ed29b4a447d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.706865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c0265-8d14-47f9-94c6-ed29b4a447d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.707149 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c0265-8d14-47f9-94c6-ed29b4a447d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.707427 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c0265-8d14-47f9-94c6-ed29b4a447d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.708136 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c0265-8d14-47f9-94c6-ed29b4a447d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.709747 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c0265-8d14-47f9-94c6-ed29b4a447d9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.721074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1315/2620] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:04:35.725547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815134b9-ce32-44b8-9b59-421d36605b74 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.735574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815134b9-ce32-44b8-9b59-421d36605b74 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.740081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1211ac-9cf0-4b88-9a22-ca2a3bbc6b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.740775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1211ac-9cf0-4b88-9a22-ca2a3bbc6b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.741059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1211ac-9cf0-4b88-9a22-ca2a3bbc6b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.741336 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1211ac-9cf0-4b88-9a22-ca2a3bbc6b74 admin admin] PATH_INFO: `/v3/projects/a0db21868f244d3db0af1f95f13ebf8b/users/adde2163f12a4e648ccf44749cbfb46b/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.756879 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1211ac-9cf0-4b88-9a22-ca2a3bbc6b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0db21868f244d3db0af1f95f13ebf8b, user_id=adde2163f12a4e648ccf44749cbfb46b, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.760228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1211ac-9cf0-4b88-9a22-ca2a3bbc6b74 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.772792 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1306/2621] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:35 2022] PUT /identity/v3/projects/a0db21868f244d3db0af1f95f13ebf8b/users/adde2163f12a4e648ccf44749cbfb46b/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:35.777509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c0265-8d14-47f9-94c6-ed29b4a447d9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.787606 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c0265-8d14-47f9-94c6-ed29b4a447d9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.843514 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda140d-8588-4098-8925-bf1b0bd0b1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.844160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda140d-8588-4098-8925-bf1b0bd0b1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.844444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda140d-8588-4098-8925-bf1b0bd0b1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.844717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda140d-8588-4098-8925-bf1b0bd0b1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.845497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda140d-8588-4098-8925-bf1b0bd0b1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.847090 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda140d-8588-4098-8925-bf1b0bd0b1f8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.856841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1316/2622] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:35.861721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1211ac-9cf0-4b88-9a22-ca2a3bbc6b74 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.872203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1211ac-9cf0-4b88-9a22-ca2a3bbc6b74 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.876764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672e61e-af33-4fec-8d5d-4252b54fb593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.877415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672e61e-af33-4fec-8d5d-4252b54fb593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.877697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672e61e-af33-4fec-8d5d-4252b54fb593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.877972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672e61e-af33-4fec-8d5d-4252b54fb593 admin admin] PATH_INFO: `/v3/projects/a0db21868f244d3db0af1f95f13ebf8b/users/adde2163f12a4e648ccf44749cbfb46b/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.879900 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672e61e-af33-4fec-8d5d-4252b54fb593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0db21868f244d3db0af1f95f13ebf8b, user_id=adde2163f12a4e648ccf44749cbfb46b, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.882526 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672e61e-af33-4fec-8d5d-4252b54fb593 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.886084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:35.895544 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1307/2623] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:35 2022] PUT /identity/v3/projects/a0db21868f244d3db0af1f95f13ebf8b/users/adde2163f12a4e648ccf44749cbfb46b/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:35.906254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0111609-a22a-4877-944e-c740b71b54ed None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.906544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0111609-a22a-4877-944e-c740b71b54ed None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.906825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0111609-a22a-4877-944e-c740b71b54ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.933907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d0111609-a22a-4877-944e-c740b71b54ed None None] MFA Rules not processed for user `adde2163f12a4e648ccf44749cbfb46b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:35.935033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d0111609-a22a-4877-944e-c740b71b54ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:35.993780 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:36.004067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1317/2624] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:04:36.016435 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672e61e-af33-4fec-8d5d-4252b54fb593 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:36.018248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0672e61e-af33-4fec-8d5d-4252b54fb593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:36.079222 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672e61e-af33-4fec-8d5d-4252b54fb593 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:36.083107 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960ec8a-b4ff-429f-8dc8-3870d54474e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:36.083713 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960ec8a-b4ff-429f-8dc8-3870d54474e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:36.083992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960ec8a-b4ff-429f-8dc8-3870d54474e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:36.084297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960ec8a-b4ff-429f-8dc8-3870d54474e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:36.138394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960ec8a-b4ff-429f-8dc8-3870d54474e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:36.139803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960ec8a-b4ff-429f-8dc8-3870d54474e0 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:36.149126 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1308/2625] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:37.649781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0111609-a22a-4877-944e-c740b71b54ed None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:37.651162 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d0111609-a22a-4877-944e-c740b71b54ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:37.663196 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0111609-a22a-4877-944e-c740b71b54ed None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:37.666784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c8d4b-d3c3-47e9-8df0-811711215165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:37.667387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c8d4b-d3c3-47e9-8df0-811711215165 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:37.667671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c8d4b-d3c3-47e9-8df0-811711215165 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:37.667946 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c8d4b-d3c3-47e9-8df0-811711215165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:37.724996 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c8d4b-d3c3-47e9-8df0-811711215165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:37.726438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c8d4b-d3c3-47e9-8df0-811711215165 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:37.735184 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1318/2626] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:38.259566 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960ec8a-b4ff-429f-8dc8-3870d54474e0 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:38.268282 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960ec8a-b4ff-429f-8dc8-3870d54474e0 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:38.272002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b7c86-2e28-4a1f-aa00-75f253c7f7f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:38.272794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b7c86-2e28-4a1f-aa00-75f253c7f7f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:38.273078 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b7c86-2e28-4a1f-aa00-75f253c7f7f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:38.274010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b7c86-2e28-4a1f-aa00-75f253c7f7f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:38.282951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b7c86-2e28-4a1f-aa00-75f253c7f7f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:38.284392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b7c86-2e28-4a1f-aa00-75f253c7f7f4 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:38.294177 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1309/2627] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:42.207961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c8d4b-d3c3-47e9-8df0-811711215165 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:42.394627 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c8d4b-d3c3-47e9-8df0-811711215165 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:42.399185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:42.399819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:42.400742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:42.400936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] PATH_INFO: `/v3/users/d684b4afc05448c5a51eb4c9e2d8eb53` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:42.402087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d684b4afc05448c5a51eb4c9e2d8eb53)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:42.403983 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:42.451947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd684b4afc05448c5a51eb4c9e2d8eb53'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:42.452630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd684b4afc05448c5a51eb4c9e2d8eb53'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:42.460312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd684b4afc05448c5a51eb4c9e2d8eb53'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:42.474316 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd684b4afc05448c5a51eb4c9e2d8eb53'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:42.481197 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd684b4afc05448c5a51eb4c9e2d8eb53'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:42.487148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1319/2628] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:42 2022] DELETE /identity/v3/users/d684b4afc05448c5a51eb4c9e2d8eb53 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:42.491724 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c9120-afe7-413d-95de-9108e8b760c9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:42.492211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c9120-afe7-413d-95de-9108e8b760c9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:42.492388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c9120-afe7-413d-95de-9108e8b760c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:42.511511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f73c9120-afe7-413d-95de-9108e8b760c9 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:42.512721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f73c9120-afe7-413d-95de-9108e8b760c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:42.569803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1310/2629] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:42.580445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:42.581884 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:42.596674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:42.640375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16994dbf-e68a-4672-9188-5669347f749d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:42.644035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d732b1-b866-4180-8ffa-b5716b677b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:42.644728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d732b1-b866-4180-8ffa-b5716b677b22 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:42.644954 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d732b1-b866-4180-8ffa-b5716b677b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:42.645227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d732b1-b866-4180-8ffa-b5716b677b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:42.654652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d732b1-b866-4180-8ffa-b5716b677b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:42.656066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d732b1-b866-4180-8ffa-b5716b677b22 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:42.665633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1320/2630] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:04:42.924622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c9120-afe7-413d-95de-9108e8b760c9 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:42.926046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f73c9120-afe7-413d-95de-9108e8b760c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:42.938236 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c9120-afe7-413d-95de-9108e8b760c9 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:42.943003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:42.943645 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:42.943922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:42.944219 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] PATH_INFO: `/v3/projects/8d27c7726c4446f1a9b3f03bc382ab7b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:42.945404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d27c7726c4446f1a9b3f03bc382ab7b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:42.947953 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:42.983676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:42.996578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d27c7726c4446f1a9b3f03bc382ab7b', 'request_id': 'req-64dde603-50fb-4d25-a8ee-26c3cc778840'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.001966 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d27c7726c4446f1a9b3f03bc382ab7b', 'request_id': 'req-64dde603-50fb-4d25-a8ee-26c3cc778840'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.008296 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d27c7726c4446f1a9b3f03bc382ab7b', 'request_id': 'req-64dde603-50fb-4d25-a8ee-26c3cc778840'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.021933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] The token cache is being invalidate because project 8d27c7726c4446f1a9b3f03bc382ab7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:43.022218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.022829 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.024352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1311/2631] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:42 2022] DELETE /identity/v3/projects/8d27c7726c4446f1a9b3f03bc382ab7b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:43.028355 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d732b1-b866-4180-8ffa-b5716b677b22 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:43.037976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d732b1-b866-4180-8ffa-b5716b677b22 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:43.093754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:43.094389 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:43.094678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:43.094953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] PATH_INFO: `/v3/users/3189764cec6948899f6361ba1f184b1f` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:43.096103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3189764cec6948899f6361ba1f184b1f)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:43.098054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:43.142262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3189764cec6948899f6361ba1f184b1f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.142906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3189764cec6948899f6361ba1f184b1f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.149895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3189764cec6948899f6361ba1f184b1f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.161796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3189764cec6948899f6361ba1f184b1f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.169974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3189764cec6948899f6361ba1f184b1f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.175795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1321/2632] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:43 2022] DELETE /identity/v3/users/3189764cec6948899f6361ba1f184b1f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:43.457669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:43.459308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:43.474430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dde603-50fb-4d25-a8ee-26c3cc778840 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:43.538153 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:43.538812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:43.539065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:43.539342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] PATH_INFO: `/v3/projects/414050060c09494bbc0b2b3e29cb49b3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:43.540517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=414050060c09494bbc0b2b3e29cb49b3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:43.543113 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:43.590592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414050060c09494bbc0b2b3e29cb49b3', 'request_id': 'req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.596411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414050060c09494bbc0b2b3e29cb49b3', 'request_id': 'req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.603861 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414050060c09494bbc0b2b3e29cb49b3', 'request_id': 'req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.617293 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] The token cache is being invalidate because project 414050060c09494bbc0b2b3e29cb49b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:43.617578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.618208 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.619799 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1312/2633] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:43 2022] DELETE /identity/v3/projects/414050060c09494bbc0b2b3e29cb49b3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:43.623899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:43.625402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:43.638069 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db8de8-fd36-442c-825c-801b402f4634 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:43.673952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:43.700256 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc62156-8e04-4c91-b02b-c18913026bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:43.700825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc62156-8e04-4c91-b02b-c18913026bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:43.701109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc62156-8e04-4c91-b02b-c18913026bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:43.701388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc62156-8e04-4c91-b02b-c18913026bcb admin admin] PATH_INFO: `/v3/users/adde2163f12a4e648ccf44749cbfb46b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:43.702550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc62156-8e04-4c91-b02b-c18913026bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=adde2163f12a4e648ccf44749cbfb46b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:43.704758 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc62156-8e04-4c91-b02b-c18913026bcb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:43.759017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4dc62156-8e04-4c91-b02b-c18913026bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adde2163f12a4e648ccf44749cbfb46b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.759699 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4dc62156-8e04-4c91-b02b-c18913026bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adde2163f12a4e648ccf44749cbfb46b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.768810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4dc62156-8e04-4c91-b02b-c18913026bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adde2163f12a4e648ccf44749cbfb46b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.782804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4dc62156-8e04-4c91-b02b-c18913026bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adde2163f12a4e648ccf44749cbfb46b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.789260 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4dc62156-8e04-4c91-b02b-c18913026bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adde2163f12a4e648ccf44749cbfb46b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:43.803112 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1322/2634] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:43 2022] DELETE /identity/v3/users/adde2163f12a4e648ccf44749cbfb46b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:44.093632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:44.095125 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:44.107653 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ab7f1-4b0a-42f0-a71b-9d5ed99c7f7f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:44.155399 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:44.167143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b2691-0918-4ff9-809e-e526dfd268e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:44.167784 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b2691-0918-4ff9-809e-e526dfd268e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:44.168065 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b2691-0918-4ff9-809e-e526dfd268e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:44.168373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b2691-0918-4ff9-809e-e526dfd268e7 admin admin] PATH_INFO: `/v3/projects/a0db21868f244d3db0af1f95f13ebf8b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:44.169533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b2691-0918-4ff9-809e-e526dfd268e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0db21868f244d3db0af1f95f13ebf8b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:44.171454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b2691-0918-4ff9-809e-e526dfd268e7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:44.217467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af8b2691-0918-4ff9-809e-e526dfd268e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0db21868f244d3db0af1f95f13ebf8b', 'request_id': 'req-af8b2691-0918-4ff9-809e-e526dfd268e7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:44.222920 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af8b2691-0918-4ff9-809e-e526dfd268e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0db21868f244d3db0af1f95f13ebf8b', 'request_id': 'req-af8b2691-0918-4ff9-809e-e526dfd268e7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:44.229297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af8b2691-0918-4ff9-809e-e526dfd268e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0db21868f244d3db0af1f95f13ebf8b', 'request_id': 'req-af8b2691-0918-4ff9-809e-e526dfd268e7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:44.241469 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af8b2691-0918-4ff9-809e-e526dfd268e7 admin admin] The token cache is being invalidate because project a0db21868f244d3db0af1f95f13ebf8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:44.241762 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af8b2691-0918-4ff9-809e-e526dfd268e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:44.242392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-af8b2691-0918-4ff9-809e-e526dfd268e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:44.244393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1313/2635] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:44 2022] DELETE /identity/v3/projects/a0db21868f244d3db0af1f95f13ebf8b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:44.249282 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8da5bd-c8fd-4d87-b95b-8f1376f6d2b4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:44.249580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8da5bd-c8fd-4d87-b95b-8f1376f6d2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:44.249864 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8da5bd-c8fd-4d87-b95b-8f1376f6d2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:44.269578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9f8da5bd-c8fd-4d87-b95b-8f1376f6d2b4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:44.270782 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9f8da5bd-c8fd-4d87-b95b-8f1376f6d2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:44.329683 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1323/2636] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:44.337341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d74256-d576-4a69-baf9-5175823adabe None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:44.337637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d74256-d576-4a69-baf9-5175823adabe None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:44.337920 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d74256-d576-4a69-baf9-5175823adabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:44.357043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a3d74256-d576-4a69-baf9-5175823adabe None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:44.358261 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a3d74256-d576-4a69-baf9-5175823adabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:44.365942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1314/2637] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:44.370724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8da5bd-c8fd-4d87-b95b-8f1376f6d2b4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:44.380229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8da5bd-c8fd-4d87-b95b-8f1376f6d2b4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:44.385310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c972e-17c6-4fad-b79e-e73a8064a205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:44.385911 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c972e-17c6-4fad-b79e-e73a8064a205 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:44.386193 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c972e-17c6-4fad-b79e-e73a8064a205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:44.386468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c972e-17c6-4fad-b79e-e73a8064a205 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:44.387158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c972e-17c6-4fad-b79e-e73a8064a205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:44.387464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c972e-17c6-4fad-b79e-e73a8064a205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:44.389079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c972e-17c6-4fad-b79e-e73a8064a205 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:44.400405 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1324/2638] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:44.404453 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d74256-d576-4a69-baf9-5175823adabe None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:44.413576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d74256-d576-4a69-baf9-5175823adabe None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:44.418175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d614b38-0971-4c30-9d21-2896ac344ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:44.418770 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614b38-0971-4c30-9d21-2896ac344ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:44.419050 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614b38-0971-4c30-9d21-2896ac344ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:44.419351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614b38-0971-4c30-9d21-2896ac344ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:44.420006 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d614b38-0971-4c30-9d21-2896ac344ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:44.421903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d614b38-0971-4c30-9d21-2896ac344ad3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:44.450384 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1315/2639] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:44 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:44.454703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c972e-17c6-4fad-b79e-e73a8064a205 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:44.464510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c972e-17c6-4fad-b79e-e73a8064a205 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:44.504160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:44.522315 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d83c1-785b-43ec-b95e-d25f7c695464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:44.522922 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d83c1-785b-43ec-b95e-d25f7c695464 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:44.523226 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d83c1-785b-43ec-b95e-d25f7c695464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:44.523500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d83c1-785b-43ec-b95e-d25f7c695464 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:44.524292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d83c1-785b-43ec-b95e-d25f7c695464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:44.526216 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d83c1-785b-43ec-b95e-d25f7c695464 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:44.546432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1325/2640] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:44 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:44.550521 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d614b38-0971-4c30-9d21-2896ac344ad3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:44.561246 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d614b38-0971-4c30-9d21-2896ac344ad3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:44.565842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc1d55-a011-4e8a-a6ac-0f6640cfc5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:44.566448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc1d55-a011-4e8a-a6ac-0f6640cfc5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:44.566726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc1d55-a011-4e8a-a6ac-0f6640cfc5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:44.566998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc1d55-a011-4e8a-a6ac-0f6640cfc5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:44.567683 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc1d55-a011-4e8a-a6ac-0f6640cfc5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:44.569298 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc1d55-a011-4e8a-a6ac-0f6640cfc5e3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:44.580026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1316/2641] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:44.583953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d83c1-785b-43ec-b95e-d25f7c695464 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:44.593759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d83c1-785b-43ec-b95e-d25f7c695464 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:44.598331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205df5b8-3ee2-4e70-aca1-20a5835d4888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:44.598942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df5b8-3ee2-4e70-aca1-20a5835d4888 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:44.599225 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df5b8-3ee2-4e70-aca1-20a5835d4888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:44.599500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df5b8-3ee2-4e70-aca1-20a5835d4888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:44.600229 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205df5b8-3ee2-4e70-aca1-20a5835d4888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:44.601814 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205df5b8-3ee2-4e70-aca1-20a5835d4888 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:44.612001 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1326/2642] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:44.615995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc1d55-a011-4e8a-a6ac-0f6640cfc5e3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:44.626774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc1d55-a011-4e8a-a6ac-0f6640cfc5e3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:44.631361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c5b47-0d59-415a-8555-8cff1fe14ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:44.632023 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c5b47-0d59-415a-8555-8cff1fe14ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:44.632343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c5b47-0d59-415a-8555-8cff1fe14ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:44.632622 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c5b47-0d59-415a-8555-8cff1fe14ee3 admin admin] PATH_INFO: `/v3/projects/4b7960c66a61441faa18ef4ba42f5e5e/users/e469194b140942bf929001c7e12a0933/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:44.647842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c5b47-0d59-415a-8555-8cff1fe14ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7960c66a61441faa18ef4ba42f5e5e, user_id=e469194b140942bf929001c7e12a0933, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:44.650514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c5b47-0d59-415a-8555-8cff1fe14ee3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:44.664362 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1317/2643] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:44 2022] PUT /identity/v3/projects/4b7960c66a61441faa18ef4ba42f5e5e/users/e469194b140942bf929001c7e12a0933/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:44.670648 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784175f2-e53f-4eb9-8215-7feda3970035 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:44.671150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784175f2-e53f-4eb9-8215-7feda3970035 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:44.671458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784175f2-e53f-4eb9-8215-7feda3970035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:44.694601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-784175f2-e53f-4eb9-8215-7feda3970035 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:44.695963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-784175f2-e53f-4eb9-8215-7feda3970035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:44.762565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1327/2644] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:44.777306 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c5b47-0d59-415a-8555-8cff1fe14ee3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:44.779072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9f3c5b47-0d59-415a-8555-8cff1fe14ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:44.843412 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c5b47-0d59-415a-8555-8cff1fe14ee3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:44.847130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d82095-cdf9-44d9-b539-e0e641353ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:44.847752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d82095-cdf9-44d9-b539-e0e641353ccb service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:44.848032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d82095-cdf9-44d9-b539-e0e641353ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:44.848340 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d82095-cdf9-44d9-b539-e0e641353ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:44.858287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d82095-cdf9-44d9-b539-e0e641353ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:44.859777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d82095-cdf9-44d9-b539-e0e641353ccb service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:44.870951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1318/2645] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:49.593339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc64806-8e09-4438-88ac-ca64f492e8ff None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:49.593826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc64806-8e09-4438-88ac-ca64f492e8ff None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:49.593931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc64806-8e09-4438-88ac-ca64f492e8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:49.629497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-afc64806-8e09-4438-88ac-ca64f492e8ff None None] MFA Rules not processed for user `e469194b140942bf929001c7e12a0933`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:49.630442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-afc64806-8e09-4438-88ac-ca64f492e8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:49.722117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1328/2646] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:49.727067 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d82095-cdf9-44d9-b539-e0e641353ccb service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:49.740164 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d82095-cdf9-44d9-b539-e0e641353ccb service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:49.745873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abaa26-4c6b-4b30-a091-d94b6c5cbc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:49.746752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abaa26-4c6b-4b30-a091-d94b6c5cbc68 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:49.747228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abaa26-4c6b-4b30-a091-d94b6c5cbc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:49.747666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abaa26-4c6b-4b30-a091-d94b6c5cbc68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:49.748558 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abaa26-4c6b-4b30-a091-d94b6c5cbc68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:49.751391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abaa26-4c6b-4b30-a091-d94b6c5cbc68 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:49.782326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:49.798379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1319/2647] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:49 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:49.799414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc64806-8e09-4438-88ac-ca64f492e8ff None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:49.823419 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc64806-8e09-4438-88ac-ca64f492e8ff None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:49.890787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:49.902612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc31db7-78e9-4d9b-9de5-1abcd2345193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:49.903454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc31db7-78e9-4d9b-9de5-1abcd2345193 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:49.903737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc31db7-78e9-4d9b-9de5-1abcd2345193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:49.904010 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc31db7-78e9-4d9b-9de5-1abcd2345193 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:49.904774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc31db7-78e9-4d9b-9de5-1abcd2345193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:49.906920 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc31db7-78e9-4d9b-9de5-1abcd2345193 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:49.936784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1329/2648] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:49 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:04:49.937807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abaa26-4c6b-4b30-a091-d94b6c5cbc68 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:49.948850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abaa26-4c6b-4b30-a091-d94b6c5cbc68 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:49.954301 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255891cd-8f4b-4f3c-b30f-979535c86d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:49.955171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255891cd-8f4b-4f3c-b30f-979535c86d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:49.955300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255891cd-8f4b-4f3c-b30f-979535c86d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:49.955599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255891cd-8f4b-4f3c-b30f-979535c86d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:49.956343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255891cd-8f4b-4f3c-b30f-979535c86d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:49.961069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255891cd-8f4b-4f3c-b30f-979535c86d06 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:49.974069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1320/2649] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:04:49.979746 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc31db7-78e9-4d9b-9de5-1abcd2345193 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:49.991174 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc31db7-78e9-4d9b-9de5-1abcd2345193 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:49.998556 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a9d9c-3f4e-4cd6-9670-f8e56c86ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:49.999338 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a9d9c-3f4e-4cd6-9670-f8e56c86ef20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:49.999693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a9d9c-3f4e-4cd6-9670-f8e56c86ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:50.000054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a9d9c-3f4e-4cd6-9670-f8e56c86ef20 admin admin] PATH_INFO: `/v3/projects/a3f510dd776842519420769b4c784fe4/users/47c6c60dc66c477f896403c4d9ed11ba/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:50.024540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a9d9c-3f4e-4cd6-9670-f8e56c86ef20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f510dd776842519420769b4c784fe4, user_id=47c6c60dc66c477f896403c4d9ed11ba, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:50.028273 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a9d9c-3f4e-4cd6-9670-f8e56c86ef20 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:50.049468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1330/2650] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:49 2022] PUT /identity/v3/projects/a3f510dd776842519420769b4c784fe4/users/47c6c60dc66c477f896403c4d9ed11ba/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:04:50.053476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255891cd-8f4b-4f3c-b30f-979535c86d06 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:50.065487 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255891cd-8f4b-4f3c-b30f-979535c86d06 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:50.145332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e3adb-d18f-406d-96de-f9ae909a8443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:50.146535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e3adb-d18f-406d-96de-f9ae909a8443 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:50.146535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e3adb-d18f-406d-96de-f9ae909a8443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:50.146752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e3adb-d18f-406d-96de-f9ae909a8443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:50.147357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e3adb-d18f-406d-96de-f9ae909a8443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:50.149115 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e3adb-d18f-406d-96de-f9ae909a8443 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:50.160646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1321/2651] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:50.164994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a9d9c-3f4e-4cd6-9670-f8e56c86ef20 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:50.176772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a9d9c-3f4e-4cd6-9670-f8e56c86ef20 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:50.182641 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4f8c4-4752-4e5c-8c2c-1211b016d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:50.183628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4f8c4-4752-4e5c-8c2c-1211b016d609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:50.184138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4f8c4-4752-4e5c-8c2c-1211b016d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:50.184580 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4f8c4-4752-4e5c-8c2c-1211b016d609 admin admin] PATH_INFO: `/v3/projects/a3f510dd776842519420769b4c784fe4/users/47c6c60dc66c477f896403c4d9ed11ba/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:50.187560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4f8c4-4752-4e5c-8c2c-1211b016d609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f510dd776842519420769b4c784fe4, user_id=47c6c60dc66c477f896403c4d9ed11ba, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:50.190487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4f8c4-4752-4e5c-8c2c-1211b016d609 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:50.202574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1331/2652] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:50 2022] PUT /identity/v3/projects/a3f510dd776842519420769b4c784fe4/users/47c6c60dc66c477f896403c4d9ed11ba/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:53.377162 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e3adb-d18f-406d-96de-f9ae909a8443 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:53.462363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e3adb-d18f-406d-96de-f9ae909a8443 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:53.583503 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fe551-91f6-4661-8b65-6f5abc55c20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:53.584700 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fe551-91f6-4661-8b65-6f5abc55c20b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:53.585201 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fe551-91f6-4661-8b65-6f5abc55c20b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:53.586114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fe551-91f6-4661-8b65-6f5abc55c20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:53.588606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-393fe551-91f6-4661-8b65-6f5abc55c20b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:53.682431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:53.703237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fe551-91f6-4661-8b65-6f5abc55c20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:53.706563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fe551-91f6-4661-8b65-6f5abc55c20b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:53.741426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1322/2653] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:55.023102 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f8527-e33d-458f-82a4-964bc785da8a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:55.023563 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f8527-e33d-458f-82a4-964bc785da8a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:55.023667 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f8527-e33d-458f-82a4-964bc785da8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:55.061532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-026f8527-e33d-458f-82a4-964bc785da8a None None] MFA Rules not processed for user `47c6c60dc66c477f896403c4d9ed11ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:55.062902 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-026f8527-e33d-458f-82a4-964bc785da8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:55.187953 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1332/2654] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:55.204291 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fe551-91f6-4661-8b65-6f5abc55c20b service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:55.205743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-393fe551-91f6-4661-8b65-6f5abc55c20b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:55.332961 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fe551-91f6-4661-8b65-6f5abc55c20b service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:55.344862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4b70a-9e8c-4b4b-bc97-2cbf0040e8fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:55.345606 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4b70a-9e8c-4b4b-bc97-2cbf0040e8fc service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:55.345972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4b70a-9e8c-4b4b-bc97-2cbf0040e8fc service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:55.346317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4b70a-9e8c-4b4b-bc97-2cbf0040e8fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:55.416668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4b70a-9e8c-4b4b-bc97-2cbf0040e8fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:55.418284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4b70a-9e8c-4b4b-bc97-2cbf0040e8fc service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:55.428380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1323/2655] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:58.259179 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f8527-e33d-458f-82a4-964bc785da8a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:58.261688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-026f8527-e33d-458f-82a4-964bc785da8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:58.277618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f8527-e33d-458f-82a4-964bc785da8a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:58.282451 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297936b-9419-4333-aa61-bff4ac03be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:58.283327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297936b-9419-4333-aa61-bff4ac03be1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:58.284063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297936b-9419-4333-aa61-bff4ac03be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:58.284425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297936b-9419-4333-aa61-bff4ac03be1b admin admin] PATH_INFO: `/v3/users/e846d960fa87451db8ae291e22b3cb7b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:58.285603 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297936b-9419-4333-aa61-bff4ac03be1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e846d960fa87451db8ae291e22b3cb7b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:58.287510 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297936b-9419-4333-aa61-bff4ac03be1b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:58.388558 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3297936b-9419-4333-aa61-bff4ac03be1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e846d960fa87451db8ae291e22b3cb7b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:58.389619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3297936b-9419-4333-aa61-bff4ac03be1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e846d960fa87451db8ae291e22b3cb7b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:58.402019 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3297936b-9419-4333-aa61-bff4ac03be1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e846d960fa87451db8ae291e22b3cb7b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:58.416578 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3297936b-9419-4333-aa61-bff4ac03be1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e846d960fa87451db8ae291e22b3cb7b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:58.426528 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3297936b-9419-4333-aa61-bff4ac03be1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e846d960fa87451db8ae291e22b3cb7b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:58.429140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:58.434123 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1333/2656] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:04:58 2022] DELETE /identity/v3/users/e846d960fa87451db8ae291e22b3cb7b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:58.644491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4b70a-9e8c-4b4b-bc97-2cbf0040e8fc service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:58.658178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4b70a-9e8c-4b4b-bc97-2cbf0040e8fc service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:58.726335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:58.726989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:58.727276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:58.728148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc admin admin] PATH_INFO: `/v3/projects/1cb1f802c78a4317a0af32afb533eb8a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:58.729467 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb1f802c78a4317a0af32afb533eb8a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:58.731389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:58.766075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:58.795815 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb1f802c78a4317a0af32afb533eb8a', 'request_id': 'req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:58.809350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb1f802c78a4317a0af32afb533eb8a', 'request_id': 'req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:58.820723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb1f802c78a4317a0af32afb533eb8a', 'request_id': 'req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:58.835576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc admin admin] The token cache is being invalidate because project 1cb1f802c78a4317a0af32afb533eb8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:04:58.835915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:58.836609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89a8b7bd-f0ac-4511-86c7-54aa9622f4cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:04:58.838647 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1324/2657] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:04:58 2022] DELETE /identity/v3/projects/1cb1f802c78a4317a0af32afb533eb8a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:58.844522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64a68-1c9b-42ea-8256-0c11aef5dc74 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:58.845533 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64a68-1c9b-42ea-8256-0c11aef5dc74 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:58.845934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64a68-1c9b-42ea-8256-0c11aef5dc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:58.866629 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5fc64a68-1c9b-42ea-8256-0c11aef5dc74 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:58.867848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5fc64a68-1c9b-42ea-8256-0c11aef5dc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:58.928221 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1334/2658] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:58.936164 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875777-cb68-453f-82e5-c20b2d1a0a93 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:58.936457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875777-cb68-453f-82e5-c20b2d1a0a93 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:58.936737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875777-cb68-453f-82e5-c20b2d1a0a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:58.959125 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c9875777-cb68-453f-82e5-c20b2d1a0a93 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:58.960363 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c9875777-cb68-453f-82e5-c20b2d1a0a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:58.968866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1325/2659] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:58.973207 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc64a68-1c9b-42ea-8256-0c11aef5dc74 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:58.982722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc64a68-1c9b-42ea-8256-0c11aef5dc74 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:58.987625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cb4d0-416d-41bc-bebb-41dbb3fcbd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:58.988470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cb4d0-416d-41bc-bebb-41dbb3fcbd1f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:58.988781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cb4d0-416d-41bc-bebb-41dbb3fcbd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:58.989054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cb4d0-416d-41bc-bebb-41dbb3fcbd1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:58.989752 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cb4d0-416d-41bc-bebb-41dbb3fcbd1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:58.990064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cb4d0-416d-41bc-bebb-41dbb3fcbd1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:58.991691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cb4d0-416d-41bc-bebb-41dbb3fcbd1f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:59.004055 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1335/2660] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:59.009167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875777-cb68-453f-82e5-c20b2d1a0a93 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:59.018324 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875777-cb68-453f-82e5-c20b2d1a0a93 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:59.022908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b5be6-fc76-4e49-a7d4-9d0f58c17e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:59.023551 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b5be6-fc76-4e49-a7d4-9d0f58c17e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.023836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b5be6-fc76-4e49-a7d4-9d0f58c17e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.024107 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b5be6-fc76-4e49-a7d4-9d0f58c17e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.025409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b5be6-fc76-4e49-a7d4-9d0f58c17e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:59.027628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b5be6-fc76-4e49-a7d4-9d0f58c17e67 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:59.055308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1326/2661] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:59 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:59.059777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cb4d0-416d-41bc-bebb-41dbb3fcbd1f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:59.070658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cb4d0-416d-41bc-bebb-41dbb3fcbd1f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:59.128473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f714d0-4410-4523-bb61-f91a293c0705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:59.129093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f714d0-4410-4523-bb61-f91a293c0705 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.129380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f714d0-4410-4523-bb61-f91a293c0705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.129658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f714d0-4410-4523-bb61-f91a293c0705 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.130334 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f714d0-4410-4523-bb61-f91a293c0705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:59.132286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f714d0-4410-4523-bb61-f91a293c0705 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:59.155826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1336/2662] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:59 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:59.160338 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b5be6-fc76-4e49-a7d4-9d0f58c17e67 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:59.170529 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b5be6-fc76-4e49-a7d4-9d0f58c17e67 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:59.175055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a7400-b5a2-4da1-9eb3-5b549f5f735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:59.175656 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a7400-b5a2-4da1-9eb3-5b549f5f735e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.175946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a7400-b5a2-4da1-9eb3-5b549f5f735e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.176239 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a7400-b5a2-4da1-9eb3-5b549f5f735e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.176923 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a7400-b5a2-4da1-9eb3-5b549f5f735e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:59.178554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a7400-b5a2-4da1-9eb3-5b549f5f735e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:59.189208 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1327/2663] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:59.193388 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f714d0-4410-4523-bb61-f91a293c0705 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:59.204282 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f714d0-4410-4523-bb61-f91a293c0705 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:59.208833 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f69b0-12ad-4d64-bad0-059f019e48ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:59.209445 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f69b0-12ad-4d64-bad0-059f019e48ab admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.209728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f69b0-12ad-4d64-bad0-059f019e48ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.210006 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f69b0-12ad-4d64-bad0-059f019e48ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.210705 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f69b0-12ad-4d64-bad0-059f019e48ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:59.213103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f69b0-12ad-4d64-bad0-059f019e48ab admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:59.225190 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1337/2664] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:59.229327 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a7400-b5a2-4da1-9eb3-5b549f5f735e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:59.239463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a7400-b5a2-4da1-9eb3-5b549f5f735e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:59.244560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5381a-915a-4941-afc5-6417bfa22f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:59.245218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5381a-915a-4941-afc5-6417bfa22f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.245498 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5381a-915a-4941-afc5-6417bfa22f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.245774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5381a-915a-4941-afc5-6417bfa22f3e admin admin] PATH_INFO: `/v3/projects/d320d35647ec44e69b5aefd76ee9a802/users/b9591cff8a1548d2be8e6468f46c2bed/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.261328 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5381a-915a-4941-afc5-6417bfa22f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d320d35647ec44e69b5aefd76ee9a802, user_id=b9591cff8a1548d2be8e6468f46c2bed, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:59.264505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5381a-915a-4941-afc5-6417bfa22f3e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:59.280607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1328/2665] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:59 2022] PUT /identity/v3/projects/d320d35647ec44e69b5aefd76ee9a802/users/b9591cff8a1548d2be8e6468f46c2bed/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:59.291748 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d447c-33ea-4d12-bfd4-84dce4a70538 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.292263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d447c-33ea-4d12-bfd4-84dce4a70538 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.292437 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d447c-33ea-4d12-bfd4-84dce4a70538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.322433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fd7d447c-33ea-4d12-bfd4-84dce4a70538 None None] MFA Rules not processed for user `b9591cff8a1548d2be8e6468f46c2bed`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:59.323654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fd7d447c-33ea-4d12-bfd4-84dce4a70538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:59.379696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:59.390145 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1338/2666] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:59.394723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5381a-915a-4941-afc5-6417bfa22f3e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:59.457594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5381a-915a-4941-afc5-6417bfa22f3e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:59.462130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ccb15-81c5-4981-ac5d-4ca2f35f6596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:59.462746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ccb15-81c5-4981-ac5d-4ca2f35f6596 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.463028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ccb15-81c5-4981-ac5d-4ca2f35f6596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.463303 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ccb15-81c5-4981-ac5d-4ca2f35f6596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.463964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ccb15-81c5-4981-ac5d-4ca2f35f6596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:59.465883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ccb15-81c5-4981-ac5d-4ca2f35f6596 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:59.500043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1329/2667] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:04:59 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:59.505201 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d447c-33ea-4d12-bfd4-84dce4a70538 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:59.517777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d447c-33ea-4d12-bfd4-84dce4a70538 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:59.583787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94a633-cf63-4f3c-ae58-e66abfee3f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:59.584485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94a633-cf63-4f3c-ae58-e66abfee3f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.584767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94a633-cf63-4f3c-ae58-e66abfee3f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.585032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94a633-cf63-4f3c-ae58-e66abfee3f25 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.585692 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94a633-cf63-4f3c-ae58-e66abfee3f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:59.588016 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94a633-cf63-4f3c-ae58-e66abfee3f25 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:59.612203 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1339/2668] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:59 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:59.616105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ccb15-81c5-4981-ac5d-4ca2f35f6596 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:59.627269 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ccb15-81c5-4981-ac5d-4ca2f35f6596 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:59.631977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650ee6b-f545-4e7b-9b2f-0aa00e6cff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:59.632779 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650ee6b-f545-4e7b-9b2f-0aa00e6cff0e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.633133 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650ee6b-f545-4e7b-9b2f-0aa00e6cff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.633787 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650ee6b-f545-4e7b-9b2f-0aa00e6cff0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.634507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650ee6b-f545-4e7b-9b2f-0aa00e6cff0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:59.638405 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650ee6b-f545-4e7b-9b2f-0aa00e6cff0e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:59.650596 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1330/2669] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:59.654806 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94a633-cf63-4f3c-ae58-e66abfee3f25 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:59.667454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94a633-cf63-4f3c-ae58-e66abfee3f25 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:59.673051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b03ab-c8af-47c2-972e-834ce51dd8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:59.673905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b03ab-c8af-47c2-972e-834ce51dd8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.674316 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b03ab-c8af-47c2-972e-834ce51dd8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.674704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b03ab-c8af-47c2-972e-834ce51dd8f7 admin admin] PATH_INFO: `/v3/projects/993c313c6f4644f9880e48125adc0c6a/users/8edd1db3064f49de828e26e14b0854b1/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.691461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b03ab-c8af-47c2-972e-834ce51dd8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=993c313c6f4644f9880e48125adc0c6a, user_id=8edd1db3064f49de828e26e14b0854b1, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:59.694164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b03ab-c8af-47c2-972e-834ce51dd8f7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:59.711517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1340/2670] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:59 2022] PUT /identity/v3/projects/993c313c6f4644f9880e48125adc0c6a/users/8edd1db3064f49de828e26e14b0854b1/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:59.713361 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650ee6b-f545-4e7b-9b2f-0aa00e6cff0e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:59.725294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650ee6b-f545-4e7b-9b2f-0aa00e6cff0e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:59.758243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:59.798493 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80f044-18b2-4e44-aa7c-b95732bb290a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:59.798673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80f044-18b2-4e44-aa7c-b95732bb290a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.798959 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80f044-18b2-4e44-aa7c-b95732bb290a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.799312 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80f044-18b2-4e44-aa7c-b95732bb290a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.800225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80f044-18b2-4e44-aa7c-b95732bb290a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:59.801919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80f044-18b2-4e44-aa7c-b95732bb290a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:59.818534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1331/2671] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:59.824454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b03ab-c8af-47c2-972e-834ce51dd8f7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:59.846069 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b03ab-c8af-47c2-972e-834ce51dd8f7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:59.851808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab61fa-d14d-478f-9502-a60bfe09d6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:59.853850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab61fa-d14d-478f-9502-a60bfe09d6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.854135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab61fa-d14d-478f-9502-a60bfe09d6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.854418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab61fa-d14d-478f-9502-a60bfe09d6dd admin admin] PATH_INFO: `/v3/projects/993c313c6f4644f9880e48125adc0c6a/users/8edd1db3064f49de828e26e14b0854b1/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.856523 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab61fa-d14d-478f-9502-a60bfe09d6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=993c313c6f4644f9880e48125adc0c6a, user_id=8edd1db3064f49de828e26e14b0854b1, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:59.859341 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab61fa-d14d-478f-9502-a60bfe09d6dd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:59.871503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1341/2672] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:04:59 2022] PUT /identity/v3/projects/993c313c6f4644f9880e48125adc0c6a/users/8edd1db3064f49de828e26e14b0854b1/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:04:59.882594 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420833-7659-47a5-8138-22b888f7e7c2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:59.882885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420833-7659-47a5-8138-22b888f7e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:59.883161 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420833-7659-47a5-8138-22b888f7e7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:59.912323 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7b420833-7659-47a5-8138-22b888f7e7c2 None None] MFA Rules not processed for user `8edd1db3064f49de828e26e14b0854b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:59.913560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7b420833-7659-47a5-8138-22b888f7e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:59.982171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1332/2673] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:04:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:59.994299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab61fa-d14d-478f-9502-a60bfe09d6dd admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:59.996136 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a5ab61fa-d14d-478f-9502-a60bfe09d6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:00.054826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab61fa-d14d-478f-9502-a60bfe09d6dd admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:00.059013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7db1c-b56a-4d8c-8c03-6eedc359bfc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:00.059633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7db1c-b56a-4d8c-8c03-6eedc359bfc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:00.059916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7db1c-b56a-4d8c-8c03-6eedc359bfc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:00.060227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7db1c-b56a-4d8c-8c03-6eedc359bfc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:00.069110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7db1c-b56a-4d8c-8c03-6eedc359bfc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:00.070540 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7db1c-b56a-4d8c-8c03-6eedc359bfc2 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:00.081479 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1342/2674] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:05:00.125134 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b420833-7659-47a5-8138-22b888f7e7c2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:00.126726 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7b420833-7659-47a5-8138-22b888f7e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:00.139341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b420833-7659-47a5-8138-22b888f7e7c2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:00.142890 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aea1f8-ad86-4e94-aac4-c1340b2b0e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:00.143473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aea1f8-ad86-4e94-aac4-c1340b2b0e57 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:00.143752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aea1f8-ad86-4e94-aac4-c1340b2b0e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:00.144026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aea1f8-ad86-4e94-aac4-c1340b2b0e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:00.211444 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aea1f8-ad86-4e94-aac4-c1340b2b0e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:00.212910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aea1f8-ad86-4e94-aac4-c1340b2b0e57 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:00.221604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1333/2675] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:05:03.609170 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7db1c-b56a-4d8c-8c03-6eedc359bfc2 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:03.667549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:03.682437 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7db1c-b56a-4d8c-8c03-6eedc359bfc2 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:03.687011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:03.687829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:03.688110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:03.688411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] PATH_INFO: `/v3/users/b9591cff8a1548d2be8e6468f46c2bed` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:03.689565 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9591cff8a1548d2be8e6468f46c2bed)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:03.691477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:03.741121 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9591cff8a1548d2be8e6468f46c2bed'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:03.741805 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9591cff8a1548d2be8e6468f46c2bed'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:03.751328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9591cff8a1548d2be8e6468f46c2bed'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:03.764764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9591cff8a1548d2be8e6468f46c2bed'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:03.771685 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9591cff8a1548d2be8e6468f46c2bed'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:03.777596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1343/2676] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:05:03 2022] DELETE /identity/v3/users/b9591cff8a1548d2be8e6468f46c2bed => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:03.782729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3192b0-5e55-4994-b66a-67d02e70a62f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:03.783345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3192b0-5e55-4994-b66a-67d02e70a62f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:03.783345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3192b0-5e55-4994-b66a-67d02e70a62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:03.802452 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0d3192b0-5e55-4994-b66a-67d02e70a62f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:03.808717 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0d3192b0-5e55-4994-b66a-67d02e70a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:03.852362 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:03.871931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1334/2677] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:03.881682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:03.883085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:03.942858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb3f68-e19b-4038-bdd6-f6d10d017ae9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:03.954961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7910d18-cb2a-4478-83d1-9109f3165042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:03.954961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7910d18-cb2a-4478-83d1-9109f3165042 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:03.954961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7910d18-cb2a-4478-83d1-9109f3165042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:03.954961 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7910d18-cb2a-4478-83d1-9109f3165042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:03.959715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7910d18-cb2a-4478-83d1-9109f3165042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:03.961181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7910d18-cb2a-4478-83d1-9109f3165042 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:03.972078 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1344/2678] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:05:04.262460 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3192b0-5e55-4994-b66a-67d02e70a62f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:04.264448 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0d3192b0-5e55-4994-b66a-67d02e70a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:04.278108 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3192b0-5e55-4994-b66a-67d02e70a62f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:04.282171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:04.282945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:04.283345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:04.283723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] PATH_INFO: `/v3/projects/d320d35647ec44e69b5aefd76ee9a802` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:04.285029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d320d35647ec44e69b5aefd76ee9a802)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:04.287016 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:04.348818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd320d35647ec44e69b5aefd76ee9a802', 'request_id': 'req-8d9dd52d-1075-4aa0-af93-768e11973c4b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.355001 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd320d35647ec44e69b5aefd76ee9a802', 'request_id': 'req-8d9dd52d-1075-4aa0-af93-768e11973c4b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.361642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd320d35647ec44e69b5aefd76ee9a802', 'request_id': 'req-8d9dd52d-1075-4aa0-af93-768e11973c4b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.375933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] The token cache is being invalidate because project d320d35647ec44e69b5aefd76ee9a802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:05:04.376837 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.377612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.380534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1335/2679] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:05:04 2022] DELETE /identity/v3/projects/d320d35647ec44e69b5aefd76ee9a802 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:04.384605 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7910d18-cb2a-4478-83d1-9109f3165042 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:04.394622 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7910d18-cb2a-4478-83d1-9109f3165042 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:04.451680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101c67f-07f0-4278-a148-dcb60c9eb2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:04.452356 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101c67f-07f0-4278-a148-dcb60c9eb2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:04.452643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101c67f-07f0-4278-a148-dcb60c9eb2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:04.452924 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101c67f-07f0-4278-a148-dcb60c9eb2db admin admin] PATH_INFO: `/v3/users/8edd1db3064f49de828e26e14b0854b1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:04.454333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101c67f-07f0-4278-a148-dcb60c9eb2db admin admin] RBAC: Authorizing `identity:delete_user(user_id=8edd1db3064f49de828e26e14b0854b1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:04.456301 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101c67f-07f0-4278-a148-dcb60c9eb2db admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:04.470619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:04.507052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d101c67f-07f0-4278-a148-dcb60c9eb2db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edd1db3064f49de828e26e14b0854b1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.507777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d101c67f-07f0-4278-a148-dcb60c9eb2db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edd1db3064f49de828e26e14b0854b1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.515012 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d101c67f-07f0-4278-a148-dcb60c9eb2db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edd1db3064f49de828e26e14b0854b1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.527522 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d101c67f-07f0-4278-a148-dcb60c9eb2db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edd1db3064f49de828e26e14b0854b1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.534687 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d101c67f-07f0-4278-a148-dcb60c9eb2db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edd1db3064f49de828e26e14b0854b1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.541144 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1345/2680] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:05:04 2022] DELETE /identity/v3/users/8edd1db3064f49de828e26e14b0854b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:04.826543 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:04.828004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:04.842089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dd52d-1075-4aa0-af93-768e11973c4b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:04.902619 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:04.903183 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:04.903470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:04.903857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8 admin admin] PATH_INFO: `/v3/projects/993c313c6f4644f9880e48125adc0c6a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:04.905195 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=993c313c6f4644f9880e48125adc0c6a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:04.907431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:04.956588 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '993c313c6f4644f9880e48125adc0c6a', 'request_id': 'req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.962161 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '993c313c6f4644f9880e48125adc0c6a', 'request_id': 'req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.968612 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '993c313c6f4644f9880e48125adc0c6a', 'request_id': 'req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.978560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:04.983118 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8 admin admin] The token cache is being invalidate because project 993c313c6f4644f9880e48125adc0c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:05:04.983573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.984714 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f01d3cd-5f9a-4a67-b71d-cd61dfd707a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:04.986371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1336/2681] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:05:04 2022] DELETE /identity/v3/projects/993c313c6f4644f9880e48125adc0c6a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:05:04.991464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fcbf5-b478-4401-a0a9-dd05a93e21e4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:04.991932 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fcbf5-b478-4401-a0a9-dd05a93e21e4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:04.992040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fcbf5-b478-4401-a0a9-dd05a93e21e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.013675 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a38fcbf5-b478-4401-a0a9-dd05a93e21e4 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:05.014872 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a38fcbf5-b478-4401-a0a9-dd05a93e21e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:05.074120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1346/2682] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:05.082449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296d0b-f9e6-4ce4-a4ed-dfee1b3785c8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.082739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296d0b-f9e6-4ce4-a4ed-dfee1b3785c8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.083020 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296d0b-f9e6-4ce4-a4ed-dfee1b3785c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.103111 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-dc296d0b-f9e6-4ce4-a4ed-dfee1b3785c8 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:05.104404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-dc296d0b-f9e6-4ce4-a4ed-dfee1b3785c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:05.113775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1337/2683] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:05.118934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fcbf5-b478-4401-a0a9-dd05a93e21e4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:05.128719 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fcbf5-b478-4401-a0a9-dd05a93e21e4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:05.133286 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db2257-0ad8-4ca6-9390-06dfd184ffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:05.133929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db2257-0ad8-4ca6-9390-06dfd184ffe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.134213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db2257-0ad8-4ca6-9390-06dfd184ffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.134487 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db2257-0ad8-4ca6-9390-06dfd184ffe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.135177 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db2257-0ad8-4ca6-9390-06dfd184ffe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:05:05.135485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db2257-0ad8-4ca6-9390-06dfd184ffe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:05.137106 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db2257-0ad8-4ca6-9390-06dfd184ffe9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:05.148577 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1347/2684] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:05.153559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296d0b-f9e6-4ce4-a4ed-dfee1b3785c8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:05.163038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296d0b-f9e6-4ce4-a4ed-dfee1b3785c8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:05.168106 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a235-ed77-4d32-9927-e2da5aa87247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:05.168746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a235-ed77-4d32-9927-e2da5aa87247 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.169022 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a235-ed77-4d32-9927-e2da5aa87247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.169297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a235-ed77-4d32-9927-e2da5aa87247 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.169946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3a235-ed77-4d32-9927-e2da5aa87247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:05.171803 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3a235-ed77-4d32-9927-e2da5aa87247 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:05.200090 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1338/2685] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:05:05 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:05:05.204534 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db2257-0ad8-4ca6-9390-06dfd184ffe9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:05.214761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db2257-0ad8-4ca6-9390-06dfd184ffe9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:05.273802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05286fa0-6e39-474e-a605-b205247cb60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:05.274970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05286fa0-6e39-474e-a605-b205247cb60c admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.275257 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05286fa0-6e39-474e-a605-b205247cb60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.275531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05286fa0-6e39-474e-a605-b205247cb60c admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.276265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05286fa0-6e39-474e-a605-b205247cb60c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:05.278232 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05286fa0-6e39-474e-a605-b205247cb60c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:05.301164 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1348/2686] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:05:05 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:05:05.304925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a235-ed77-4d32-9927-e2da5aa87247 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:05.319371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a235-ed77-4d32-9927-e2da5aa87247 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:05.324041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb92715-d073-4cf1-90b5-b343c0ae51f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:05.324760 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb92715-d073-4cf1-90b5-b343c0ae51f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.325101 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb92715-d073-4cf1-90b5-b343c0ae51f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.325461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb92715-d073-4cf1-90b5-b343c0ae51f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.326242 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb92715-d073-4cf1-90b5-b343c0ae51f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:05.327952 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb92715-d073-4cf1-90b5-b343c0ae51f7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:05.339329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1339/2687] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:05:05.343282 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05286fa0-6e39-474e-a605-b205247cb60c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:05.354502 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05286fa0-6e39-474e-a605-b205247cb60c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:05.359222 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9648776-35d9-496c-92aa-cb75fddc935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:05.359840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9648776-35d9-496c-92aa-cb75fddc935a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.360148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9648776-35d9-496c-92aa-cb75fddc935a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.360425 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9648776-35d9-496c-92aa-cb75fddc935a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.361120 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9648776-35d9-496c-92aa-cb75fddc935a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:05.362730 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9648776-35d9-496c-92aa-cb75fddc935a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:05.365070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:05.374582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1349/2688] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:05:05.379298 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb92715-d073-4cf1-90b5-b343c0ae51f7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:05.390839 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb92715-d073-4cf1-90b5-b343c0ae51f7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:05.396099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e1c32-0075-40f4-86d4-fd3291c2523a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:05.396896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e1c32-0075-40f4-86d4-fd3291c2523a admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.397183 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e1c32-0075-40f4-86d4-fd3291c2523a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.397464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e1c32-0075-40f4-86d4-fd3291c2523a admin admin] PATH_INFO: `/v3/projects/f269523f50654e1aa5c5e84e9a33cbe5/users/cbb0a31b9e2c40b498d552243cbb512c/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.412658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e1c32-0075-40f4-86d4-fd3291c2523a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f269523f50654e1aa5c5e84e9a33cbe5, user_id=cbb0a31b9e2c40b498d552243cbb512c, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:05.415893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e1c32-0075-40f4-86d4-fd3291c2523a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:05.429422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1340/2689] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:05:05 2022] PUT /identity/v3/projects/f269523f50654e1aa5c5e84e9a33cbe5/users/cbb0a31b9e2c40b498d552243cbb512c/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:05.440904 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1370ed-8f27-4f7e-9872-70e58e335bb9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.441217 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1370ed-8f27-4f7e-9872-70e58e335bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.441493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1370ed-8f27-4f7e-9872-70e58e335bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.471880 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-eb1370ed-8f27-4f7e-9872-70e58e335bb9 None None] MFA Rules not processed for user `cbb0a31b9e2c40b498d552243cbb512c`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:05.473875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-eb1370ed-8f27-4f7e-9872-70e58e335bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:05.547258 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1350/2690] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:05.551573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e1c32-0075-40f4-86d4-fd3291c2523a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:05.616643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e1c32-0075-40f4-86d4-fd3291c2523a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:05.622368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f12dd-2fd7-4b0d-804b-8cd4e72f2a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:05.622989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f12dd-2fd7-4b0d-804b-8cd4e72f2a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.623275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f12dd-2fd7-4b0d-804b-8cd4e72f2a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.623554 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f12dd-2fd7-4b0d-804b-8cd4e72f2a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.624602 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f12dd-2fd7-4b0d-804b-8cd4e72f2a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:05.626916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f12dd-2fd7-4b0d-804b-8cd4e72f2a7e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:05.654677 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1341/2691] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:05:05 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:05:05.658817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1370ed-8f27-4f7e-9872-70e58e335bb9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:05.670353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1370ed-8f27-4f7e-9872-70e58e335bb9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:05.728713 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef40d0-382c-40ee-a59f-20dd9c0a1aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:05.729330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef40d0-382c-40ee-a59f-20dd9c0a1aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.729611 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef40d0-382c-40ee-a59f-20dd9c0a1aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.729886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef40d0-382c-40ee-a59f-20dd9c0a1aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.730568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef40d0-382c-40ee-a59f-20dd9c0a1aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:05.732493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef40d0-382c-40ee-a59f-20dd9c0a1aa8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:05.754085 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1351/2692] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:05:05 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:05:05.758217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f12dd-2fd7-4b0d-804b-8cd4e72f2a7e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:05.768994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f12dd-2fd7-4b0d-804b-8cd4e72f2a7e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:05.773583 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b0caf-3cfd-42f9-9cdb-9e8a709098e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:05.774796 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b0caf-3cfd-42f9-9cdb-9e8a709098e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.775083 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b0caf-3cfd-42f9-9cdb-9e8a709098e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.775368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b0caf-3cfd-42f9-9cdb-9e8a709098e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.776083 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b0caf-3cfd-42f9-9cdb-9e8a709098e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:05.777701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b0caf-3cfd-42f9-9cdb-9e8a709098e3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:05.788415 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1342/2693] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:05:05.793249 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef40d0-382c-40ee-a59f-20dd9c0a1aa8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:05.804348 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef40d0-382c-40ee-a59f-20dd9c0a1aa8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:05.809521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9614e8-55a7-4514-876d-0070b3937fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:05.810200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9614e8-55a7-4514-876d-0070b3937fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.810486 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9614e8-55a7-4514-876d-0070b3937fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.810763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9614e8-55a7-4514-876d-0070b3937fcf admin admin] PATH_INFO: `/v3/projects/eed74762aa354b048050b35a6b20497a/users/d1dc67e6b10e45988a4053947b036570/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.826182 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9614e8-55a7-4514-876d-0070b3937fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed74762aa354b048050b35a6b20497a, user_id=d1dc67e6b10e45988a4053947b036570, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:05.829173 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9614e8-55a7-4514-876d-0070b3937fcf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:05.843952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1352/2694] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:05:05 2022] PUT /identity/v3/projects/eed74762aa354b048050b35a6b20497a/users/d1dc67e6b10e45988a4053947b036570/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:05.847965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b0caf-3cfd-42f9-9cdb-9e8a709098e3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:05.857957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b0caf-3cfd-42f9-9cdb-9e8a709098e3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:05.915669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f19dd4-b4ec-4496-b7f4-58a2412faa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:05.916315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f19dd4-b4ec-4496-b7f4-58a2412faa91 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.916599 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f19dd4-b4ec-4496-b7f4-58a2412faa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.916870 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f19dd4-b4ec-4496-b7f4-58a2412faa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.917556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f19dd4-b4ec-4496-b7f4-58a2412faa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:05.919130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f19dd4-b4ec-4496-b7f4-58a2412faa91 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:05.928910 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1343/2695] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:05:05.933029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9614e8-55a7-4514-876d-0070b3937fcf admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:05.943631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9614e8-55a7-4514-876d-0070b3937fcf admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:05.949101 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2353-e39a-48d2-9d8b-9409defd81c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:05.949812 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2353-e39a-48d2-9d8b-9409defd81c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.950128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2353-e39a-48d2-9d8b-9409defd81c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.950411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2353-e39a-48d2-9d8b-9409defd81c8 admin admin] PATH_INFO: `/v3/projects/eed74762aa354b048050b35a6b20497a/users/d1dc67e6b10e45988a4053947b036570/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.952572 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2353-e39a-48d2-9d8b-9409defd81c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed74762aa354b048050b35a6b20497a, user_id=d1dc67e6b10e45988a4053947b036570, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:05.955483 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2353-e39a-48d2-9d8b-9409defd81c8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:05.966940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1353/2696] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:05:05 2022] PUT /identity/v3/projects/eed74762aa354b048050b35a6b20497a/users/d1dc67e6b10e45988a4053947b036570/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:05.977137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec395eb-fc88-4e5d-9ab6-91116a0a8ae8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:05.977721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec395eb-fc88-4e5d-9ab6-91116a0a8ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:05.978005 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec395eb-fc88-4e5d-9ab6-91116a0a8ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:05.991735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:06.008226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bec395eb-fc88-4e5d-9ab6-91116a0a8ae8 None None] MFA Rules not processed for user `d1dc67e6b10e45988a4053947b036570`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:06.010038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bec395eb-fc88-4e5d-9ab6-91116a0a8ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:06.079393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1344/2697] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:06.091590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2353-e39a-48d2-9d8b-9409defd81c8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:06.093385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-39bc2353-e39a-48d2-9d8b-9409defd81c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:06.137858 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:06.152718 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2353-e39a-48d2-9d8b-9409defd81c8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:06.156361 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e3135-b889-4644-91c3-a8f3c9a0183e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:06.156976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e3135-b889-4644-91c3-a8f3c9a0183e service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:06.157260 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e3135-b889-4644-91c3-a8f3c9a0183e service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:06.157537 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e3135-b889-4644-91c3-a8f3c9a0183e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:06.167901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e3135-b889-4644-91c3-a8f3c9a0183e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:06.169382 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e3135-b889-4644-91c3-a8f3c9a0183e service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:06.178826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1354/2698] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:05:06.207880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec395eb-fc88-4e5d-9ab6-91116a0a8ae8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:06.272457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec395eb-fc88-4e5d-9ab6-91116a0a8ae8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:06.277503 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:06.278137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:06.278416 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:06.278689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] PATH_INFO: `/v3/users/cbb0a31b9e2c40b498d552243cbb512c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:06.279832 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb0a31b9e2c40b498d552243cbb512c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:06.281934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:06.329982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb0a31b9e2c40b498d552243cbb512c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:06.330637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb0a31b9e2c40b498d552243cbb512c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:06.346297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb0a31b9e2c40b498d552243cbb512c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:06.354918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb0a31b9e2c40b498d552243cbb512c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:06.362238 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb0a31b9e2c40b498d552243cbb512c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:06.368406 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1345/2699] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:05:06 2022] DELETE /identity/v3/users/cbb0a31b9e2c40b498d552243cbb512c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:06.372970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b8485-dbc3-4181-b53c-4a2aa87134de None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:06.373262 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b8485-dbc3-4181-b53c-4a2aa87134de None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:06.373562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b8485-dbc3-4181-b53c-4a2aa87134de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:06.394132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c57b8485-dbc3-4181-b53c-4a2aa87134de None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:06.395383 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c57b8485-dbc3-4181-b53c-4a2aa87134de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:06.457972 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1355/2700] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:06.469163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:06.470761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:06.484925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:06.533387 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324df4c-c479-41f5-a3bf-928ebfc21d93 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:06.537125 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0746db-2f22-4c13-9887-f76b378691dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:06.537743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0746db-2f22-4c13-9887-f76b378691dd service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:06.538028 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0746db-2f22-4c13-9887-f76b378691dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:06.538307 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0746db-2f22-4c13-9887-f76b378691dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:06.547618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0746db-2f22-4c13-9887-f76b378691dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:06.549181 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0746db-2f22-4c13-9887-f76b378691dd service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:06.560283 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1346/2701] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:05:06.838098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b8485-dbc3-4181-b53c-4a2aa87134de None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:06.839586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c57b8485-dbc3-4181-b53c-4a2aa87134de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:06.851831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b8485-dbc3-4181-b53c-4a2aa87134de None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:06.857060 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:06.857708 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:06.858142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:06.858449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] PATH_INFO: `/v3/projects/f269523f50654e1aa5c5e84e9a33cbe5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:06.860011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f269523f50654e1aa5c5e84e9a33cbe5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:06.862185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:06.913759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f269523f50654e1aa5c5e84e9a33cbe5', 'request_id': 'req-b123a786-7f74-4f18-b00a-1889f42084e8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:06.919344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f269523f50654e1aa5c5e84e9a33cbe5', 'request_id': 'req-b123a786-7f74-4f18-b00a-1889f42084e8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:06.926847 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f269523f50654e1aa5c5e84e9a33cbe5', 'request_id': 'req-b123a786-7f74-4f18-b00a-1889f42084e8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:06.939277 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] The token cache is being invalidate because project f269523f50654e1aa5c5e84e9a33cbe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:05:06.939602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:06.940297 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:06.944803 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1356/2702] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:05:06 2022] DELETE /identity/v3/projects/f269523f50654e1aa5c5e84e9a33cbe5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:06.946985 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0746db-2f22-4c13-9887-f76b378691dd service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:06.957253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0746db-2f22-4c13-9887-f76b378691dd service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:07.038140 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911a07a-6aa2-44f0-9b14-0da91ee510be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:07.038794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911a07a-6aa2-44f0-9b14-0da91ee510be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:07.039076 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911a07a-6aa2-44f0-9b14-0da91ee510be admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:07.039353 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911a07a-6aa2-44f0-9b14-0da91ee510be admin admin] PATH_INFO: `/v3/users/d1dc67e6b10e45988a4053947b036570` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:07.040629 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911a07a-6aa2-44f0-9b14-0da91ee510be admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1dc67e6b10e45988a4053947b036570)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:07.043936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911a07a-6aa2-44f0-9b14-0da91ee510be admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:07.102542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5911a07a-6aa2-44f0-9b14-0da91ee510be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1dc67e6b10e45988a4053947b036570'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:07.103316 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5911a07a-6aa2-44f0-9b14-0da91ee510be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1dc67e6b10e45988a4053947b036570'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:07.116032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5911a07a-6aa2-44f0-9b14-0da91ee510be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1dc67e6b10e45988a4053947b036570'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:07.125228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5911a07a-6aa2-44f0-9b14-0da91ee510be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1dc67e6b10e45988a4053947b036570'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:07.135560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5911a07a-6aa2-44f0-9b14-0da91ee510be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1dc67e6b10e45988a4053947b036570'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:07.141610 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1347/2703] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:05:06 2022] DELETE /identity/v3/users/d1dc67e6b10e45988a4053947b036570 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:07.417664 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:07.419110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:07.435464 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123a786-7f74-4f18-b00a-1889f42084e8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:07.504612 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:07.505263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:07.505546 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:07.505850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e admin admin] PATH_INFO: `/v3/projects/eed74762aa354b048050b35a6b20497a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:07.507550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed74762aa354b048050b35a6b20497a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:07.509498 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:07.518310 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:07.559688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed74762aa354b048050b35a6b20497a', 'request_id': 'req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:07.565180 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed74762aa354b048050b35a6b20497a', 'request_id': 'req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:07.573045 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed74762aa354b048050b35a6b20497a', 'request_id': 'req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:07.584051 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e admin admin] The token cache is being invalidate because project eed74762aa354b048050b35a6b20497a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:05:07.584367 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:07.585160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-05c4ae52-47ee-48f7-a81d-5f1eaa7bc95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:07.587181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1357/2704] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:05:07 2022] DELETE /identity/v3/projects/eed74762aa354b048050b35a6b20497a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:07.593189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ca1de-34a6-4729-af43-15268b2ef8be None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:07.593629 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ca1de-34a6-4729-af43-15268b2ef8be None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:07.593753 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ca1de-34a6-4729-af43-15268b2ef8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:07.614568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6b4ca1de-34a6-4729-af43-15268b2ef8be None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:07.615810 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6b4ca1de-34a6-4729-af43-15268b2ef8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:07.644322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:07.676525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1348/2705] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:07.684268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7ec2-50d4-4a16-85d7-86fc50303b83 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:07.684563 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7ec2-50d4-4a16-85d7-86fc50303b83 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:07.684846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7ec2-50d4-4a16-85d7-86fc50303b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:07.704897 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e2af7ec2-50d4-4a16-85d7-86fc50303b83 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:07.706113 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e2af7ec2-50d4-4a16-85d7-86fc50303b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:07.714584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1358/2706] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:07.718716 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ca1de-34a6-4729-af43-15268b2ef8be None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:07.728918 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ca1de-34a6-4729-af43-15268b2ef8be None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:07.733427 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0300a1-20c4-40ef-a108-45bcc99d5cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:07.734027 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0300a1-20c4-40ef-a108-45bcc99d5cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:07.734309 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0300a1-20c4-40ef-a108-45bcc99d5cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:07.734582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0300a1-20c4-40ef-a108-45bcc99d5cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:07.735271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0300a1-20c4-40ef-a108-45bcc99d5cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:05:07.735578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0300a1-20c4-40ef-a108-45bcc99d5cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:07.737274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0300a1-20c4-40ef-a108-45bcc99d5cd5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:07.748790 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1349/2707] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:07.752942 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af7ec2-50d4-4a16-85d7-86fc50303b83 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:07.762121 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af7ec2-50d4-4a16-85d7-86fc50303b83 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:07.766898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be37fe4-6f9d-430c-a7c1-af9c7c4f9474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:07.767539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be37fe4-6f9d-430c-a7c1-af9c7c4f9474 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:07.767820 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be37fe4-6f9d-430c-a7c1-af9c7c4f9474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:07.768091 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be37fe4-6f9d-430c-a7c1-af9c7c4f9474 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:07.768814 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be37fe4-6f9d-430c-a7c1-af9c7c4f9474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:07.770711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be37fe4-6f9d-430c-a7c1-af9c7c4f9474 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:07.798568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1359/2708] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:05:07 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:05:07.802774 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0300a1-20c4-40ef-a108-45bcc99d5cd5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:07.813084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0300a1-20c4-40ef-a108-45bcc99d5cd5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:07.869934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62070c-a418-41f4-b98e-5bf1fc78f4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:07.870546 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62070c-a418-41f4-b98e-5bf1fc78f4bc admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:07.870827 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62070c-a418-41f4-b98e-5bf1fc78f4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:07.871102 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62070c-a418-41f4-b98e-5bf1fc78f4bc admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:07.871762 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62070c-a418-41f4-b98e-5bf1fc78f4bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:07.873690 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62070c-a418-41f4-b98e-5bf1fc78f4bc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:07.897623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1350/2709] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:05:07 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:05:07.902733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be37fe4-6f9d-430c-a7c1-af9c7c4f9474 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:07.913453 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be37fe4-6f9d-430c-a7c1-af9c7c4f9474 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:07.918163 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200b9a2-ead3-4b3e-a5d8-8f3245d29c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:07.918770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200b9a2-ead3-4b3e-a5d8-8f3245d29c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:07.919058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200b9a2-ead3-4b3e-a5d8-8f3245d29c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:07.919336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200b9a2-ead3-4b3e-a5d8-8f3245d29c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:07.920035 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200b9a2-ead3-4b3e-a5d8-8f3245d29c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:07.921661 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200b9a2-ead3-4b3e-a5d8-8f3245d29c93 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:07.931441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1360/2710] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:05:07.935400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62070c-a418-41f4-b98e-5bf1fc78f4bc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:07.945385 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62070c-a418-41f4-b98e-5bf1fc78f4bc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:07.950807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa3f31-d7c0-4daf-95f7-1ef63e85f3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:07.951431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa3f31-d7c0-4daf-95f7-1ef63e85f3fa admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:07.951718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa3f31-d7c0-4daf-95f7-1ef63e85f3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:07.951997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa3f31-d7c0-4daf-95f7-1ef63e85f3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:07.952727 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa3f31-d7c0-4daf-95f7-1ef63e85f3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:07.954597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa3f31-d7c0-4daf-95f7-1ef63e85f3fa admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:07.966155 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1351/2711] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:05:07.970710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200b9a2-ead3-4b3e-a5d8-8f3245d29c93 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:07.980665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200b9a2-ead3-4b3e-a5d8-8f3245d29c93 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:07.985562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d581f-64ae-49c2-810b-4f5c290e33a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:07.986238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d581f-64ae-49c2-810b-4f5c290e33a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:07.986524 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d581f-64ae-49c2-810b-4f5c290e33a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:07.986809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d581f-64ae-49c2-810b-4f5c290e33a9 admin admin] PATH_INFO: `/v3/projects/a78e39ed46054e758edc132ddea20bc9/users/24a1085389a143adba39d408ac7fc81e/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:08.001957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d581f-64ae-49c2-810b-4f5c290e33a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78e39ed46054e758edc132ddea20bc9, user_id=24a1085389a143adba39d408ac7fc81e, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:08.004651 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d581f-64ae-49c2-810b-4f5c290e33a9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:08.017346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1361/2712] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:05:07 2022] PUT /identity/v3/projects/a78e39ed46054e758edc132ddea20bc9/users/24a1085389a143adba39d408ac7fc81e/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:08.029290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba286fc-dec5-454a-b9aa-c325fc29e8ca None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:08.029609 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba286fc-dec5-454a-b9aa-c325fc29e8ca None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:08.029889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba286fc-dec5-454a-b9aa-c325fc29e8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:08.058299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3ba286fc-dec5-454a-b9aa-c325fc29e8ca None None] MFA Rules not processed for user `24a1085389a143adba39d408ac7fc81e`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:08.059513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3ba286fc-dec5-454a-b9aa-c325fc29e8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:08.124578 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1352/2713] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:08.135681 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d581f-64ae-49c2-810b-4f5c290e33a9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:08.137417 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-272d581f-64ae-49c2-810b-4f5c290e33a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:08.193378 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d581f-64ae-49c2-810b-4f5c290e33a9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:08.197812 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1811a4-be54-4cc0-963b-d870f2180f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:08.198429 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1811a4-be54-4cc0-963b-d870f2180f5d service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:08.199039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1811a4-be54-4cc0-963b-d870f2180f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:08.199039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1811a4-be54-4cc0-963b-d870f2180f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:08.208573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1811a4-be54-4cc0-963b-d870f2180f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:08.210550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1811a4-be54-4cc0-963b-d870f2180f5d service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:08.220790 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1362/2714] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:05:18.121643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:18.216722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:26.483425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804de058-4a5e-4c4c-908b-55b3fe6e00ac None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:26.483922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804de058-4a5e-4c4c-908b-55b3fe6e00ac None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:26.484031 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804de058-4a5e-4c4c-908b-55b3fe6e00ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:26.503168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-804de058-4a5e-4c4c-908b-55b3fe6e00ac None None] MFA Rules not processed for user `e469194b140942bf929001c7e12a0933`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:26.504401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-804de058-4a5e-4c4c-908b-55b3fe6e00ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:26.561241 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1353/2715] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:26.901686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1811a4-be54-4cc0-963b-d870f2180f5d service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:26.903128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cb1811a4-be54-4cc0-963b-d870f2180f5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:26.962128 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1811a4-be54-4cc0-963b-d870f2180f5d service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:26.965736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf14752-261f-49c8-b457-5eeed4215893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:26.966344 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf14752-261f-49c8-b457-5eeed4215893 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:26.966624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf14752-261f-49c8-b457-5eeed4215893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:26.966898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf14752-261f-49c8-b457-5eeed4215893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:26.968674 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2cf14752-261f-49c8-b457-5eeed4215893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:26.978739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf14752-261f-49c8-b457-5eeed4215893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:26.980185 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf14752-261f-49c8-b457-5eeed4215893 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:26.988199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1363/2716] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:05:27.428525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804de058-4a5e-4c4c-908b-55b3fe6e00ac None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:27.430486 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-804de058-4a5e-4c4c-908b-55b3fe6e00ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:27.503156 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804de058-4a5e-4c4c-908b-55b3fe6e00ac None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:27.508768 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cfe76-5c53-41c1-a3c8-ede3038edb9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:27.509391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cfe76-5c53-41c1-a3c8-ede3038edb9f service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:27.509676 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cfe76-5c53-41c1-a3c8-ede3038edb9f service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:27.509954 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cfe76-5c53-41c1-a3c8-ede3038edb9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:27.511696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d87cfe76-5c53-41c1-a3c8-ede3038edb9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:27.522957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cfe76-5c53-41c1-a3c8-ede3038edb9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:27.524577 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cfe76-5c53-41c1-a3c8-ede3038edb9f service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:27.534410 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1354/2717] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:05:36.984555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=26 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:37.187094 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf14752-261f-49c8-b457-5eeed4215893 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:37.249589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf14752-261f-49c8-b457-5eeed4215893 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:37.253980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:37.254616 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:37.254897 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:37.255174 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] PATH_INFO: `/v3/users/24a1085389a143adba39d408ac7fc81e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:37.256352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a1085389a143adba39d408ac7fc81e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:37.258789 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:37.304015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a1085389a143adba39d408ac7fc81e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:37.304722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a1085389a143adba39d408ac7fc81e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:37.311899 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a1085389a143adba39d408ac7fc81e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:37.324759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a1085389a143adba39d408ac7fc81e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:37.332706 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a1085389a143adba39d408ac7fc81e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:37.339321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1364/2718] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:05:37 2022] DELETE /identity/v3/users/24a1085389a143adba39d408ac7fc81e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:37.344025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db93bbb-5dfa-475b-a3d3-a1dc811f8c83 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:37.344575 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db93bbb-5dfa-475b-a3d3-a1dc811f8c83 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:37.344694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db93bbb-5dfa-475b-a3d3-a1dc811f8c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:37.366188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9db93bbb-5dfa-475b-a3d3-a1dc811f8c83 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:37.367038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9db93bbb-5dfa-475b-a3d3-a1dc811f8c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:37.430942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1355/2719] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:37.441493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:37.442936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:37.503039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a912f45-358e-4da5-b427-b0e23309aa7f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:37.506644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce547884-e006-4415-9a1d-ed2097dd5f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:37.507838 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce547884-e006-4415-9a1d-ed2097dd5f26 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:37.508158 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce547884-e006-4415-9a1d-ed2097dd5f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:37.508438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce547884-e006-4415-9a1d-ed2097dd5f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:37.517402 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce547884-e006-4415-9a1d-ed2097dd5f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:37.518844 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce547884-e006-4415-9a1d-ed2097dd5f26 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:37.528264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1365/2720] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:05:37.858010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db93bbb-5dfa-475b-a3d3-a1dc811f8c83 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:37.859677 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9db93bbb-5dfa-475b-a3d3-a1dc811f8c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:37.873346 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db93bbb-5dfa-475b-a3d3-a1dc811f8c83 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:37.878804 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:37.879468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:37.880275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:37.880275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8 admin admin] PATH_INFO: `/v3/projects/a78e39ed46054e758edc132ddea20bc9` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:37.881229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78e39ed46054e758edc132ddea20bc9)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:37.883657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:37.921043 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:37.935992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78e39ed46054e758edc132ddea20bc9', 'request_id': 'req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:37.941863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78e39ed46054e758edc132ddea20bc9', 'request_id': 'req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:37.948143 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78e39ed46054e758edc132ddea20bc9', 'request_id': 'req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:37.960889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8 admin admin] The token cache is being invalidate because project a78e39ed46054e758edc132ddea20bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:05:37.961180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:37.961848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5acf97b6-a3d8-4e8f-ab5c-386bb19b4ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:37.963351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1356/2721] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:05:37 2022] DELETE /identity/v3/projects/a78e39ed46054e758edc132ddea20bc9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:37.968359 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527f58b-0542-4689-8965-f1aed8c6dc5f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:37.968644 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527f58b-0542-4689-8965-f1aed8c6dc5f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:37.968929 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527f58b-0542-4689-8965-f1aed8c6dc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:37.988839 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6527f58b-0542-4689-8965-f1aed8c6dc5f None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:37.990049 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6527f58b-0542-4689-8965-f1aed8c6dc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:38.011351 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:38.071928 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1366/2722] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:05:38.080110 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630437a2-97f3-4af4-8f68-42cb00f89726 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:38.080426 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630437a2-97f3-4af4-8f68-42cb00f89726 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:38.080710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630437a2-97f3-4af4-8f68-42cb00f89726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:38.100079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-630437a2-97f3-4af4-8f68-42cb00f89726 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:38.101795 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-630437a2-97f3-4af4-8f68-42cb00f89726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:38.109699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1357/2723] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:38.113834 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527f58b-0542-4689-8965-f1aed8c6dc5f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:38.124039 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527f58b-0542-4689-8965-f1aed8c6dc5f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:38.128657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c005f-e301-47cc-a115-6d8db5df1a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:38.129263 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c005f-e301-47cc-a115-6d8db5df1a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:38.129544 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c005f-e301-47cc-a115-6d8db5df1a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:38.129819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c005f-e301-47cc-a115-6d8db5df1a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:38.130508 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c005f-e301-47cc-a115-6d8db5df1a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:05:38.130815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c005f-e301-47cc-a115-6d8db5df1a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:38.132430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c005f-e301-47cc-a115-6d8db5df1a86 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:38.143785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1367/2724] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:38.147853 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630437a2-97f3-4af4-8f68-42cb00f89726 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:38.157119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630437a2-97f3-4af4-8f68-42cb00f89726 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:38.161841 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ff43f-bdf0-4a54-92e5-4ccd042e7d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:38.162479 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ff43f-bdf0-4a54-92e5-4ccd042e7d55 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:38.162761 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ff43f-bdf0-4a54-92e5-4ccd042e7d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:38.163036 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ff43f-bdf0-4a54-92e5-4ccd042e7d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:38.164240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ff43f-bdf0-4a54-92e5-4ccd042e7d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:38.166134 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ff43f-bdf0-4a54-92e5-4ccd042e7d55 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:38.194281 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1358/2725] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:05:38 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:05:38.198653 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c005f-e301-47cc-a115-6d8db5df1a86 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:38.208919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c005f-e301-47cc-a115-6d8db5df1a86 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:38.265925 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d49f2c-fd54-49ad-a53e-74ddcc58ae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:38.266539 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d49f2c-fd54-49ad-a53e-74ddcc58ae2f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:38.266826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d49f2c-fd54-49ad-a53e-74ddcc58ae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:38.267111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d49f2c-fd54-49ad-a53e-74ddcc58ae2f admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:38.267777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d49f2c-fd54-49ad-a53e-74ddcc58ae2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:38.269721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d49f2c-fd54-49ad-a53e-74ddcc58ae2f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:38.290873 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1368/2726] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:05:38 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:05:38.294966 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ff43f-bdf0-4a54-92e5-4ccd042e7d55 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:38.304974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ff43f-bdf0-4a54-92e5-4ccd042e7d55 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:38.309407 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f52532-7119-4d6b-b4f8-e468bab13a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:38.310004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f52532-7119-4d6b-b4f8-e468bab13a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:38.310280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f52532-7119-4d6b-b4f8-e468bab13a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:38.310549 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f52532-7119-4d6b-b4f8-e468bab13a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:38.311252 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f52532-7119-4d6b-b4f8-e468bab13a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:38.312852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f52532-7119-4d6b-b4f8-e468bab13a2b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:38.322882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1359/2727] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:05:38.326602 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d49f2c-fd54-49ad-a53e-74ddcc58ae2f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:38.337704 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d49f2c-fd54-49ad-a53e-74ddcc58ae2f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:38.342340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f0de4-cd34-464d-ad25-942dca6136de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:38.342931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f0de4-cd34-464d-ad25-942dca6136de admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:38.343209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f0de4-cd34-464d-ad25-942dca6136de admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:38.343481 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f0de4-cd34-464d-ad25-942dca6136de admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:38.344192 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f0de4-cd34-464d-ad25-942dca6136de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:38.345767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f0de4-cd34-464d-ad25-942dca6136de admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:38.356710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1369/2728] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:05:38.360762 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f52532-7119-4d6b-b4f8-e468bab13a2b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:38.370638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f52532-7119-4d6b-b4f8-e468bab13a2b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:38.375722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3c95f-8719-4fb0-ade8-6d47e8e612db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:38.376916 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3c95f-8719-4fb0-ade8-6d47e8e612db admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:38.377406 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3c95f-8719-4fb0-ade8-6d47e8e612db admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:38.377878 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3c95f-8719-4fb0-ade8-6d47e8e612db admin admin] PATH_INFO: `/v3/projects/7bf97799bfe549e7acf1b4cf30331296/users/2a30b9a7d3674372a2e77b86c767ccef/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:38.395495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3c95f-8719-4fb0-ade8-6d47e8e612db admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf97799bfe549e7acf1b4cf30331296, user_id=2a30b9a7d3674372a2e77b86c767ccef, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:38.398678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3c95f-8719-4fb0-ade8-6d47e8e612db admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:38.411946 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1360/2729] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:05:38 2022] PUT /identity/v3/projects/7bf97799bfe549e7acf1b4cf30331296/users/2a30b9a7d3674372a2e77b86c767ccef/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:05:38.423852 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb308e5-c9c3-47a7-bd94-463a122dfc58 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:38.424165 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb308e5-c9c3-47a7-bd94-463a122dfc58 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:38.424446 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb308e5-c9c3-47a7-bd94-463a122dfc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:38.451410 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0cb308e5-c9c3-47a7-bd94-463a122dfc58 None None] MFA Rules not processed for user `2a30b9a7d3674372a2e77b86c767ccef`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:38.452885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0cb308e5-c9c3-47a7-bd94-463a122dfc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:38.518984 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1370/2730] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:05:38.532454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3c95f-8719-4fb0-ade8-6d47e8e612db admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:38.534154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e9d3c95f-8719-4fb0-ade8-6d47e8e612db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:38.590253 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3c95f-8719-4fb0-ade8-6d47e8e612db admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:38.593785 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4377c-4d59-4284-bec9-b374feff2945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:38.594401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4377c-4d59-4284-bec9-b374feff2945 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:38.594700 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4377c-4d59-4284-bec9-b374feff2945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:38.594978 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4377c-4d59-4284-bec9-b374feff2945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:38.603635 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4377c-4d59-4284-bec9-b374feff2945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:38.605073 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4377c-4d59-4284-bec9-b374feff2945 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:38.613641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1361/2731] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:05:44.631291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb308e5-c9c3-47a7-bd94-463a122dfc58 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:44.633415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0cb308e5-c9c3-47a7-bd94-463a122dfc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:44.655739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:44.727828 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb308e5-c9c3-47a7-bd94-463a122dfc58 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:44.733449 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c860800-c348-4549-8dd9-fa2c7c44bab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:44.734073 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c860800-c348-4549-8dd9-fa2c7c44bab0 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:44.734380 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c860800-c348-4549-8dd9-fa2c7c44bab0 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:44.734658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c860800-c348-4549-8dd9-fa2c7c44bab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:44.736457 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8c860800-c348-4549-8dd9-fa2c7c44bab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:44.749595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c860800-c348-4549-8dd9-fa2c7c44bab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:44.751320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c860800-c348-4549-8dd9-fa2c7c44bab0 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:44.762443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1371/2732] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:05:47.600778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4377c-4d59-4284-bec9-b374feff2945 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:47.602229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-17d4377c-4d59-4284-bec9-b374feff2945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:47.658458 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4377c-4d59-4284-bec9-b374feff2945 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:47.661969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97127ec-ce5d-4252-a530-c7689eac2699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:47.662571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97127ec-ce5d-4252-a530-c7689eac2699 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:47.662851 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97127ec-ce5d-4252-a530-c7689eac2699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:47.663643 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97127ec-ce5d-4252-a530-c7689eac2699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:47.665372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c97127ec-ce5d-4252-a530-c7689eac2699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:47.675372 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:47.736105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97127ec-ce5d-4252-a530-c7689eac2699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:47.737570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97127ec-ce5d-4252-a530-c7689eac2699 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:47.747009 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1362/2733] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:05:48.536778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c860800-c348-4549-8dd9-fa2c7c44bab0 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:48.624766 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c860800-c348-4549-8dd9-fa2c7c44bab0 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:48.634456 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:48.636531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:48.636531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:48.636531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] PATH_INFO: `/v3/users/2a30b9a7d3674372a2e77b86c767ccef` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:48.639204 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a30b9a7d3674372a2e77b86c767ccef)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:48.641628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:48.715901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a30b9a7d3674372a2e77b86c767ccef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:48.716658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a30b9a7d3674372a2e77b86c767ccef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:48.732752 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a30b9a7d3674372a2e77b86c767ccef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:48.764656 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a30b9a7d3674372a2e77b86c767ccef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:48.782686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a30b9a7d3674372a2e77b86c767ccef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:48.798156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1372/2734] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:05:48 2022] DELETE /identity/v3/users/2a30b9a7d3674372a2e77b86c767ccef => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:48.802630 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8489e91-ef24-4e5e-9d36-f35fa8562f02 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:48.803184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8489e91-ef24-4e5e-9d36-f35fa8562f02 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:48.803275 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8489e91-ef24-4e5e-9d36-f35fa8562f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:48.832010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e8489e91-ef24-4e5e-9d36-f35fa8562f02 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:48.833366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e8489e91-ef24-4e5e-9d36-f35fa8562f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:48.904689 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1363/2735] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:48.916014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:48.917686 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:48.964621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:49.009939 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c81981-6a75-48d7-bf4b-d674733388ca admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:49.013750 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dbd0c-c434-48c8-94b2-237c79b73560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:49.014375 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dbd0c-c434-48c8-94b2-237c79b73560 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:49.014721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dbd0c-c434-48c8-94b2-237c79b73560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:49.015003 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dbd0c-c434-48c8-94b2-237c79b73560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:49.026470 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9dbd0c-c434-48c8-94b2-237c79b73560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:49.028461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9dbd0c-c434-48c8-94b2-237c79b73560 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:49.039211 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1373/2736] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:05:49.314215 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8489e91-ef24-4e5e-9d36-f35fa8562f02 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:49.315969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e8489e91-ef24-4e5e-9d36-f35fa8562f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:49.330153 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8489e91-ef24-4e5e-9d36-f35fa8562f02 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:49.335873 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1707654-862c-4923-a016-e3e595b123ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:49.336577 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1707654-862c-4923-a016-e3e595b123ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:49.336924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1707654-862c-4923-a016-e3e595b123ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:49.337189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1707654-862c-4923-a016-e3e595b123ba admin admin] PATH_INFO: `/v3/projects/7bf97799bfe549e7acf1b4cf30331296` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:49.338379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1707654-862c-4923-a016-e3e595b123ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf97799bfe549e7acf1b4cf30331296)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:49.340341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1707654-862c-4923-a016-e3e595b123ba admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:49.388279 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f1707654-862c-4923-a016-e3e595b123ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf97799bfe549e7acf1b4cf30331296', 'request_id': 'req-f1707654-862c-4923-a016-e3e595b123ba'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:49.393748 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f1707654-862c-4923-a016-e3e595b123ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf97799bfe549e7acf1b4cf30331296', 'request_id': 'req-f1707654-862c-4923-a016-e3e595b123ba'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:49.400414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f1707654-862c-4923-a016-e3e595b123ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf97799bfe549e7acf1b4cf30331296', 'request_id': 'req-f1707654-862c-4923-a016-e3e595b123ba'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:49.413196 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f1707654-862c-4923-a016-e3e595b123ba admin admin] The token cache is being invalidate because project 7bf97799bfe549e7acf1b4cf30331296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:05:49.413845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f1707654-862c-4923-a016-e3e595b123ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:49.414623 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f1707654-862c-4923-a016-e3e595b123ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:05:49.416182 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1364/2737] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:05:49 2022] DELETE /identity/v3/projects/7bf97799bfe549e7acf1b4cf30331296 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:49.421463 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196bb91-e78f-4de1-94e9-482b99fcd59d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:49.421751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196bb91-e78f-4de1-94e9-482b99fcd59d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:49.422030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196bb91-e78f-4de1-94e9-482b99fcd59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:49.441441 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8196bb91-e78f-4de1-94e9-482b99fcd59d None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:49.442656 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8196bb91-e78f-4de1-94e9-482b99fcd59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:49.512754 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1374/2738] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:49.514152 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279adc4-2e6e-4f90-a03d-0a9c5f0daa9d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:49.514450 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279adc4-2e6e-4f90-a03d-0a9c5f0daa9d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:49.514736 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279adc4-2e6e-4f90-a03d-0a9c5f0daa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:49.535899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7279adc4-2e6e-4f90-a03d-0a9c5f0daa9d None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:49.537148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7279adc4-2e6e-4f90-a03d-0a9c5f0daa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:49.545436 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1365/2739] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:49.549957 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196bb91-e78f-4de1-94e9-482b99fcd59d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:49.560497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196bb91-e78f-4de1-94e9-482b99fcd59d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:49.565027 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcf616-548d-45a6-9a8d-00754749b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:49.565645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf616-548d-45a6-9a8d-00754749b0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:49.565934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf616-548d-45a6-9a8d-00754749b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:49.566210 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf616-548d-45a6-9a8d-00754749b0f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:49.566906 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcf616-548d-45a6-9a8d-00754749b0f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:05:49.567216 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcf616-548d-45a6-9a8d-00754749b0f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:49.568866 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcf616-548d-45a6-9a8d-00754749b0f8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:49.584419 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1375/2740] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:49.588454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279adc4-2e6e-4f90-a03d-0a9c5f0daa9d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:49.599026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279adc4-2e6e-4f90-a03d-0a9c5f0daa9d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:49.605885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a9c34-e5c5-4a04-8586-9fd3640a8e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:49.606646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a9c34-e5c5-4a04-8586-9fd3640a8e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:49.607052 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a9c34-e5c5-4a04-8586-9fd3640a8e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:49.607437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a9c34-e5c5-4a04-8586-9fd3640a8e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:49.608244 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a9c34-e5c5-4a04-8586-9fd3640a8e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:49.610255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a9c34-e5c5-4a04-8586-9fd3640a8e5e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:49.654405 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1366/2741] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:05:49 2022] POST /identity/v3/projects => generated 391 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:05:49.655740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcf616-548d-45a6-9a8d-00754749b0f8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:49.666458 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcf616-548d-45a6-9a8d-00754749b0f8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:49.731715 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c86439-34d8-46d5-9513-0f16fb9799d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:49.732819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c86439-34d8-46d5-9513-0f16fb9799d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:49.733269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c86439-34d8-46d5-9513-0f16fb9799d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:49.733710 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c86439-34d8-46d5-9513-0f16fb9799d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:49.734719 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c86439-34d8-46d5-9513-0f16fb9799d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:49.736777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c86439-34d8-46d5-9513-0f16fb9799d4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:49.763088 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1376/2742] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:05:49 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:05:49.767119 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a9c34-e5c5-4a04-8586-9fd3640a8e5e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:49.774124 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:49.786592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a9c34-e5c5-4a04-8586-9fd3640a8e5e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:49.793989 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd2fed-926f-4fc0-8159-8d4a9341aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:49.794893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd2fed-926f-4fc0-8159-8d4a9341aa9c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:49.795198 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd2fed-926f-4fc0-8159-8d4a9341aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:49.795537 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd2fed-926f-4fc0-8159-8d4a9341aa9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:49.796550 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd2fed-926f-4fc0-8159-8d4a9341aa9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:49.804211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd2fed-926f-4fc0-8159-8d4a9341aa9c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:49.820255 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1367/2743] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:05:49.821418 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c86439-34d8-46d5-9513-0f16fb9799d4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:49.833184 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c86439-34d8-46d5-9513-0f16fb9799d4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:49.838505 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfba303-887c-4650-94c3-ce5a124f7e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:49.839124 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfba303-887c-4650-94c3-ce5a124f7e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:49.839411 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfba303-887c-4650-94c3-ce5a124f7e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:49.839693 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfba303-887c-4650-94c3-ce5a124f7e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:49.840500 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfba303-887c-4650-94c3-ce5a124f7e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:49.842117 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfba303-887c-4650-94c3-ce5a124f7e14 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:49.855894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1377/2744] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:05:49.860571 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd2fed-926f-4fc0-8159-8d4a9341aa9c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:49.873347 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd2fed-926f-4fc0-8159-8d4a9341aa9c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:49.878493 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aca6a2-5d96-4f37-a7c9-dbdf5d391539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:49.879325 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aca6a2-5d96-4f37-a7c9-dbdf5d391539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:49.879771 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aca6a2-5d96-4f37-a7c9-dbdf5d391539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:49.880056 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aca6a2-5d96-4f37-a7c9-dbdf5d391539 admin admin] PATH_INFO: `/v3/projects/76088122ecdc4386bcbef638ec52de86/users/fc867d3f2c4f43fe8049447706ceabb1/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:49.899072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aca6a2-5d96-4f37-a7c9-dbdf5d391539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76088122ecdc4386bcbef638ec52de86, user_id=fc867d3f2c4f43fe8049447706ceabb1, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:49.901856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aca6a2-5d96-4f37-a7c9-dbdf5d391539 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:49.918731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1368/2745] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:05:49 2022] PUT /identity/v3/projects/76088122ecdc4386bcbef638ec52de86/users/fc867d3f2c4f43fe8049447706ceabb1/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:05:49.929770 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599fdc4-25d8-4bf1-a5f2-2218fb6d29ab None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:49.930064 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599fdc4-25d8-4bf1-a5f2-2218fb6d29ab None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:49.930337 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599fdc4-25d8-4bf1-a5f2-2218fb6d29ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:49.963930 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1599fdc4-25d8-4bf1-a5f2-2218fb6d29ab None None] MFA Rules not processed for user `fc867d3f2c4f43fe8049447706ceabb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:49.965172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1599fdc4-25d8-4bf1-a5f2-2218fb6d29ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:49.986832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:50.065679 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1378/2746] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:05:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:05:50.087487 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aca6a2-5d96-4f37-a7c9-dbdf5d391539 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:50.089934 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-99aca6a2-5d96-4f37-a7c9-dbdf5d391539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:50.168580 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aca6a2-5d96-4f37-a7c9-dbdf5d391539 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:50.172496 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5db76b-2467-4e49-9679-1c43acc7fc39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:50.174560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5db76b-2467-4e49-9679-1c43acc7fc39 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:50.174560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5db76b-2467-4e49-9679-1c43acc7fc39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:50.174560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5db76b-2467-4e49-9679-1c43acc7fc39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:50.183720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5db76b-2467-4e49-9679-1c43acc7fc39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:50.185200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5db76b-2467-4e49-9679-1c43acc7fc39 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:50.201054 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1369/2747] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:05:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:06:00.062353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=18 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:00.191678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:08.110342 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599fdc4-25d8-4bf1-a5f2-2218fb6d29ab None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:08.111795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1599fdc4-25d8-4bf1-a5f2-2218fb6d29ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:08.184278 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599fdc4-25d8-4bf1-a5f2-2218fb6d29ab None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:08.189781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e9dbf-9784-4afe-bc0a-00a1dacfc9de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:08.190398 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e9dbf-9784-4afe-bc0a-00a1dacfc9de service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:08.190683 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e9dbf-9784-4afe-bc0a-00a1dacfc9de service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:08.190964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e9dbf-9784-4afe-bc0a-00a1dacfc9de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:08.192725 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-da3e9dbf-9784-4afe-bc0a-00a1dacfc9de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:08.272753 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e9dbf-9784-4afe-bc0a-00a1dacfc9de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:08.274875 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e9dbf-9784-4afe-bc0a-00a1dacfc9de service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:08.294066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1379/2748] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:06:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:06:11.807271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5db76b-2467-4e49-9679-1c43acc7fc39 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:11.882310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5db76b-2467-4e49-9679-1c43acc7fc39 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:11.887669 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:11.888523 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:11.888809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:11.889218 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] PATH_INFO: `/v3/users/fc867d3f2c4f43fe8049447706ceabb1` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:11.890401 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc867d3f2c4f43fe8049447706ceabb1)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:11.892389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:11.940345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc867d3f2c4f43fe8049447706ceabb1'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:11.941009 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc867d3f2c4f43fe8049447706ceabb1'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:11.955925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc867d3f2c4f43fe8049447706ceabb1'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:11.964484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc867d3f2c4f43fe8049447706ceabb1'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:11.972248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc867d3f2c4f43fe8049447706ceabb1'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:11.978509 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1370/2749] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:06:11 2022] DELETE /identity/v3/users/fc867d3f2c4f43fe8049447706ceabb1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:06:11.983071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83404127-8c0f-46cd-a13d-d21900d37a64 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:11.983574 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83404127-8c0f-46cd-a13d-d21900d37a64 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:11.983815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83404127-8c0f-46cd-a13d-d21900d37a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:12.004010 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-83404127-8c0f-46cd-a13d-d21900d37a64 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:12.005414 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-83404127-8c0f-46cd-a13d-d21900d37a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:12.073583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1380/2750] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:12.083468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:12.085004 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:12.145362 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12747e29-edd2-4fa4-9706-393375118952 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:12.149678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815312f-28df-4212-a6b1-112c3b522a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:12.150304 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815312f-28df-4212-a6b1-112c3b522a6e service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:12.150585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815312f-28df-4212-a6b1-112c3b522a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:12.150862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815312f-28df-4212-a6b1-112c3b522a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:12.159978 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815312f-28df-4212-a6b1-112c3b522a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:12.161471 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815312f-28df-4212-a6b1-112c3b522a6e service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:12.171534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1371/2751] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:06:12.467636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83404127-8c0f-46cd-a13d-d21900d37a64 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:12.468729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-83404127-8c0f-46cd-a13d-d21900d37a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:12.490521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83404127-8c0f-46cd-a13d-d21900d37a64 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:12.495123 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869705f-c951-460e-b88c-731ebdd8495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:12.495788 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869705f-c951-460e-b88c-731ebdd8495c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:12.496163 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869705f-c951-460e-b88c-731ebdd8495c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:12.496373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869705f-c951-460e-b88c-731ebdd8495c admin admin] PATH_INFO: `/v3/projects/76088122ecdc4386bcbef638ec52de86` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:12.497684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869705f-c951-460e-b88c-731ebdd8495c admin admin] RBAC: Authorizing `identity:delete_project(project_id=76088122ecdc4386bcbef638ec52de86)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:12.499583 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869705f-c951-460e-b88c-731ebdd8495c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:12.502508 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:12.556838 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b869705f-c951-460e-b88c-731ebdd8495c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76088122ecdc4386bcbef638ec52de86', 'request_id': 'req-b869705f-c951-460e-b88c-731ebdd8495c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:12.562962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b869705f-c951-460e-b88c-731ebdd8495c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76088122ecdc4386bcbef638ec52de86', 'request_id': 'req-b869705f-c951-460e-b88c-731ebdd8495c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:12.572784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b869705f-c951-460e-b88c-731ebdd8495c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76088122ecdc4386bcbef638ec52de86', 'request_id': 'req-b869705f-c951-460e-b88c-731ebdd8495c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:12.587299 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b869705f-c951-460e-b88c-731ebdd8495c admin admin] The token cache is being invalidate because project 76088122ecdc4386bcbef638ec52de86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:06:12.587801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b869705f-c951-460e-b88c-731ebdd8495c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:12.588684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b869705f-c951-460e-b88c-731ebdd8495c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:12.590742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1381/2752] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:06:12 2022] DELETE /identity/v3/projects/76088122ecdc4386bcbef638ec52de86 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:06:12.596935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c65d1d-d36b-4f8b-8fb0-ad47d36d46fe None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:12.597473 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c65d1d-d36b-4f8b-8fb0-ad47d36d46fe None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:12.597969 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c65d1d-d36b-4f8b-8fb0-ad47d36d46fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:12.618970 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-96c65d1d-d36b-4f8b-8fb0-ad47d36d46fe None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:12.620185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-96c65d1d-d36b-4f8b-8fb0-ad47d36d46fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:12.637697 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:12.681933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1372/2753] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:12.696951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48573489-97e3-4ae7-b37f-b6a3c8997eff None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:12.697242 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48573489-97e3-4ae7-b37f-b6a3c8997eff None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:12.697519 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48573489-97e3-4ae7-b37f-b6a3c8997eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:12.719023 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-48573489-97e3-4ae7-b37f-b6a3c8997eff None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:12.720290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-48573489-97e3-4ae7-b37f-b6a3c8997eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:12.728526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1382/2754] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:12.732935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c65d1d-d36b-4f8b-8fb0-ad47d36d46fe None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:12.743185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c65d1d-d36b-4f8b-8fb0-ad47d36d46fe None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:12.747645 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501048f1-acec-4860-99d8-be13d3830211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:12.748280 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501048f1-acec-4860-99d8-be13d3830211 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:12.748562 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501048f1-acec-4860-99d8-be13d3830211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:12.748835 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501048f1-acec-4860-99d8-be13d3830211 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:12.749560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501048f1-acec-4860-99d8-be13d3830211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:12.749830 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501048f1-acec-4860-99d8-be13d3830211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:12.751427 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501048f1-acec-4860-99d8-be13d3830211 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:12.763410 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1373/2755] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:12.767800 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48573489-97e3-4ae7-b37f-b6a3c8997eff None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:12.777849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48573489-97e3-4ae7-b37f-b6a3c8997eff None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:12.782498 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1952ac-b382-46fd-826f-c73b5671122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:12.783098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1952ac-b382-46fd-826f-c73b5671122f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:12.783381 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1952ac-b382-46fd-826f-c73b5671122f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:12.783658 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1952ac-b382-46fd-826f-c73b5671122f admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:12.784353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1952ac-b382-46fd-826f-c73b5671122f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:12.786245 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1952ac-b382-46fd-826f-c73b5671122f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:12.814889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1383/2756] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:06:12 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:06:12.818949 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501048f1-acec-4860-99d8-be13d3830211 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:12.832173 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501048f1-acec-4860-99d8-be13d3830211 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:12.889887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5ec27-9294-496c-9cc2-c4428852cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:12.890524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5ec27-9294-496c-9cc2-c4428852cc98 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:12.890807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5ec27-9294-496c-9cc2-c4428852cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:12.891080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5ec27-9294-496c-9cc2-c4428852cc98 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:12.891745 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5ec27-9294-496c-9cc2-c4428852cc98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:12.893715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5ec27-9294-496c-9cc2-c4428852cc98 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:12.914262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1374/2757] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:06:12 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:06:12.918966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1952ac-b382-46fd-826f-c73b5671122f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:12.929082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1952ac-b382-46fd-826f-c73b5671122f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:12.934116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512e6d6-1df8-4f6c-9053-f2d06fc03b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:12.934801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512e6d6-1df8-4f6c-9053-f2d06fc03b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:12.935080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512e6d6-1df8-4f6c-9053-f2d06fc03b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:12.935358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512e6d6-1df8-4f6c-9053-f2d06fc03b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:12.936054 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512e6d6-1df8-4f6c-9053-f2d06fc03b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:12.937688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512e6d6-1df8-4f6c-9053-f2d06fc03b36 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:12.948624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1384/2758] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:06:12.952903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5ec27-9294-496c-9cc2-c4428852cc98 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:12.963647 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5ec27-9294-496c-9cc2-c4428852cc98 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:12.968454 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a3169-bc6c-4a10-8d30-3e5fcfe5afaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:12.969060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3169-bc6c-4a10-8d30-3e5fcfe5afaa admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:12.969339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3169-bc6c-4a10-8d30-3e5fcfe5afaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:12.969616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3169-bc6c-4a10-8d30-3e5fcfe5afaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:12.970297 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a3169-bc6c-4a10-8d30-3e5fcfe5afaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:12.971977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a3169-bc6c-4a10-8d30-3e5fcfe5afaa admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:12.985975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1375/2759] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:06:12.987113 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512e6d6-1df8-4f6c-9053-f2d06fc03b36 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:12.997599 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512e6d6-1df8-4f6c-9053-f2d06fc03b36 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:13.002160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e5689-82d3-47f0-b4bc-34e71ce97f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:13.002808 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e5689-82d3-47f0-b4bc-34e71ce97f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:13.003093 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e5689-82d3-47f0-b4bc-34e71ce97f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:13.003366 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e5689-82d3-47f0-b4bc-34e71ce97f9b admin admin] PATH_INFO: `/v3/projects/4e302e615c17471fa0c5638c2bc08b8c/users/3639081f2d814af4bd963399a7a63312/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:13.018134 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e5689-82d3-47f0-b4bc-34e71ce97f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e302e615c17471fa0c5638c2bc08b8c, user_id=3639081f2d814af4bd963399a7a63312, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:13.020923 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e5689-82d3-47f0-b4bc-34e71ce97f9b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:13.034614 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1385/2760] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:06:12 2022] PUT /identity/v3/projects/4e302e615c17471fa0c5638c2bc08b8c/users/3639081f2d814af4bd963399a7a63312/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:06:13.040775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c654fd-e9c0-4218-bf4f-6fa1acf23ad5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:13.041123 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c654fd-e9c0-4218-bf4f-6fa1acf23ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:13.041478 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c654fd-e9c0-4218-bf4f-6fa1acf23ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:13.060945 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-69c654fd-e9c0-4218-bf4f-6fa1acf23ad5 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:13.062133 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-69c654fd-e9c0-4218-bf4f-6fa1acf23ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:13.121809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1376/2761] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:06:13.131443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e5689-82d3-47f0-b4bc-34e71ce97f9b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:13.133142 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-997e5689-82d3-47f0-b4bc-34e71ce97f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:13.190204 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e5689-82d3-47f0-b4bc-34e71ce97f9b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:13.193821 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ea3cf-141f-455f-845b-652cdeab29cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:13.194431 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ea3cf-141f-455f-845b-652cdeab29cc service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:13.194714 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ea3cf-141f-455f-845b-652cdeab29cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:13.194991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ea3cf-141f-455f-845b-652cdeab29cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:13.204264 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ea3cf-141f-455f-845b-652cdeab29cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:13.205700 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ea3cf-141f-455f-845b-652cdeab29cc service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:13.214977 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1386/2762] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:06:16.228536 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c654fd-e9c0-4218-bf4f-6fa1acf23ad5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:16.240174 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c654fd-e9c0-4218-bf4f-6fa1acf23ad5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:16.244886 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031a04b-ce96-4407-ad0e-472dd15b4855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:16.245607 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031a04b-ce96-4407-ad0e-472dd15b4855 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:16.245965 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031a04b-ce96-4407-ad0e-472dd15b4855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:16.246318 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031a04b-ce96-4407-ad0e-472dd15b4855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:16.248228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e031a04b-ce96-4407-ad0e-472dd15b4855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:16.261226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031a04b-ce96-4407-ad0e-472dd15b4855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:16.262802 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031a04b-ce96-4407-ad0e-472dd15b4855 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:16.273646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1377/2763] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:06:17.490737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b75fd-4b7c-46a7-87ab-ba5e169362b2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:17.491845 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b75fd-4b7c-46a7-87ab-ba5e169362b2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:17.492825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b75fd-4b7c-46a7-87ab-ba5e169362b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:17.567521 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c51b75fd-4b7c-46a7-87ab-ba5e169362b2 None None] MFA Rules not processed for user `3639081f2d814af4bd963399a7a63312`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:17.568811 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c51b75fd-4b7c-46a7-87ab-ba5e169362b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:17.615733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:17.713098 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1387/2764] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:06:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:06:17.718695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031a04b-ce96-4407-ad0e-472dd15b4855 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:17.733317 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031a04b-ce96-4407-ad0e-472dd15b4855 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:17.740528 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d841579-eaf1-43de-b309-8a9a46a3dfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:17.741375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d841579-eaf1-43de-b309-8a9a46a3dfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:17.741737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d841579-eaf1-43de-b309-8a9a46a3dfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:17.742646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d841579-eaf1-43de-b309-8a9a46a3dfb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:17.743404 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d841579-eaf1-43de-b309-8a9a46a3dfb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:17.745556 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d841579-eaf1-43de-b309-8a9a46a3dfb0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:17.771055 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:17.790718 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1378/2765] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:06:17 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:06:17.794846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b75fd-4b7c-46a7-87ab-ba5e169362b2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:17.816406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b75fd-4b7c-46a7-87ab-ba5e169362b2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:17.888817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428ee07-81cf-4bfa-9a95-4ab46823a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:17.889607 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428ee07-81cf-4bfa-9a95-4ab46823a6da admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:17.889963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428ee07-81cf-4bfa-9a95-4ab46823a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:17.890312 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428ee07-81cf-4bfa-9a95-4ab46823a6da admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:17.891058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428ee07-81cf-4bfa-9a95-4ab46823a6da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:17.893118 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428ee07-81cf-4bfa-9a95-4ab46823a6da admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:17.925255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1388/2766] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:06:17 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:06:17.928964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d841579-eaf1-43de-b309-8a9a46a3dfb0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:17.941586 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d841579-eaf1-43de-b309-8a9a46a3dfb0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:17.952730 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ee735-aa78-4dd0-8f6a-490a769b5d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:17.953561 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ee735-aa78-4dd0-8f6a-490a769b5d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:17.953915 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ee735-aa78-4dd0-8f6a-490a769b5d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:17.954462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ee735-aa78-4dd0-8f6a-490a769b5d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:17.955340 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ee735-aa78-4dd0-8f6a-490a769b5d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:17.957087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ee735-aa78-4dd0-8f6a-490a769b5d12 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:17.969438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1379/2767] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:06:17.973951 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428ee07-81cf-4bfa-9a95-4ab46823a6da admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:17.986925 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428ee07-81cf-4bfa-9a95-4ab46823a6da admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:17.992739 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738cca5-f767-4d9d-bd0c-a94c6ae4d823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:17.993617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738cca5-f767-4d9d-bd0c-a94c6ae4d823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:17.994135 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738cca5-f767-4d9d-bd0c-a94c6ae4d823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:17.994288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738cca5-f767-4d9d-bd0c-a94c6ae4d823 admin admin] PATH_INFO: `/v3/projects/1f3e9e056d8f442392b7943dee8e5855/users/4fd9dd03771f4299a005f58c45d78bfe/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:18.016805 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738cca5-f767-4d9d-bd0c-a94c6ae4d823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f3e9e056d8f442392b7943dee8e5855, user_id=4fd9dd03771f4299a005f58c45d78bfe, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:18.021598 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738cca5-f767-4d9d-bd0c-a94c6ae4d823 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:18.043507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1389/2768] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:06:17 2022] PUT /identity/v3/projects/1f3e9e056d8f442392b7943dee8e5855/users/4fd9dd03771f4299a005f58c45d78bfe/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:06:18.045358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ee735-aa78-4dd0-8f6a-490a769b5d12 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:18.058117 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ee735-aa78-4dd0-8f6a-490a769b5d12 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:18.165142 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378dbf1-aa53-45c4-a39d-d2bf46cc4f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:18.165698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378dbf1-aa53-45c4-a39d-d2bf46cc4f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:18.165986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378dbf1-aa53-45c4-a39d-d2bf46cc4f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:18.166267 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378dbf1-aa53-45c4-a39d-d2bf46cc4f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:18.166979 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378dbf1-aa53-45c4-a39d-d2bf46cc4f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:18.168799 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378dbf1-aa53-45c4-a39d-d2bf46cc4f8a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:18.184168 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1380/2769] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:06:18.184597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738cca5-f767-4d9d-bd0c-a94c6ae4d823 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:18.200374 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738cca5-f767-4d9d-bd0c-a94c6ae4d823 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:18.208200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34ce30-d61e-417d-a4be-b9901974e39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:18.209119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ce30-d61e-417d-a4be-b9901974e39c admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:18.209569 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ce30-d61e-417d-a4be-b9901974e39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:18.210011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ce30-d61e-417d-a4be-b9901974e39c admin admin] PATH_INFO: `/v3/projects/1f3e9e056d8f442392b7943dee8e5855/users/4fd9dd03771f4299a005f58c45d78bfe/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:18.216350 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34ce30-d61e-417d-a4be-b9901974e39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f3e9e056d8f442392b7943dee8e5855, user_id=4fd9dd03771f4299a005f58c45d78bfe, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:18.222964 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34ce30-d61e-417d-a4be-b9901974e39c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:18.240636 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1390/2770] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:06:18 2022] PUT /identity/v3/projects/1f3e9e056d8f442392b7943dee8e5855/users/4fd9dd03771f4299a005f58c45d78bfe/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:06:19.999388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378dbf1-aa53-45c4-a39d-d2bf46cc4f8a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:20.001582 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6378dbf1-aa53-45c4-a39d-d2bf46cc4f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:20.128028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34ce30-d61e-417d-a4be-b9901974e39c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:20.133997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3d34ce30-d61e-417d-a4be-b9901974e39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:20.150449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378dbf1-aa53-45c4-a39d-d2bf46cc4f8a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:20.238761 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34ce30-d61e-417d-a4be-b9901974e39c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:20.244968 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e88e4-ea66-4d9e-af1a-1c573359e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:20.245763 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e88e4-ea66-4d9e-af1a-1c573359e047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:20.246155 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e88e4-ea66-4d9e-af1a-1c573359e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:20.246742 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e88e4-ea66-4d9e-af1a-1c573359e047 admin admin] PATH_INFO: `/v3/users/f01062e92f974dc890897d19359e7e63` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:20.247422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcf030-d185-4f90-bf2a-a89b1b783bbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:20.248318 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e88e4-ea66-4d9e-af1a-1c573359e047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01062e92f974dc890897d19359e7e63)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:20.248648 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcf030-d185-4f90-bf2a-a89b1b783bbf service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:20.249499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcf030-d185-4f90-bf2a-a89b1b783bbf service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:20.250203 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcf030-d185-4f90-bf2a-a89b1b783bbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:20.251026 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e88e4-ea66-4d9e-af1a-1c573359e047 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:20.252312 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7afcf030-d185-4f90-bf2a-a89b1b783bbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:20.265057 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcf030-d185-4f90-bf2a-a89b1b783bbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:20.266673 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcf030-d185-4f90-bf2a-a89b1b783bbf service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:20.271080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:20.278819 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1381/2771] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:06:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:06:20.347794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e40e88e4-ea66-4d9e-af1a-1c573359e047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01062e92f974dc890897d19359e7e63'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:20.348654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e40e88e4-ea66-4d9e-af1a-1c573359e047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01062e92f974dc890897d19359e7e63'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:20.358491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e40e88e4-ea66-4d9e-af1a-1c573359e047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01062e92f974dc890897d19359e7e63'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:20.380594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e40e88e4-ea66-4d9e-af1a-1c573359e047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01062e92f974dc890897d19359e7e63'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:20.389476 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e40e88e4-ea66-4d9e-af1a-1c573359e047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01062e92f974dc890897d19359e7e63'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:20.400517 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1391/2772] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:06:20 2022] DELETE /identity/v3/users/f01062e92f974dc890897d19359e7e63 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:06:20.615613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcf030-d185-4f90-bf2a-a89b1b783bbf service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:20.630425 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcf030-d185-4f90-bf2a-a89b1b783bbf service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:20.642099 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:20.717474 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c07778-c233-4c05-aa40-91d8543e72fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:20.718141 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c07778-c233-4c05-aa40-91d8543e72fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:20.718424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c07778-c233-4c05-aa40-91d8543e72fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:20.718704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c07778-c233-4c05-aa40-91d8543e72fc admin admin] PATH_INFO: `/v3/projects/3179955b76864553a96682674d01b781` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:20.720514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c07778-c233-4c05-aa40-91d8543e72fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3179955b76864553a96682674d01b781)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:20.723414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c07778-c233-4c05-aa40-91d8543e72fc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:20.785197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-84c07778-c233-4c05-aa40-91d8543e72fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3179955b76864553a96682674d01b781', 'request_id': 'req-84c07778-c233-4c05-aa40-91d8543e72fc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:20.794695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-84c07778-c233-4c05-aa40-91d8543e72fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3179955b76864553a96682674d01b781', 'request_id': 'req-84c07778-c233-4c05-aa40-91d8543e72fc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:20.816352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-84c07778-c233-4c05-aa40-91d8543e72fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3179955b76864553a96682674d01b781', 'request_id': 'req-84c07778-c233-4c05-aa40-91d8543e72fc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:20.833581 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-84c07778-c233-4c05-aa40-91d8543e72fc admin admin] The token cache is being invalidate because project 3179955b76864553a96682674d01b781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:06:20.834524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-84c07778-c233-4c05-aa40-91d8543e72fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:20.835235 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-84c07778-c233-4c05-aa40-91d8543e72fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:20.840847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1382/2773] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:06:20 2022] DELETE /identity/v3/projects/3179955b76864553a96682674d01b781 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:06:20.842541 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7d3e8-291a-4e0b-bb83-6933ccc352bf None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:20.842835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7d3e8-291a-4e0b-bb83-6933ccc352bf None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:20.843131 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7d3e8-291a-4e0b-bb83-6933ccc352bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:20.869384 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-eda7d3e8-291a-4e0b-bb83-6933ccc352bf None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:20.870791 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-eda7d3e8-291a-4e0b-bb83-6933ccc352bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:20.997327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1392/2774] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:06:21.013880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e2664-703e-472d-9361-8c7897d0dae7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:21.013880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e2664-703e-472d-9361-8c7897d0dae7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:21.014373 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e2664-703e-472d-9361-8c7897d0dae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:21.050002 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-708e2664-703e-472d-9361-8c7897d0dae7 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:21.052379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-708e2664-703e-472d-9361-8c7897d0dae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:21.075494 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1383/2775] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:21.079642 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7d3e8-291a-4e0b-bb83-6933ccc352bf None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:21.091155 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7d3e8-291a-4e0b-bb83-6933ccc352bf None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:21.102874 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afcc9c-7b09-4ba7-b30b-102d5ac40d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:21.104916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afcc9c-7b09-4ba7-b30b-102d5ac40d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:21.105210 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afcc9c-7b09-4ba7-b30b-102d5ac40d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:21.105492 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afcc9c-7b09-4ba7-b30b-102d5ac40d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:21.106219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afcc9c-7b09-4ba7-b30b-102d5ac40d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:21.106532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afcc9c-7b09-4ba7-b30b-102d5ac40d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:21.108376 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afcc9c-7b09-4ba7-b30b-102d5ac40d00 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:21.125248 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1393/2776] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:06:21.129344 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e2664-703e-472d-9361-8c7897d0dae7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:21.140146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e2664-703e-472d-9361-8c7897d0dae7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:21.152244 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebce50c-687b-41b4-8bf3-6a4cc48b7e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:21.153300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebce50c-687b-41b4-8bf3-6a4cc48b7e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:21.153820 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebce50c-687b-41b4-8bf3-6a4cc48b7e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:21.154206 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebce50c-687b-41b4-8bf3-6a4cc48b7e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:21.154988 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebce50c-687b-41b4-8bf3-6a4cc48b7e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:21.157505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebce50c-687b-41b4-8bf3-6a4cc48b7e6b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:21.199898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1384/2777] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:06:21 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:06:21.204110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afcc9c-7b09-4ba7-b30b-102d5ac40d00 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:21.223995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afcc9c-7b09-4ba7-b30b-102d5ac40d00 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:21.301471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522878-471f-49eb-aaad-091a95795195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:21.302377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522878-471f-49eb-aaad-091a95795195 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:21.302848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522878-471f-49eb-aaad-091a95795195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:21.303865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522878-471f-49eb-aaad-091a95795195 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:21.304910 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd522878-471f-49eb-aaad-091a95795195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:21.307882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd522878-471f-49eb-aaad-091a95795195 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:21.341119 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1394/2778] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:06:21 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:06:21.342214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebce50c-687b-41b4-8bf3-6a4cc48b7e6b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:21.356943 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebce50c-687b-41b4-8bf3-6a4cc48b7e6b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:21.369900 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e7329-1323-4649-84b0-f73928ca3b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:21.370825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e7329-1323-4649-84b0-f73928ca3b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:21.371276 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e7329-1323-4649-84b0-f73928ca3b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:21.372590 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e7329-1323-4649-84b0-f73928ca3b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:21.373289 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e7329-1323-4649-84b0-f73928ca3b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:21.374920 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e7329-1323-4649-84b0-f73928ca3b24 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:21.396835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522878-471f-49eb-aaad-091a95795195 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:21.414580 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1385/2779] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:06:21.416721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522878-471f-49eb-aaad-091a95795195 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:21.423167 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf7a77-c2b6-4d65-b262-9028034df97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:21.423812 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf7a77-c2b6-4d65-b262-9028034df97a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:21.424100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf7a77-c2b6-4d65-b262-9028034df97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:21.424415 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf7a77-c2b6-4d65-b262-9028034df97a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:21.425138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf7a77-c2b6-4d65-b262-9028034df97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:21.427617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf7a77-c2b6-4d65-b262-9028034df97a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:21.433014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:21.453122 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1395/2780] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:06:21.454513 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e7329-1323-4649-84b0-f73928ca3b24 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:21.469880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e7329-1323-4649-84b0-f73928ca3b24 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:21.480975 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00581b2-1e18-4647-b6e0-95c2d71a0db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:21.482542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00581b2-1e18-4647-b6e0-95c2d71a0db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:21.482542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00581b2-1e18-4647-b6e0-95c2d71a0db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:21.482542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00581b2-1e18-4647-b6e0-95c2d71a0db8 admin admin] PATH_INFO: `/v3/projects/79efd54304bb4c398a6d16888affef04/users/f0be2f57f67f45c384e46791027475e4/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:21.502041 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00581b2-1e18-4647-b6e0-95c2d71a0db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79efd54304bb4c398a6d16888affef04, user_id=f0be2f57f67f45c384e46791027475e4, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:21.505094 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00581b2-1e18-4647-b6e0-95c2d71a0db8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:21.534985 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1386/2781] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:06:21 2022] PUT /identity/v3/projects/79efd54304bb4c398a6d16888affef04/users/f0be2f57f67f45c384e46791027475e4/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:06:21.537537 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb414a4-da4c-4c12-9f97-b8800c71094f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:21.538071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb414a4-da4c-4c12-9f97-b8800c71094f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:21.540863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb414a4-da4c-4c12-9f97-b8800c71094f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:21.610136 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fbb414a4-da4c-4c12-9f97-b8800c71094f None None] MFA Rules not processed for user `f0be2f57f67f45c384e46791027475e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:21.611938 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fbb414a4-da4c-4c12-9f97-b8800c71094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:21.780147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1396/2782] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:06:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:21.780568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00581b2-1e18-4647-b6e0-95c2d71a0db8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:21.883491 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:21.917524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00581b2-1e18-4647-b6e0-95c2d71a0db8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:21.927358 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b0b9f-00d7-4a23-bed2-c4004c64b5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:21.928178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b0b9f-00d7-4a23-bed2-c4004c64b5bd admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:21.928573 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b0b9f-00d7-4a23-bed2-c4004c64b5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:21.929021 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b0b9f-00d7-4a23-bed2-c4004c64b5bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:21.930706 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b0b9f-00d7-4a23-bed2-c4004c64b5bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:21.932911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b0b9f-00d7-4a23-bed2-c4004c64b5bd admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:21.977875 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1387/2783] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:06:21 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:06:21.978074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb414a4-da4c-4c12-9f97-b8800c71094f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:21.997236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb414a4-da4c-4c12-9f97-b8800c71094f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.126218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33453ac-41f6-4f4b-80cc-6f9f62268ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.127171 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33453ac-41f6-4f4b-80cc-6f9f62268ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.127461 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33453ac-41f6-4f4b-80cc-6f9f62268ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.127908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33453ac-41f6-4f4b-80cc-6f9f62268ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.129191 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33453ac-41f6-4f4b-80cc-6f9f62268ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.131552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33453ac-41f6-4f4b-80cc-6f9f62268ab6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.168401 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1397/2784] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:06:21 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:06:22.173071 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b0b9f-00d7-4a23-bed2-c4004c64b5bd admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:22.196290 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b0b9f-00d7-4a23-bed2-c4004c64b5bd admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.203876 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b1706-01ae-41c6-a748-780885b798c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.204962 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b1706-01ae-41c6-a748-780885b798c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.205499 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b1706-01ae-41c6-a748-780885b798c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.206075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b1706-01ae-41c6-a748-780885b798c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.208011 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b1706-01ae-41c6-a748-780885b798c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.209836 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b1706-01ae-41c6-a748-780885b798c7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.232674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1388/2785] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:06:22.233831 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33453ac-41f6-4f4b-80cc-6f9f62268ab6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:22.252360 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33453ac-41f6-4f4b-80cc-6f9f62268ab6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.269224 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf12c3-4ca3-495e-b666-26a950b12776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.270818 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf12c3-4ca3-495e-b666-26a950b12776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.271279 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf12c3-4ca3-495e-b666-26a950b12776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.271768 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf12c3-4ca3-495e-b666-26a950b12776 admin admin] PATH_INFO: `/v3/projects/96999316ce234cb6bfd2c91b7220c4a5/users/c48db83486a246adb056c6fbb20afddc/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.319533 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf12c3-4ca3-495e-b666-26a950b12776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96999316ce234cb6bfd2c91b7220c4a5, user_id=c48db83486a246adb056c6fbb20afddc, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.322331 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf12c3-4ca3-495e-b666-26a950b12776 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.343842 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1398/2786] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:06:22 2022] PUT /identity/v3/projects/96999316ce234cb6bfd2c91b7220c4a5/users/c48db83486a246adb056c6fbb20afddc/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:06:22.345132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b1706-01ae-41c6-a748-780885b798c7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:22.362587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b1706-01ae-41c6-a748-780885b798c7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.447322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549a2e9-6a6b-4bfc-b094-5e5b47eb0de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.448268 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549a2e9-6a6b-4bfc-b094-5e5b47eb0de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.448658 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549a2e9-6a6b-4bfc-b094-5e5b47eb0de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.449013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549a2e9-6a6b-4bfc-b094-5e5b47eb0de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.449863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549a2e9-6a6b-4bfc-b094-5e5b47eb0de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.452212 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549a2e9-6a6b-4bfc-b094-5e5b47eb0de7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.468620 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1389/2787] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:06:22.472737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf12c3-4ca3-495e-b666-26a950b12776 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:22.485819 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf12c3-4ca3-495e-b666-26a950b12776 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.491333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22cfb2-d2be-44a9-9be6-17c9c9e107cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.492533 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22cfb2-d2be-44a9-9be6-17c9c9e107cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.496421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22cfb2-d2be-44a9-9be6-17c9c9e107cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.496421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22cfb2-d2be-44a9-9be6-17c9c9e107cf admin admin] PATH_INFO: `/v3/projects/96999316ce234cb6bfd2c91b7220c4a5/users/c48db83486a246adb056c6fbb20afddc/roles/55eadb7f82cc444296a433ecdbcdb69b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.496421 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22cfb2-d2be-44a9-9be6-17c9c9e107cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=96999316ce234cb6bfd2c91b7220c4a5, user_id=c48db83486a246adb056c6fbb20afddc, role_id=55eadb7f82cc444296a433ecdbcdb69b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.499298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22cfb2-d2be-44a9-9be6-17c9c9e107cf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.520587 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1399/2788] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:06:22 2022] PUT /identity/v3/projects/96999316ce234cb6bfd2c91b7220c4a5/users/c48db83486a246adb056c6fbb20afddc/roles/55eadb7f82cc444296a433ecdbcdb69b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:06:22.531618 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0ba0c-5d32-45d3-abf9-8374f199b13f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.531907 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0ba0c-5d32-45d3-abf9-8374f199b13f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.532226 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0ba0c-5d32-45d3-abf9-8374f199b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.573992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-07b0ba0c-5d32-45d3-abf9-8374f199b13f None None] MFA Rules not processed for user `c48db83486a246adb056c6fbb20afddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:22.577025 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-07b0ba0c-5d32-45d3-abf9-8374f199b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:22.680964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1390/2789] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:06:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:22.689208 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22cfb2-d2be-44a9-9be6-17c9c9e107cf admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:22.691084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9e22cfb2-d2be-44a9-9be6-17c9c9e107cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:22.765786 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:22.798179 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22cfb2-d2be-44a9-9be6-17c9c9e107cf admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.809865 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7371946-9034-43c8-a088-ea5eae52d81a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.810513 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7371946-9034-43c8-a088-ea5eae52d81a service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.810796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7371946-9034-43c8-a088-ea5eae52d81a service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.811100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7371946-9034-43c8-a088-ea5eae52d81a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.895997 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7371946-9034-43c8-a088-ea5eae52d81a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.898821 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7371946-9034-43c8-a088-ea5eae52d81a service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.914860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1400/2790] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:06:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:06:23.672533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a956b26-cab8-4973-ac73-a9adaaac9452 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:23.673074 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a956b26-cab8-4973-ac73-a9adaaac9452 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:23.673074 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a956b26-cab8-4973-ac73-a9adaaac9452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:23.726781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6a956b26-cab8-4973-ac73-a9adaaac9452 None None] MFA Rules not processed for user `4fd9dd03771f4299a005f58c45d78bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:23.728093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6a956b26-cab8-4973-ac73-a9adaaac9452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:23.756953 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:23.854059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1391/2791] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:06:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:23.874387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7371946-9034-43c8-a088-ea5eae52d81a service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:23.876531 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e7371946-9034-43c8-a088-ea5eae52d81a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:23.987621 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7371946-9034-43c8-a088-ea5eae52d81a service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:23.991555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca49da-3a07-47cb-bab1-ea7ad57c8614 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b08a946b43f08028c5da415d4e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:23.992274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca49da-3a07-47cb-bab1-ea7ad57c8614 service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:23.992564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca49da-3a07-47cb-bab1-ea7ad57c8614 service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:23.992852 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca49da-3a07-47cb-bab1-ea7ad57c8614 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:23.994684 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c0ca49da-3a07-47cb-bab1-ea7ad57c8614 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:24.071014 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca49da-3a07-47cb-bab1-ea7ad57c8614 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:24.073156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca49da-3a07-47cb-bab1-ea7ad57c8614 service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:24.084743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1401/2792] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:06:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:06:24.255982 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1fa6b-ec83-4c62-868c-b6c01f0741e0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:24.256350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1fa6b-ec83-4c62-868c-b6c01f0741e0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:24.256584 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1fa6b-ec83-4c62-868c-b6c01f0741e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:24.322281 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4db1fa6b-ec83-4c62-868c-b6c01f0741e0 None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:24.323964 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4db1fa6b-ec83-4c62-868c-b6c01f0741e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:24.392407 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1392/2793] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 09:06:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:24.452306 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca49da-3a07-47cb-bab1-ea7ad57c8614 service glance] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:24.457671 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c0ca49da-3a07-47cb-bab1-ea7ad57c8614 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:24.506301 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:24.584966 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca49da-3a07-47cb-bab1-ea7ad57c8614 service glance] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:24.591654 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e347b6-dfaf-4f29-a493-9a132bdbd774 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:24.592477 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e347b6-dfaf-4f29-a493-9a132bdbd774 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:24.592944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e347b6-dfaf-4f29-a493-9a132bdbd774 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:24.593228 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e347b6-dfaf-4f29-a493-9a132bdbd774 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:24.605673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e347b6-dfaf-4f29-a493-9a132bdbd774 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:24.607571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e347b6-dfaf-4f29-a493-9a132bdbd774 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:24.620083 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1402/2794] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 09:06:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:29.922887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1fa6b-ec83-4c62-868c-b6c01f0741e0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:29.934079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1fa6b-ec83-4c62-868c-b6c01f0741e0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:29.937974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7780bf-6fc0-45fa-bbee-bc5fd4e90df9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:29.938782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7780bf-6fc0-45fa-bbee-bc5fd4e90df9 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:29.938927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7780bf-6fc0-45fa-bbee-bc5fd4e90df9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:29.939138 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7780bf-6fc0-45fa-bbee-bc5fd4e90df9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:29.949194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7780bf-6fc0-45fa-bbee-bc5fd4e90df9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:29.951188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7780bf-6fc0-45fa-bbee-bc5fd4e90df9 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:29.974427 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1393/2795] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:06:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:06:33.046305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cefb2-280c-4642-9c04-6c4a3548a312 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:33.046829 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cefb2-280c-4642-9c04-6c4a3548a312 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:33.046963 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cefb2-280c-4642-9c04-6c4a3548a312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:33.065795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-834cefb2-280c-4642-9c04-6c4a3548a312 None None] MFA Rules not processed for user `3639081f2d814af4bd963399a7a63312`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:33.066999 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-834cefb2-280c-4642-9c04-6c4a3548a312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:33.074385 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1403/2796] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:06:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:35.159197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a0d9a-4cd5-4477-900f-15751fa8b386 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:35.159725 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a0d9a-4cd5-4477-900f-15751fa8b386 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:35.159967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a0d9a-4cd5-4477-900f-15751fa8b386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:35.181066 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-db4a0d9a-4cd5-4477-900f-15751fa8b386 None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:35.182380 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-db4a0d9a-4cd5-4477-900f-15751fa8b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:35.189919 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1394/2797] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 09:06:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:35.202646 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cefb2-280c-4642-9c04-6c4a3548a312 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:35.215295 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cefb2-280c-4642-9c04-6c4a3548a312 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:35.221302 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0dc3f2-55f4-4e5f-bbd3-71500e66d3a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:35.222011 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dc3f2-55f4-4e5f-bbd3-71500e66d3a4 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:35.222303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dc3f2-55f4-4e5f-bbd3-71500e66d3a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:35.222569 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dc3f2-55f4-4e5f-bbd3-71500e66d3a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:35.233469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0dc3f2-55f4-4e5f-bbd3-71500e66d3a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:35.235314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0dc3f2-55f4-4e5f-bbd3-71500e66d3a4 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:35.243789 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1404/2798] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 09:06:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:45.175927 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=68 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:45.240550 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=37 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:05.555728 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a0d9a-4cd5-4477-900f-15751fa8b386 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:05.626977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a0d9a-4cd5-4477-900f-15751fa8b386 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:05.631608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:05.632463 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:05.632775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:05.633057 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] PATH_INFO: `/v3/users/f0be2f57f67f45c384e46791027475e4` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:05.634243 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0be2f57f67f45c384e46791027475e4)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:05.636850 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:05.689752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0be2f57f67f45c384e46791027475e4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:05.690411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0be2f57f67f45c384e46791027475e4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:05.704133 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0be2f57f67f45c384e46791027475e4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:05.713008 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0be2f57f67f45c384e46791027475e4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:05.720505 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0be2f57f67f45c384e46791027475e4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:05.727843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1395/2799] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:07:05 2022] DELETE /identity/v3/users/f0be2f57f67f45c384e46791027475e4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:07:05.733171 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f19782-9ab0-4c03-b4ac-978508a98342 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:05.733697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f19782-9ab0-4c03-b4ac-978508a98342 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:05.733697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f19782-9ab0-4c03-b4ac-978508a98342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:05.754596 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a6f19782-9ab0-4c03-b4ac-978508a98342 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:05.755807 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a6f19782-9ab0-4c03-b4ac-978508a98342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:05.816455 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1405/2800] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:07:05.828414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:05.829789 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:05.891729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720ba80-d80b-4c44-8211-1827e49f718f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:05.895302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0709b0e-4988-48bd-9480-f6d2c5b03b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:05.895911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0709b0e-4988-48bd-9480-f6d2c5b03b87 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:05.896229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0709b0e-4988-48bd-9480-f6d2c5b03b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:05.896506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0709b0e-4988-48bd-9480-f6d2c5b03b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:05.905437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0709b0e-4988-48bd-9480-f6d2c5b03b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:05.906848 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0709b0e-4988-48bd-9480-f6d2c5b03b87 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:05.916814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1396/2801] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:07:06.198962 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f19782-9ab0-4c03-b4ac-978508a98342 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:06.200772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a6f19782-9ab0-4c03-b4ac-978508a98342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:06.212691 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f19782-9ab0-4c03-b4ac-978508a98342 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:06.217670 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:06.218390 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:06.218669 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:06.218941 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] PATH_INFO: `/v3/projects/79efd54304bb4c398a6d16888affef04` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:06.220087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79efd54304bb4c398a6d16888affef04)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:06.222058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:06.269241 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79efd54304bb4c398a6d16888affef04', 'request_id': 'req-5a0b977d-9e05-40f2-aca6-afaf409428a7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.274694 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79efd54304bb4c398a6d16888affef04', 'request_id': 'req-5a0b977d-9e05-40f2-aca6-afaf409428a7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.282825 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79efd54304bb4c398a6d16888affef04', 'request_id': 'req-5a0b977d-9e05-40f2-aca6-afaf409428a7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.294526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] The token cache is being invalidate because project 79efd54304bb4c398a6d16888affef04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:07:06.294815 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.295473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.296995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1406/2802] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:07:06 2022] DELETE /identity/v3/projects/79efd54304bb4c398a6d16888affef04 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:07:06.300983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0709b0e-4988-48bd-9480-f6d2c5b03b87 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:06.311807 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0709b0e-4988-48bd-9480-f6d2c5b03b87 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:06.329557 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:06.371812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735d8e1-9e12-4dcc-940a-440121fb7b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:06.372481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d8e1-9e12-4dcc-940a-440121fb7b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:06.372759 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d8e1-9e12-4dcc-940a-440121fb7b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:06.373033 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d8e1-9e12-4dcc-940a-440121fb7b07 admin admin] PATH_INFO: `/v3/users/c48db83486a246adb056c6fbb20afddc` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:06.374205 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735d8e1-9e12-4dcc-940a-440121fb7b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48db83486a246adb056c6fbb20afddc)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:06.376189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735d8e1-9e12-4dcc-940a-440121fb7b07 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:06.423208 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f735d8e1-9e12-4dcc-940a-440121fb7b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48db83486a246adb056c6fbb20afddc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.423863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f735d8e1-9e12-4dcc-940a-440121fb7b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48db83486a246adb056c6fbb20afddc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.436587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f735d8e1-9e12-4dcc-940a-440121fb7b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48db83486a246adb056c6fbb20afddc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.443984 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f735d8e1-9e12-4dcc-940a-440121fb7b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48db83486a246adb056c6fbb20afddc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.451869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f735d8e1-9e12-4dcc-940a-440121fb7b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48db83486a246adb056c6fbb20afddc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.457666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1397/2803] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:07:06 2022] DELETE /identity/v3/users/c48db83486a246adb056c6fbb20afddc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:07:06.730294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:06.731804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:06.748772 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b977d-9e05-40f2-aca6-afaf409428a7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:06.814059 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:06.814976 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:06.815501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:06.816110 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb admin admin] PATH_INFO: `/v3/projects/96999316ce234cb6bfd2c91b7220c4a5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:06.817337 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=96999316ce234cb6bfd2c91b7220c4a5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:06.819292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:06.851143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:06.873132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96999316ce234cb6bfd2c91b7220c4a5', 'request_id': 'req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.879288 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96999316ce234cb6bfd2c91b7220c4a5', 'request_id': 'req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.886721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96999316ce234cb6bfd2c91b7220c4a5', 'request_id': 'req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.898480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb admin admin] The token cache is being invalidate because project 96999316ce234cb6bfd2c91b7220c4a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:07:06.898775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.899433 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c1848cb3-0afb-4c2d-8f16-175f299fc6cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:06.901028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1407/2804] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:07:06 2022] DELETE /identity/v3/projects/96999316ce234cb6bfd2c91b7220c4a5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:07:06.906185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f41455-d677-420f-8794-c9ac779150c3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:06.906642 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f41455-d677-420f-8794-c9ac779150c3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:06.907026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f41455-d677-420f-8794-c9ac779150c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:06.927302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-44f41455-d677-420f-8794-c9ac779150c3 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:06.928596 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-44f41455-d677-420f-8794-c9ac779150c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:06.987295 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1398/2805] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:07:06.995740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083321a6-2272-4d24-a3bd-835a14ef0f1e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:06.996031 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083321a6-2272-4d24-a3bd-835a14ef0f1e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:06.996340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083321a6-2272-4d24-a3bd-835a14ef0f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.015615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-083321a6-2272-4d24-a3bd-835a14ef0f1e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:07.016869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-083321a6-2272-4d24-a3bd-835a14ef0f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:07.024744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1408/2806] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:07:07.029333 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f41455-d677-420f-8794-c9ac779150c3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:07.038858 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f41455-d677-420f-8794-c9ac779150c3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:07.044294 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ba148-fd6e-4086-bbf5-09afb56a44cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:07.044898 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ba148-fd6e-4086-bbf5-09afb56a44cf admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:07.045184 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ba148-fd6e-4086-bbf5-09afb56a44cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:07.045462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ba148-fd6e-4086-bbf5-09afb56a44cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.046157 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ba148-fd6e-4086-bbf5-09afb56a44cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:07:07.046468 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ba148-fd6e-4086-bbf5-09afb56a44cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:07.048080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ba148-fd6e-4086-bbf5-09afb56a44cf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:07.059617 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1399/2807] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:07:07.063985 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083321a6-2272-4d24-a3bd-835a14ef0f1e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:07.073159 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083321a6-2272-4d24-a3bd-835a14ef0f1e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:07.078022 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c7c0a-5f3c-4a9a-9174-a474fbb674d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:07.078623 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c7c0a-5f3c-4a9a-9174-a474fbb674d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:07.078903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c7c0a-5f3c-4a9a-9174-a474fbb674d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:07.079178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c7c0a-5f3c-4a9a-9174-a474fbb674d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.079832 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c7c0a-5f3c-4a9a-9174-a474fbb674d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:07.081765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c7c0a-5f3c-4a9a-9174-a474fbb674d7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:07.109329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1409/2808] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:07:07 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:07:07.113268 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ba148-fd6e-4086-bbf5-09afb56a44cf admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:07.123132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ba148-fd6e-4086-bbf5-09afb56a44cf admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:07.148933 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:07.194271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595307be-1c38-4e63-b508-28183f346e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:07.195010 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595307be-1c38-4e63-b508-28183f346e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:07.195351 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595307be-1c38-4e63-b508-28183f346e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:07.195679 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595307be-1c38-4e63-b508-28183f346e1e admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.196441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595307be-1c38-4e63-b508-28183f346e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:07.198407 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595307be-1c38-4e63-b508-28183f346e1e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:07.223072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1400/2809] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:07:07 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:07:07.227209 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c7c0a-5f3c-4a9a-9174-a474fbb674d7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:07.238156 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c7c0a-5f3c-4a9a-9174-a474fbb674d7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:07.242840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205244c-10dc-4bd9-898c-e9070892cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:07.243443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205244c-10dc-4bd9-898c-e9070892cead admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:07.243736 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205244c-10dc-4bd9-898c-e9070892cead admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:07.244018 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205244c-10dc-4bd9-898c-e9070892cead admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.244747 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205244c-10dc-4bd9-898c-e9070892cead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:07.246379 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205244c-10dc-4bd9-898c-e9070892cead admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:07.256236 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1410/2810] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:07:07.260069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595307be-1c38-4e63-b508-28183f346e1e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:07.269793 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595307be-1c38-4e63-b508-28183f346e1e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:07.274326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ed28b-7415-4221-bfb5-0f689dfd5a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:07.274925 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ed28b-7415-4221-bfb5-0f689dfd5a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:07.275720 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ed28b-7415-4221-bfb5-0f689dfd5a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:07.275995 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ed28b-7415-4221-bfb5-0f689dfd5a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.276715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ed28b-7415-4221-bfb5-0f689dfd5a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:07.278284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ed28b-7415-4221-bfb5-0f689dfd5a8c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:07.288657 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1401/2811] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:07:07.293352 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205244c-10dc-4bd9-898c-e9070892cead admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:07.303321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205244c-10dc-4bd9-898c-e9070892cead admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:07.308031 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de76f15-f594-4c7f-b1f1-18fed92a02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:07.308721 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de76f15-f594-4c7f-b1f1-18fed92a02d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:07.309004 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de76f15-f594-4c7f-b1f1-18fed92a02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:07.309283 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de76f15-f594-4c7f-b1f1-18fed92a02d2 admin admin] PATH_INFO: `/v3/projects/2ce80ad2ae7f408e99386819acd376b7/users/fe1d83601f8a49e18776fae117e31653/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.323974 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de76f15-f594-4c7f-b1f1-18fed92a02d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce80ad2ae7f408e99386819acd376b7, user_id=fe1d83601f8a49e18776fae117e31653, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:07.326940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de76f15-f594-4c7f-b1f1-18fed92a02d2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:07.340084 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1411/2812] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:07:07 2022] PUT /identity/v3/projects/2ce80ad2ae7f408e99386819acd376b7/users/fe1d83601f8a49e18776fae117e31653/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:07:07.350447 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f715ce-4a70-426e-8828-5a4dbcbc14e6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:07.350738 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f715ce-4a70-426e-8828-5a4dbcbc14e6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:07.351012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f715ce-4a70-426e-8828-5a4dbcbc14e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.378611 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c5f715ce-4a70-426e-8828-5a4dbcbc14e6 None None] MFA Rules not processed for user `fe1d83601f8a49e18776fae117e31653`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:07.379872 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c5f715ce-4a70-426e-8828-5a4dbcbc14e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:07.450299 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1402/2813] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:07:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:07:07.461744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de76f15-f594-4c7f-b1f1-18fed92a02d2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:07.464801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1de76f15-f594-4c7f-b1f1-18fed92a02d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:07.524702 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de76f15-f594-4c7f-b1f1-18fed92a02d2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:07.529274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7d352-424a-4620-be72-08518e54e289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:07.529898 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7d352-424a-4620-be72-08518e54e289 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:07.530186 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7d352-424a-4620-be72-08518e54e289 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:07.530468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7d352-424a-4620-be72-08518e54e289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.542070 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7d352-424a-4620-be72-08518e54e289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:07.543509 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7d352-424a-4620-be72-08518e54e289 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:07.553493 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1412/2814] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:07:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:07:07.574187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f715ce-4a70-426e-8828-5a4dbcbc14e6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:07.635413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f715ce-4a70-426e-8828-5a4dbcbc14e6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:07.639856 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:07.640525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:07.640809 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:07.641085 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] PATH_INFO: `/v3/users/fe1d83601f8a49e18776fae117e31653` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.642234 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1d83601f8a49e18776fae117e31653)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:07.644603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:07.685563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:07.693058 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1d83601f8a49e18776fae117e31653'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:07.693863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1d83601f8a49e18776fae117e31653'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:07.706855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1d83601f8a49e18776fae117e31653'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:07.714601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1d83601f8a49e18776fae117e31653'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:07.721892 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1d83601f8a49e18776fae117e31653'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:07.727907 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1403/2815] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:07:07 2022] DELETE /identity/v3/users/fe1d83601f8a49e18776fae117e31653 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:07:07.732440 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a251df7-86b7-4270-9fcd-6f1903bbff09 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:07.732733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a251df7-86b7-4270-9fcd-6f1903bbff09 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:07.733015 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a251df7-86b7-4270-9fcd-6f1903bbff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.752010 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0a251df7-86b7-4270-9fcd-6f1903bbff09 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:07.753238 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0a251df7-86b7-4270-9fcd-6f1903bbff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:07.799113 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:07.813071 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1413/2816] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:07:07.823340 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:07.825029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:07.896951 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c8661-ae00-46e0-922f-235938502f58 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:07.900983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22db4e-5506-4289-860d-fb2d2d64b4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:07.901604 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22db4e-5506-4289-860d-fb2d2d64b4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:07.901889 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22db4e-5506-4289-860d-fb2d2d64b4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:07.902163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22db4e-5506-4289-860d-fb2d2d64b4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.913980 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22db4e-5506-4289-860d-fb2d2d64b4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:07.915422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22db4e-5506-4289-860d-fb2d2d64b4a4 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:07.925266 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1404/2817] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:07:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:07:08.294247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a251df7-86b7-4270-9fcd-6f1903bbff09 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:08.295860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0a251df7-86b7-4270-9fcd-6f1903bbff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:08.311148 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a251df7-86b7-4270-9fcd-6f1903bbff09 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:08.315936 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc8fa8-5b00-47a3-a771-613129fd3479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:08.316781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc8fa8-5b00-47a3-a771-613129fd3479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:08.316912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc8fa8-5b00-47a3-a771-613129fd3479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:08.317186 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc8fa8-5b00-47a3-a771-613129fd3479 admin admin] PATH_INFO: `/v3/projects/2ce80ad2ae7f408e99386819acd376b7` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:08.318473 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc8fa8-5b00-47a3-a771-613129fd3479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce80ad2ae7f408e99386819acd376b7)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:08.320420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc8fa8-5b00-47a3-a771-613129fd3479 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:08.372324 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3abc8fa8-5b00-47a3-a771-613129fd3479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce80ad2ae7f408e99386819acd376b7', 'request_id': 'req-3abc8fa8-5b00-47a3-a771-613129fd3479'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:08.377882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3abc8fa8-5b00-47a3-a771-613129fd3479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce80ad2ae7f408e99386819acd376b7', 'request_id': 'req-3abc8fa8-5b00-47a3-a771-613129fd3479'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:08.385252 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3abc8fa8-5b00-47a3-a771-613129fd3479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce80ad2ae7f408e99386819acd376b7', 'request_id': 'req-3abc8fa8-5b00-47a3-a771-613129fd3479'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:08.396434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3abc8fa8-5b00-47a3-a771-613129fd3479 admin admin] The token cache is being invalidate because project 2ce80ad2ae7f408e99386819acd376b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:07:08.396720 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3abc8fa8-5b00-47a3-a771-613129fd3479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:08.397350 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3abc8fa8-5b00-47a3-a771-613129fd3479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:07:08.398867 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1414/2818] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:07:08 2022] DELETE /identity/v3/projects/2ce80ad2ae7f408e99386819acd376b7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:07:08.403892 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1097a9-3fcf-4cd2-9e40-27c4d175a541 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:08.404146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1097a9-3fcf-4cd2-9e40-27c4d175a541 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:08.404472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1097a9-3fcf-4cd2-9e40-27c4d175a541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:08.424587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1e1097a9-3fcf-4cd2-9e40-27c4d175a541 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:08.425800 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1e1097a9-3fcf-4cd2-9e40-27c4d175a541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:08.487145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1405/2819] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:07:08.496626 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35604de2-5c04-4361-9d0b-447437ef2d81 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:08.496918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35604de2-5c04-4361-9d0b-447437ef2d81 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:08.497199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35604de2-5c04-4361-9d0b-447437ef2d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:08.516294 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-35604de2-5c04-4361-9d0b-447437ef2d81 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:08.517497 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-35604de2-5c04-4361-9d0b-447437ef2d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:08.525848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1415/2820] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:07:08.529937 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1097a9-3fcf-4cd2-9e40-27c4d175a541 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:08.539532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1097a9-3fcf-4cd2-9e40-27c4d175a541 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:08.544766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94ed3a-f5a3-4d79-865b-9f6e0f6f551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:08.545375 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94ed3a-f5a3-4d79-865b-9f6e0f6f551b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:08.545659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94ed3a-f5a3-4d79-865b-9f6e0f6f551b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:08.545936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94ed3a-f5a3-4d79-865b-9f6e0f6f551b admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:08.546638 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94ed3a-f5a3-4d79-865b-9f6e0f6f551b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:07:08.546944 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94ed3a-f5a3-4d79-865b-9f6e0f6f551b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:08.548565 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94ed3a-f5a3-4d79-865b-9f6e0f6f551b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:08.560310 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1406/2821] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:07:08.565634 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35604de2-5c04-4361-9d0b-447437ef2d81 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:08.575168 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35604de2-5c04-4361-9d0b-447437ef2d81 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:08.579789 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38c6d3-4e7c-4da1-a52c-1de048c37b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:08.580428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38c6d3-4e7c-4da1-a52c-1de048c37b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:08.580711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38c6d3-4e7c-4da1-a52c-1de048c37b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:08.580985 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38c6d3-4e7c-4da1-a52c-1de048c37b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:08.581652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38c6d3-4e7c-4da1-a52c-1de048c37b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:08.583546 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38c6d3-4e7c-4da1-a52c-1de048c37b77 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:08.612291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1416/2822] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:07:08 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:07:08.616524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94ed3a-f5a3-4d79-865b-9f6e0f6f551b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:08.626389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94ed3a-f5a3-4d79-865b-9f6e0f6f551b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:08.670079 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:08.685003 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbf5c7-90e7-4501-9c92-35b46d0daa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:08.685614 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbf5c7-90e7-4501-9c92-35b46d0daa9b admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:08.685901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbf5c7-90e7-4501-9c92-35b46d0daa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:08.686179 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbf5c7-90e7-4501-9c92-35b46d0daa9b admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:08.686842 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbf5c7-90e7-4501-9c92-35b46d0daa9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:08.688855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbf5c7-90e7-4501-9c92-35b46d0daa9b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:08.710694 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1407/2823] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:07:08 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:07:08.715354 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38c6d3-4e7c-4da1-a52c-1de048c37b77 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:08.725662 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38c6d3-4e7c-4da1-a52c-1de048c37b77 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:08.730877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dee91-5323-4b2a-86be-f7d17c549424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:08.731512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dee91-5323-4b2a-86be-f7d17c549424 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:08.731773 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dee91-5323-4b2a-86be-f7d17c549424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:08.732065 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dee91-5323-4b2a-86be-f7d17c549424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:08.732795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dee91-5323-4b2a-86be-f7d17c549424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:08.734391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dee91-5323-4b2a-86be-f7d17c549424 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:08.744590 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1417/2824] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:07:08.748977 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbf5c7-90e7-4501-9c92-35b46d0daa9b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:08.759086 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbf5c7-90e7-4501-9c92-35b46d0daa9b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:08.763663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856d6f0-4458-4415-bbb0-2b11eb4dcdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:08.764302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856d6f0-4458-4415-bbb0-2b11eb4dcdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:08.764589 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856d6f0-4458-4415-bbb0-2b11eb4dcdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:08.764867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856d6f0-4458-4415-bbb0-2b11eb4dcdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:08.765560 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856d6f0-4458-4415-bbb0-2b11eb4dcdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:08.767130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856d6f0-4458-4415-bbb0-2b11eb4dcdd6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:08.778535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1408/2825] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:07:08.782810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dee91-5323-4b2a-86be-f7d17c549424 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:08.793630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dee91-5323-4b2a-86be-f7d17c549424 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:08.798265 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f50dbb-e2f6-419e-81fd-7b7a0ce400eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:08.798926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f50dbb-e2f6-419e-81fd-7b7a0ce400eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:08.799210 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f50dbb-e2f6-419e-81fd-7b7a0ce400eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:08.799488 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f50dbb-e2f6-419e-81fd-7b7a0ce400eb admin admin] PATH_INFO: `/v3/projects/79cf9558cd344c639e5f1a2051364659/users/a7d34b23e862400bbf082a0578708a4b/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:08.814869 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f50dbb-e2f6-419e-81fd-7b7a0ce400eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=79cf9558cd344c639e5f1a2051364659, user_id=a7d34b23e862400bbf082a0578708a4b, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:08.817564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f50dbb-e2f6-419e-81fd-7b7a0ce400eb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:08.830846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1418/2826] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:07:08 2022] PUT /identity/v3/projects/79cf9558cd344c639e5f1a2051364659/users/a7d34b23e862400bbf082a0578708a4b/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:07:08.835855 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d73966-9bf3-48dc-96b4-5f13b2ac87ac None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:08.836176 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d73966-9bf3-48dc-96b4-5f13b2ac87ac None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:08.836462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d73966-9bf3-48dc-96b4-5f13b2ac87ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:08.856241 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d1d73966-9bf3-48dc-96b4-5f13b2ac87ac None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:08.857437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d1d73966-9bf3-48dc-96b4-5f13b2ac87ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:08.915431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1409/2827] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:07:08.925116 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f50dbb-e2f6-419e-81fd-7b7a0ce400eb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:08.926731 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a8f50dbb-e2f6-419e-81fd-7b7a0ce400eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:08.983863 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f50dbb-e2f6-419e-81fd-7b7a0ce400eb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:08.987582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb032f6-6316-4271-8748-1c3353510cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:08.988230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb032f6-6316-4271-8748-1c3353510cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:08.988518 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb032f6-6316-4271-8748-1c3353510cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:08.988794 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb032f6-6316-4271-8748-1c3353510cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:08.998082 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb032f6-6316-4271-8748-1c3353510cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:08.999514 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb032f6-6316-4271-8748-1c3353510cd7 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:09.009017 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1419/2828] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:07:09.765755 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe4801-a5d0-48c7-b963-634ed6804c3b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:09.766165 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe4801-a5d0-48c7-b963-634ed6804c3b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:09.766456 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe4801-a5d0-48c7-b963-634ed6804c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:09.794953 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a1fe4801-a5d0-48c7-b963-634ed6804c3b None None] MFA Rules not processed for user `a7d34b23e862400bbf082a0578708a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:09.796274 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a1fe4801-a5d0-48c7-b963-634ed6804c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:09.879512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1410/2829] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:07:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:07:09.887357 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb032f6-6316-4271-8748-1c3353510cd7 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:09.889097 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4cb032f6-6316-4271-8748-1c3353510cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:09.912181 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:09.960588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb032f6-6316-4271-8748-1c3353510cd7 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:09.965657 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215df9f-1b97-4e22-a5d4-1ed6c53bd061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:09.966313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215df9f-1b97-4e22-a5d4-1ed6c53bd061 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:09.966597 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215df9f-1b97-4e22-a5d4-1ed6c53bd061 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:09.966874 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215df9f-1b97-4e22-a5d4-1ed6c53bd061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:09.976626 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215df9f-1b97-4e22-a5d4-1ed6c53bd061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:09.978655 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215df9f-1b97-4e22-a5d4-1ed6c53bd061 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:09.988886 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1420/2830] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:07:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:07:11.378518 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f825-6e02-475e-8af5-e2a56467e338 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:11.379012 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f825-6e02-475e-8af5-e2a56467e338 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:11.379132 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f825-6e02-475e-8af5-e2a56467e338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:11.398185 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-68a1f825-6e02-475e-8af5-e2a56467e338 None None] MFA Rules not processed for user `a7d34b23e862400bbf082a0578708a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:11.399391 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-68a1f825-6e02-475e-8af5-e2a56467e338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:11.406883 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1411/2831] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:07:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:07:11.643688 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215df9f-1b97-4e22-a5d4-1ed6c53bd061 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:11.653673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215df9f-1b97-4e22-a5d4-1ed6c53bd061 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:11.657205 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c4982-22b1-436e-8807-3089b2f6efe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:11.657801 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c4982-22b1-436e-8807-3089b2f6efe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:11.658080 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c4982-22b1-436e-8807-3089b2f6efe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:11.658349 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c4982-22b1-436e-8807-3089b2f6efe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:11.660100 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-942c4982-22b1-436e-8807-3089b2f6efe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:11.670616 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c4982-22b1-436e-8807-3089b2f6efe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:11.672160 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c4982-22b1-436e-8807-3089b2f6efe5 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:11.680078 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1421/2832] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:07:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:07:20.966116 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f825-6e02-475e-8af5-e2a56467e338 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:20.967542 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-68a1f825-6e02-475e-8af5-e2a56467e338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:20.979666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f825-6e02-475e-8af5-e2a56467e338 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:20.983237 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912a73c-1d5d-42cd-a145-ef60f5382605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:20.983846 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912a73c-1d5d-42cd-a145-ef60f5382605 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:20.984147 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912a73c-1d5d-42cd-a145-ef60f5382605 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:20.984441 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912a73c-1d5d-42cd-a145-ef60f5382605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:20.986137 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2912a73c-1d5d-42cd-a145-ef60f5382605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:21.031775 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:21.049798 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912a73c-1d5d-42cd-a145-ef60f5382605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:21.051231 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912a73c-1d5d-42cd-a145-ef60f5382605 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:21.061519 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1412/2833] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:07:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:07:21.676591 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=25 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:29.786586 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048553e-66ce-4475-ae0e-da173ff510b4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:29.787268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048553e-66ce-4475-ae0e-da173ff510b4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:29.787268 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048553e-66ce-4475-ae0e-da173ff510b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:29.806625 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d048553e-66ce-4475-ae0e-da173ff510b4 None None] MFA Rules not processed for user `a7d34b23e862400bbf082a0578708a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:29.807848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d048553e-66ce-4475-ae0e-da173ff510b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:29.814740 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1422/2834] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:07:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:07:30.833170 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912a73c-1d5d-42cd-a145-ef60f5382605 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:30.834665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2912a73c-1d5d-42cd-a145-ef60f5382605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:30.905455 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912a73c-1d5d-42cd-a145-ef60f5382605 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:30.910379 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc5938-7920-472e-9b2c-03746f4cf1e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:30.910992 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc5938-7920-472e-9b2c-03746f4cf1e3 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:30.911272 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc5938-7920-472e-9b2c-03746f4cf1e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:30.911545 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc5938-7920-472e-9b2c-03746f4cf1e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:30.913292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-81dc5938-7920-472e-9b2c-03746f4cf1e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:30.924633 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc5938-7920-472e-9b2c-03746f4cf1e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:30.926194 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc5938-7920-472e-9b2c-03746f4cf1e3 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:30.936088 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1413/2835] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:07:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:07:39.800569 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:40.932413 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=40 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:53.129555 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378276-fd24-4edb-a2b7-772b30422399 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:53.130086 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378276-fd24-4edb-a2b7-772b30422399 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:53.130204 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378276-fd24-4edb-a2b7-772b30422399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:53.149633 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d6378276-fd24-4edb-a2b7-772b30422399 None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:53.150840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d6378276-fd24-4edb-a2b7-772b30422399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:53.207498 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1423/2836] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 09:07:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:07:53.247752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc5938-7920-472e-9b2c-03746f4cf1e3 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:53.249228 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-81dc5938-7920-472e-9b2c-03746f4cf1e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:53.318568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc5938-7920-472e-9b2c-03746f4cf1e3 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:53.324332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0810b57-c914-4265-9861-99103ed3ec2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:53.324963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0810b57-c914-4265-9861-99103ed3ec2a service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:53.325270 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0810b57-c914-4265-9861-99103ed3ec2a service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:53.325522 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0810b57-c914-4265-9861-99103ed3ec2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:53.334026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0810b57-c914-4265-9861-99103ed3ec2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:53.335615 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0810b57-c914-4265-9861-99103ed3ec2a service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:53.344341 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1414/2837] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 09:07:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:08:03.200584 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=25 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:03.341230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=32 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:08.781994 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c61fe-45d9-48ca-9ccd-4cd89483cebc None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:08.782530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c61fe-45d9-48ca-9ccd-4cd89483cebc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:08.782530 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c61fe-45d9-48ca-9ccd-4cd89483cebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:08.803138 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f58c61fe-45d9-48ca-9ccd-4cd89483cebc None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:08.804371 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f58c61fe-45d9-48ca-9ccd-4cd89483cebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:08.812882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1424/2838] 10.222.0.17 () {58 vars in 967 bytes} [Tue Aug 2 09:08:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:08.827145 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0810b57-c914-4265-9861-99103ed3ec2a service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:08.837704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0810b57-c914-4265-9861-99103ed3ec2a service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:08.842768 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac26e3-43b8-4e98-b868-8b58f1ad6fda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:08.843378 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac26e3-43b8-4e98-b868-8b58f1ad6fda service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:08.843664 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac26e3-43b8-4e98-b868-8b58f1ad6fda service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:08.843941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac26e3-43b8-4e98-b868-8b58f1ad6fda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:08.851893 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac26e3-43b8-4e98-b868-8b58f1ad6fda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:08.853507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac26e3-43b8-4e98-b868-8b58f1ad6fda service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:08.862032 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1415/2839] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 09:08:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:08:10.771820 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c61fe-45d9-48ca-9ccd-4cd89483cebc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:10.783931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c61fe-45d9-48ca-9ccd-4cd89483cebc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:10.788689 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf0e3d-7aa9-44eb-8ae9-acba69cbf451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:10.789333 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0e3d-7aa9-44eb-8ae9-acba69cbf451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:10.789616 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0e3d-7aa9-44eb-8ae9-acba69cbf451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:10.789895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0e3d-7aa9-44eb-8ae9-acba69cbf451 admin admin] PATH_INFO: `/v3/users/a7d34b23e862400bbf082a0578708a4b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:10.791057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf0e3d-7aa9-44eb-8ae9-acba69cbf451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d34b23e862400bbf082a0578708a4b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:10.793877 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf0e3d-7aa9-44eb-8ae9-acba69cbf451 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:10.841618 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-afaf0e3d-7aa9-44eb-8ae9-acba69cbf451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d34b23e862400bbf082a0578708a4b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:10.842261 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-afaf0e3d-7aa9-44eb-8ae9-acba69cbf451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d34b23e862400bbf082a0578708a4b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:10.849420 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-afaf0e3d-7aa9-44eb-8ae9-acba69cbf451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d34b23e862400bbf082a0578708a4b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:10.862021 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-afaf0e3d-7aa9-44eb-8ae9-acba69cbf451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d34b23e862400bbf082a0578708a4b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:10.868887 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-afaf0e3d-7aa9-44eb-8ae9-acba69cbf451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d34b23e862400bbf082a0578708a4b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:10.874876 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1425/2840] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:08:10 2022] DELETE /identity/v3/users/a7d34b23e862400bbf082a0578708a4b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:08:11.049568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac26e3-43b8-4e98-b868-8b58f1ad6fda service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:11.060150 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac26e3-43b8-4e98-b868-8b58f1ad6fda service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:11.116308 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c983f2-8bc5-43b4-98ad-584465a97d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:11.116941 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c983f2-8bc5-43b4-98ad-584465a97d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:11.117220 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c983f2-8bc5-43b4-98ad-584465a97d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:11.117520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c983f2-8bc5-43b4-98ad-584465a97d62 admin admin] PATH_INFO: `/v3/projects/79cf9558cd344c639e5f1a2051364659` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:11.118758 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c983f2-8bc5-43b4-98ad-584465a97d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79cf9558cd344c639e5f1a2051364659)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:11.120834 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c983f2-8bc5-43b4-98ad-584465a97d62 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:11.167932 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-94c983f2-8bc5-43b4-98ad-584465a97d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79cf9558cd344c639e5f1a2051364659', 'request_id': 'req-94c983f2-8bc5-43b4-98ad-584465a97d62'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:11.173389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-94c983f2-8bc5-43b4-98ad-584465a97d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79cf9558cd344c639e5f1a2051364659', 'request_id': 'req-94c983f2-8bc5-43b4-98ad-584465a97d62'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:11.179377 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-94c983f2-8bc5-43b4-98ad-584465a97d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79cf9558cd344c639e5f1a2051364659', 'request_id': 'req-94c983f2-8bc5-43b4-98ad-584465a97d62'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:11.191365 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-94c983f2-8bc5-43b4-98ad-584465a97d62 admin admin] The token cache is being invalidate because project 79cf9558cd344c639e5f1a2051364659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:08:11.191650 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-94c983f2-8bc5-43b4-98ad-584465a97d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:11.192288 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-94c983f2-8bc5-43b4-98ad-584465a97d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:11.193778 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1416/2841] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:08:11 2022] DELETE /identity/v3/projects/79cf9558cd344c639e5f1a2051364659 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:08:11.199526 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2237f1-b58d-4ce2-a5ca-0f6580b3daee None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:11.199822 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2237f1-b58d-4ce2-a5ca-0f6580b3daee None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:11.200105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2237f1-b58d-4ce2-a5ca-0f6580b3daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:11.220387 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8b2237f1-b58d-4ce2-a5ca-0f6580b3daee None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:11.221615 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8b2237f1-b58d-4ce2-a5ca-0f6580b3daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:11.279628 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1426/2842] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:11.287158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1ce39-b38c-4e04-b6f8-b5d85e9b2963 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:11.287445 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1ce39-b38c-4e04-b6f8-b5d85e9b2963 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:11.287722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1ce39-b38c-4e04-b6f8-b5d85e9b2963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:11.306967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-94d1ce39-b38c-4e04-b6f8-b5d85e9b2963 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:11.308175 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-94d1ce39-b38c-4e04-b6f8-b5d85e9b2963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:11.316265 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1417/2843] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:11.320427 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2237f1-b58d-4ce2-a5ca-0f6580b3daee None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:11.330916 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2237f1-b58d-4ce2-a5ca-0f6580b3daee None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:11.335428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b0d3b-44b1-44f3-bb3d-04c25cb00d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:11.336030 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b0d3b-44b1-44f3-bb3d-04c25cb00d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:11.336353 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b0d3b-44b1-44f3-bb3d-04c25cb00d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:11.336627 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b0d3b-44b1-44f3-bb3d-04c25cb00d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:11.337313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b0d3b-44b1-44f3-bb3d-04c25cb00d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:08:11.337617 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b0d3b-44b1-44f3-bb3d-04c25cb00d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:11.339776 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b0d3b-44b1-44f3-bb3d-04c25cb00d06 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:11.351074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1427/2844] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:08:11.355171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1ce39-b38c-4e04-b6f8-b5d85e9b2963 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:11.364244 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1ce39-b38c-4e04-b6f8-b5d85e9b2963 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:11.368866 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e81257-3fab-4cf3-a925-abfa28d42feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:11.369458 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e81257-3fab-4cf3-a925-abfa28d42feb admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:11.369860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e81257-3fab-4cf3-a925-abfa28d42feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:11.370166 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e81257-3fab-4cf3-a925-abfa28d42feb admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:11.370812 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e81257-3fab-4cf3-a925-abfa28d42feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:11.372758 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e81257-3fab-4cf3-a925-abfa28d42feb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:11.400343 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1418/2845] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:08:11 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:08:11.404993 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b0d3b-44b1-44f3-bb3d-04c25cb00d06 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:11.415176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b0d3b-44b1-44f3-bb3d-04c25cb00d06 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:11.462846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:11.472944 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434334e1-3dfb-4a59-8bd2-cf846da4bf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:11.473579 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434334e1-3dfb-4a59-8bd2-cf846da4bf4c admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:11.473860 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434334e1-3dfb-4a59-8bd2-cf846da4bf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:11.474136 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434334e1-3dfb-4a59-8bd2-cf846da4bf4c admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:11.474796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434334e1-3dfb-4a59-8bd2-cf846da4bf4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:11.476759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434334e1-3dfb-4a59-8bd2-cf846da4bf4c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:11.497695 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1428/2846] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:08:11 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:08:11.501838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e81257-3fab-4cf3-a925-abfa28d42feb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:11.512754 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e81257-3fab-4cf3-a925-abfa28d42feb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:11.517671 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6072c-0d77-4966-bce9-a683d4980dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:11.518302 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6072c-0d77-4966-bce9-a683d4980dee admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:11.518568 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6072c-0d77-4966-bce9-a683d4980dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:11.518847 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6072c-0d77-4966-bce9-a683d4980dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:11.519538 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6072c-0d77-4966-bce9-a683d4980dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:11.521211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6072c-0d77-4966-bce9-a683d4980dee admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:11.531438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1419/2847] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:08:11.535314 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434334e1-3dfb-4a59-8bd2-cf846da4bf4c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:11.545436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434334e1-3dfb-4a59-8bd2-cf846da4bf4c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:11.550141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f6ffd-55cd-4d9a-bae4-f334199c5127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:11.550743 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f6ffd-55cd-4d9a-bae4-f334199c5127 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:11.551028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f6ffd-55cd-4d9a-bae4-f334199c5127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:11.551305 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f6ffd-55cd-4d9a-bae4-f334199c5127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:11.552036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f6ffd-55cd-4d9a-bae4-f334199c5127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:11.553651 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f6ffd-55cd-4d9a-bae4-f334199c5127 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:11.565970 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1429/2848] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:08:11.569936 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6072c-0d77-4966-bce9-a683d4980dee admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:11.580595 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6072c-0d77-4966-bce9-a683d4980dee admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:11.585158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc78080-250b-4192-9b62-baa43bf377ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:11.585808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc78080-250b-4192-9b62-baa43bf377ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:11.586086 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc78080-250b-4192-9b62-baa43bf377ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:11.586360 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc78080-250b-4192-9b62-baa43bf377ba admin admin] PATH_INFO: `/v3/projects/d8583522c5954b47a0734cf19639657f/users/bcb2c1df40474e69abd3aa4fc3e566bc/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:11.600782 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc78080-250b-4192-9b62-baa43bf377ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8583522c5954b47a0734cf19639657f, user_id=bcb2c1df40474e69abd3aa4fc3e566bc, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:11.603405 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc78080-250b-4192-9b62-baa43bf377ba admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:11.616520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1420/2849] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:08:11 2022] PUT /identity/v3/projects/d8583522c5954b47a0734cf19639657f/users/bcb2c1df40474e69abd3aa4fc3e566bc/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:08:11.627771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3367e-ee8a-4cb6-995c-b223fd54cb82 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:11.628103 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3367e-ee8a-4cb6-995c-b223fd54cb82 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:11.628407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3367e-ee8a-4cb6-995c-b223fd54cb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:11.655680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-59b3367e-ee8a-4cb6-995c-b223fd54cb82 None None] MFA Rules not processed for user `bcb2c1df40474e69abd3aa4fc3e566bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:11.656917 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-59b3367e-ee8a-4cb6-995c-b223fd54cb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:11.719913 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1430/2850] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:08:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:11.731336 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc78080-250b-4192-9b62-baa43bf377ba admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:11.733130 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8dc78080-250b-4192-9b62-baa43bf377ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:11.747917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:11.791100 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc78080-250b-4192-9b62-baa43bf377ba admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:11.795248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ca2f2-3c6d-44fc-852d-7e591b5d1f17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b08a946b43f08028c5da415d4e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:11.795865 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ca2f2-3c6d-44fc-852d-7e591b5d1f17 service glance] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:11.796182 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ca2f2-3c6d-44fc-852d-7e591b5d1f17 service glance] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:11.796462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ca2f2-3c6d-44fc-852d-7e591b5d1f17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:11.805559 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ca2f2-3c6d-44fc-852d-7e591b5d1f17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:11.806743 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ca2f2-3c6d-44fc-852d-7e591b5d1f17 service glance] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:11.816298 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1421/2851] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:08:21.716940 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:21.812431 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=20 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:50.746292 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3367e-ee8a-4cb6-995c-b223fd54cb82 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:50.748419 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-59b3367e-ee8a-4cb6-995c-b223fd54cb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:50.848573 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3367e-ee8a-4cb6-995c-b223fd54cb82 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:50.852787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53798e3-f47e-448d-aad7-804cd7a6cdad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:50.853448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53798e3-f47e-448d-aad7-804cd7a6cdad service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:50.853724 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53798e3-f47e-448d-aad7-804cd7a6cdad service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:50.853990 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53798e3-f47e-448d-aad7-804cd7a6cdad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:50.855911 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b53798e3-f47e-448d-aad7-804cd7a6cdad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:50.954919 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53798e3-f47e-448d-aad7-804cd7a6cdad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:50.956358 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53798e3-f47e-448d-aad7-804cd7a6cdad service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:50.970174 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1431/2852] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:08:52.202843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ca2f2-3c6d-44fc-852d-7e591b5d1f17 service glance] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:52.204476 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ff2ca2f2-3c6d-44fc-852d-7e591b5d1f17 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:52.218014 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ca2f2-3c6d-44fc-852d-7e591b5d1f17 service glance] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:52.222570 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97875d24-701f-4277-a4a3-f10ed7431049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:52.223326 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97875d24-701f-4277-a4a3-f10ed7431049 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:52.223724 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97875d24-701f-4277-a4a3-f10ed7431049 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:52.224206 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97875d24-701f-4277-a4a3-f10ed7431049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:52.226298 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-97875d24-701f-4277-a4a3-f10ed7431049 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:52.243178 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97875d24-701f-4277-a4a3-f10ed7431049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:52.245710 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97875d24-701f-4277-a4a3-f10ed7431049 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:52.258905 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1422/2853] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:08:57.532330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb60642-8a6b-451d-9cf7-1297a7818911 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:57.532330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb60642-8a6b-451d-9cf7-1297a7818911 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:57.532330 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb60642-8a6b-451d-9cf7-1297a7818911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:57.571792 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5eb60642-8a6b-451d-9cf7-1297a7818911 None None] MFA Rules not processed for user `e469194b140942bf929001c7e12a0933`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:57.573781 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5eb60642-8a6b-451d-9cf7-1297a7818911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:57.652784 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1432/2854] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:08:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:58.614192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97875d24-701f-4277-a4a3-f10ed7431049 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:58.747843 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97875d24-701f-4277-a4a3-f10ed7431049 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:58.755382 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:58.755869 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:58.756204 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:58.756531 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] PATH_INFO: `/v3/users/bcb2c1df40474e69abd3aa4fc3e566bc` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:58.757764 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb2c1df40474e69abd3aa4fc3e566bc)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:58.760101 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:58.843868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb2c1df40474e69abd3aa4fc3e566bc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:58.844603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb2c1df40474e69abd3aa4fc3e566bc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:58.860292 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb2c1df40474e69abd3aa4fc3e566bc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:58.871608 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb2c1df40474e69abd3aa4fc3e566bc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:58.884931 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb2c1df40474e69abd3aa4fc3e566bc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:58.894525 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1423/2855] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:08:58 2022] DELETE /identity/v3/users/bcb2c1df40474e69abd3aa4fc3e566bc => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:08:58.899109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a158f-0c91-4bd8-a1cc-f66d412c640e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:58.900332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a158f-0c91-4bd8-a1cc-f66d412c640e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:58.900332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a158f-0c91-4bd8-a1cc-f66d412c640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:58.927883 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-aa2a158f-0c91-4bd8-a1cc-f66d412c640e None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:58.930188 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-aa2a158f-0c91-4bd8-a1cc-f66d412c640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:59.004915 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:59.025503 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1433/2856] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:59.036484 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:59.038646 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:59.119911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2dd3-e408-4460-8558-0f2291f3ce56 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:59.124725 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8cc17-884a-4911-8424-a9f39e9ccf60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:59.125399 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8cc17-884a-4911-8424-a9f39e9ccf60 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:59.125683 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8cc17-884a-4911-8424-a9f39e9ccf60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:59.125983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8cc17-884a-4911-8424-a9f39e9ccf60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:59.137105 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8cc17-884a-4911-8424-a9f39e9ccf60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:59.138909 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8cc17-884a-4911-8424-a9f39e9ccf60 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:59.150585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1424/2857] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:08:59.577147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a158f-0c91-4bd8-a1cc-f66d412c640e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:59.578879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-aa2a158f-0c91-4bd8-a1cc-f66d412c640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:59.595738 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a158f-0c91-4bd8-a1cc-f66d412c640e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:59.601269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df656903-cf56-4095-b965-872e69c4cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:59.602040 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df656903-cf56-4095-b965-872e69c4cf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:59.602317 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df656903-cf56-4095-b965-872e69c4cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:59.602594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df656903-cf56-4095-b965-872e69c4cf0c admin admin] PATH_INFO: `/v3/projects/d8583522c5954b47a0734cf19639657f` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:59.603849 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df656903-cf56-4095-b965-872e69c4cf0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8583522c5954b47a0734cf19639657f)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:59.605846 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df656903-cf56-4095-b965-872e69c4cf0c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:59.666121 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-df656903-cf56-4095-b965-872e69c4cf0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8583522c5954b47a0734cf19639657f', 'request_id': 'req-df656903-cf56-4095-b965-872e69c4cf0c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:59.674828 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-df656903-cf56-4095-b965-872e69c4cf0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8583522c5954b47a0734cf19639657f', 'request_id': 'req-df656903-cf56-4095-b965-872e69c4cf0c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:59.684965 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-df656903-cf56-4095-b965-872e69c4cf0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8583522c5954b47a0734cf19639657f', 'request_id': 'req-df656903-cf56-4095-b965-872e69c4cf0c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:59.701058 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-df656903-cf56-4095-b965-872e69c4cf0c admin admin] The token cache is being invalidate because project d8583522c5954b47a0734cf19639657f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:08:59.701407 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-df656903-cf56-4095-b965-872e69c4cf0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:59.702532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-df656903-cf56-4095-b965-872e69c4cf0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:08:59.704172 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1434/2858] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:08:59 2022] DELETE /identity/v3/projects/d8583522c5954b47a0734cf19639657f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:08:59.709136 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e3b30-56e1-404c-bdcf-2db8b6648cf1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:59.709665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e3b30-56e1-404c-bdcf-2db8b6648cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:59.709665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e3b30-56e1-404c-bdcf-2db8b6648cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:59.732716 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-de1e3b30-56e1-404c-bdcf-2db8b6648cf1 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:59.733998 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-de1e3b30-56e1-404c-bdcf-2db8b6648cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:59.738696 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:59.821994 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1425/2859] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:59.829538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684152b-c793-495c-98bc-ad5a043089bd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:59.829824 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684152b-c793-495c-98bc-ad5a043089bd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:59.830112 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684152b-c793-495c-98bc-ad5a043089bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:59.862251 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7684152b-c793-495c-98bc-ad5a043089bd None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:59.863519 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7684152b-c793-495c-98bc-ad5a043089bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:59.876063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1435/2860] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:08:59.880186 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e3b30-56e1-404c-bdcf-2db8b6648cf1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:59.895188 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e3b30-56e1-404c-bdcf-2db8b6648cf1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:59.908896 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d19664-402e-4000-919b-f1eaa2f01795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:59.910316 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d19664-402e-4000-919b-f1eaa2f01795 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:59.910765 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d19664-402e-4000-919b-f1eaa2f01795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:59.911613 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d19664-402e-4000-919b-f1eaa2f01795 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:59.913315 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d19664-402e-4000-919b-f1eaa2f01795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:08:59.913739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d19664-402e-4000-919b-f1eaa2f01795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:59.915600 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d19664-402e-4000-919b-f1eaa2f01795 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:59.932917 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1426/2861] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:08:59.938266 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684152b-c793-495c-98bc-ad5a043089bd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:59.949013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684152b-c793-495c-98bc-ad5a043089bd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:59.954568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb68de-ee11-4137-a7e5-50481a2a1123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:59.955215 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb68de-ee11-4137-a7e5-50481a2a1123 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:59.956643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb68de-ee11-4137-a7e5-50481a2a1123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:59.957025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb68de-ee11-4137-a7e5-50481a2a1123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:59.958444 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb68de-ee11-4137-a7e5-50481a2a1123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:59.960818 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb68de-ee11-4137-a7e5-50481a2a1123 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:00.002024 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1436/2862] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:08:59 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:09:00.006159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d19664-402e-4000-919b-f1eaa2f01795 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:00.030801 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d19664-402e-4000-919b-f1eaa2f01795 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:00.163464 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a61c0-ed55-4c45-9368-cf567ef978f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:00.164632 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a61c0-ed55-4c45-9368-cf567ef978f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:00.165042 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a61c0-ed55-4c45-9368-cf567ef978f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:00.165337 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a61c0-ed55-4c45-9368-cf567ef978f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:00.166053 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a61c0-ed55-4c45-9368-cf567ef978f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:00.168267 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a61c0-ed55-4c45-9368-cf567ef978f1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:00.199507 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1427/2863] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:09:00 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:09:00.202939 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb68de-ee11-4137-a7e5-50481a2a1123 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:00.215874 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb68de-ee11-4137-a7e5-50481a2a1123 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:00.234701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942b27c-c42d-4e56-b5e9-a7a99d84d949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:00.235394 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b27c-c42d-4e56-b5e9-a7a99d84d949 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:00.235882 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b27c-c42d-4e56-b5e9-a7a99d84d949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:00.236426 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b27c-c42d-4e56-b5e9-a7a99d84d949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:00.237428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942b27c-c42d-4e56-b5e9-a7a99d84d949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:00.239253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942b27c-c42d-4e56-b5e9-a7a99d84d949 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:00.251274 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1437/2864] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:09:00.257114 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a61c0-ed55-4c45-9368-cf567ef978f1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:00.268485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a61c0-ed55-4c45-9368-cf567ef978f1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:00.273942 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f96bb-51ce-4e9e-aaf1-0790f89b4098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:00.274781 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f96bb-51ce-4e9e-aaf1-0790f89b4098 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:00.275135 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f96bb-51ce-4e9e-aaf1-0790f89b4098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:00.275485 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f96bb-51ce-4e9e-aaf1-0790f89b4098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:00.276342 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f96bb-51ce-4e9e-aaf1-0790f89b4098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:00.278159 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f96bb-51ce-4e9e-aaf1-0790f89b4098 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:00.292103 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1428/2865] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:09:00.298532 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942b27c-c42d-4e56-b5e9-a7a99d84d949 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:00.315804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942b27c-c42d-4e56-b5e9-a7a99d84d949 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:00.324785 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0283e-7b76-40b1-896d-d74319d19b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:00.325912 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0283e-7b76-40b1-896d-d74319d19b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:00.326373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0283e-7b76-40b1-896d-d74319d19b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:00.326838 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0283e-7b76-40b1-896d-d74319d19b24 admin admin] PATH_INFO: `/v3/projects/33e3f6cd89654c4ea4dd3fe3d969334d/users/a28ea167c4ad4ad3b3545b33c1605c3b/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:00.348374 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0283e-7b76-40b1-896d-d74319d19b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e3f6cd89654c4ea4dd3fe3d969334d, user_id=a28ea167c4ad4ad3b3545b33c1605c3b, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:00.351413 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0283e-7b76-40b1-896d-d74319d19b24 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:00.375066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1438/2866] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:09:00 2022] PUT /identity/v3/projects/33e3f6cd89654c4ea4dd3fe3d969334d/users/a28ea167c4ad4ad3b3545b33c1605c3b/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:09:00.387288 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c841b-0e30-4041-a90b-9cc1f59b679c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:00.387721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c841b-0e30-4041-a90b-9cc1f59b679c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:00.388148 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c841b-0e30-4041-a90b-9cc1f59b679c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:00.423298 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3c6c841b-0e30-4041-a90b-9cc1f59b679c None None] MFA Rules not processed for user `a28ea167c4ad4ad3b3545b33c1605c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:09:00.424603 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3c6c841b-0e30-4041-a90b-9cc1f59b679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:00.501084 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1429/2867] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:09:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:09:00.513329 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0283e-7b76-40b1-896d-d74319d19b24 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:00.515595 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1db0283e-7b76-40b1-896d-d74319d19b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:00.579840 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0283e-7b76-40b1-896d-d74319d19b24 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:00.584937 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54af778-f35e-462a-8e24-48103a59ed58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b08a946b43f08028c5da415d4e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:00.585680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54af778-f35e-462a-8e24-48103a59ed58 service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:00.585930 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54af778-f35e-462a-8e24-48103a59ed58 service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:00.586214 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54af778-f35e-462a-8e24-48103a59ed58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:00.597703 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54af778-f35e-462a-8e24-48103a59ed58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:00.599448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54af778-f35e-462a-8e24-48103a59ed58 service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:00.609518 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1439/2868] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:09:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:09:01.292838 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c841b-0e30-4041-a90b-9cc1f59b679c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:01.295026 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3c6c841b-0e30-4041-a90b-9cc1f59b679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:01.302922 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:01.395637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c841b-0e30-4041-a90b-9cc1f59b679c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:01.399966 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57075a9c-e0be-4aed-b64f-d7b484b5c6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:01.400880 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57075a9c-e0be-4aed-b64f-d7b484b5c6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:01.401144 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57075a9c-e0be-4aed-b64f-d7b484b5c6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:01.401430 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57075a9c-e0be-4aed-b64f-d7b484b5c6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:01.404040 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-57075a9c-e0be-4aed-b64f-d7b484b5c6f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:01.416663 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57075a9c-e0be-4aed-b64f-d7b484b5c6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:01.418369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57075a9c-e0be-4aed-b64f-d7b484b5c6f2 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:01.428947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1430/2869] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:09:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:09:10.605025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:11.424749 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=24 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:37.021737 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54af778-f35e-462a-8e24-48103a59ed58 service glance] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:37.086332 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54af778-f35e-462a-8e24-48103a59ed58 service glance] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:37.090851 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:37.091504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:37.091796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:37.092075 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] PATH_INFO: `/v3/users/a28ea167c4ad4ad3b3545b33c1605c3b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:37.093289 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a28ea167c4ad4ad3b3545b33c1605c3b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:37.095227 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:37.151760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a28ea167c4ad4ad3b3545b33c1605c3b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:09:37.152442 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a28ea167c4ad4ad3b3545b33c1605c3b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:09:37.161298 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a28ea167c4ad4ad3b3545b33c1605c3b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:09:37.173717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a28ea167c4ad4ad3b3545b33c1605c3b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:09:37.181717 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a28ea167c4ad4ad3b3545b33c1605c3b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:09:37.187791 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1440/2870] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:09:37 2022] DELETE /identity/v3/users/a28ea167c4ad4ad3b3545b33c1605c3b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:09:37.192440 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448f1b0-14d1-4f8e-8e51-91080c60fadf None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:37.194368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448f1b0-14d1-4f8e-8e51-91080c60fadf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:37.194368 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448f1b0-14d1-4f8e-8e51-91080c60fadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:37.213013 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4448f1b0-14d1-4f8e-8e51-91080c60fadf None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:09:37.214389 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4448f1b0-14d1-4f8e-8e51-91080c60fadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:37.274735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1431/2871] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:09:37.284616 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:37.286111 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:37.344499 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10c2ca-e1f1-47cc-bb98-571d19e3cc82 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:37.348079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd9e7f-85ae-449f-892e-a3d3bc482095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:37.348826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd9e7f-85ae-449f-892e-a3d3bc482095 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:37.349604 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd9e7f-85ae-449f-892e-a3d3bc482095 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:37.349879 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd9e7f-85ae-449f-892e-a3d3bc482095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:37.359538 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd9e7f-85ae-449f-892e-a3d3bc482095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:37.361029 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd9e7f-85ae-449f-892e-a3d3bc482095 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:37.371454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1441/2872] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:09:37.919167 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448f1b0-14d1-4f8e-8e51-91080c60fadf None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:37.920845 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4448f1b0-14d1-4f8e-8e51-91080c60fadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:37.934868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448f1b0-14d1-4f8e-8e51-91080c60fadf None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:37.939862 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3f760-b0db-402d-aead-34c2c542fa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:37.940649 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3f760-b0db-402d-aead-34c2c542fa70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:37.940967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3f760-b0db-402d-aead-34c2c542fa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:37.941392 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3f760-b0db-402d-aead-34c2c542fa70 admin admin] PATH_INFO: `/v3/projects/33e3f6cd89654c4ea4dd3fe3d969334d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:37.942659 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3f760-b0db-402d-aead-34c2c542fa70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e3f6cd89654c4ea4dd3fe3d969334d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:37.945247 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3f760-b0db-402d-aead-34c2c542fa70 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:38.003695 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-50f3f760-b0db-402d-aead-34c2c542fa70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e3f6cd89654c4ea4dd3fe3d969334d', 'request_id': 'req-50f3f760-b0db-402d-aead-34c2c542fa70'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:09:38.009947 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-50f3f760-b0db-402d-aead-34c2c542fa70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e3f6cd89654c4ea4dd3fe3d969334d', 'request_id': 'req-50f3f760-b0db-402d-aead-34c2c542fa70'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:09:38.016300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-50f3f760-b0db-402d-aead-34c2c542fa70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e3f6cd89654c4ea4dd3fe3d969334d', 'request_id': 'req-50f3f760-b0db-402d-aead-34c2c542fa70'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:09:38.036356 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-50f3f760-b0db-402d-aead-34c2c542fa70 admin admin] The token cache is being invalidate because project 33e3f6cd89654c4ea4dd3fe3d969334d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:09:38.036654 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-50f3f760-b0db-402d-aead-34c2c542fa70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:09:38.037284 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-50f3f760-b0db-402d-aead-34c2c542fa70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:09:38.038808 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1432/2873] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:09:37 2022] DELETE /identity/v3/projects/33e3f6cd89654c4ea4dd3fe3d969334d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:09:38.043895 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d9486-6226-4a0f-b8dc-a04f6217d3f2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:38.044447 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d9486-6226-4a0f-b8dc-a04f6217d3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:38.044571 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d9486-6226-4a0f-b8dc-a04f6217d3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:38.064841 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a16d9486-6226-4a0f-b8dc-a04f6217d3f2 None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:09:38.066072 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a16d9486-6226-4a0f-b8dc-a04f6217d3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:38.084896 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:38.134129 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1442/2874] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:09:38.141999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af7232-4d5f-4df3-bee0-2c40f982543b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:38.142316 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af7232-4d5f-4df3-bee0-2c40f982543b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:38.142597 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af7232-4d5f-4df3-bee0-2c40f982543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:38.164534 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c2af7232-4d5f-4df3-bee0-2c40f982543b None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:09:38.165863 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c2af7232-4d5f-4df3-bee0-2c40f982543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:38.173999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1433/2875] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:09:38.179043 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d9486-6226-4a0f-b8dc-a04f6217d3f2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:38.189320 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d9486-6226-4a0f-b8dc-a04f6217d3f2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:38.195939 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f9951-1840-4509-be6d-425c8fdc611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:38.196907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f9951-1840-4509-be6d-425c8fdc611f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:38.197328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f9951-1840-4509-be6d-425c8fdc611f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:38.197759 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f9951-1840-4509-be6d-425c8fdc611f admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:38.198830 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f9951-1840-4509-be6d-425c8fdc611f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:09:38.199291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f9951-1840-4509-be6d-425c8fdc611f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:38.201901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f9951-1840-4509-be6d-425c8fdc611f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:38.219552 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1443/2876] 10.222.0.17 () {58 vars in 1153 bytes} [Tue Aug 2 09:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:09:38.224514 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af7232-4d5f-4df3-bee0-2c40f982543b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:38.233935 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af7232-4d5f-4df3-bee0-2c40f982543b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:38.238911 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536a723-e134-4469-9d0d-585e79f8fff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:38.239533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536a723-e134-4469-9d0d-585e79f8fff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:38.240400 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536a723-e134-4469-9d0d-585e79f8fff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:38.240674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536a723-e134-4469-9d0d-585e79f8fff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:38.241347 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536a723-e134-4469-9d0d-585e79f8fff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:38.243249 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536a723-e134-4469-9d0d-585e79f8fff2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:38.280741 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1434/2877] 10.222.0.17 () {60 vars in 1153 bytes} [Tue Aug 2 09:09:38 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:09:38.285339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f9951-1840-4509-be6d-425c8fdc611f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:38.295908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f9951-1840-4509-be6d-425c8fdc611f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:38.356771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee9d78-6131-45e9-ae3a-c18928f1f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:38.357397 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee9d78-6131-45e9-ae3a-c18928f1f401 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:38.357677 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee9d78-6131-45e9-ae3a-c18928f1f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:38.357952 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee9d78-6131-45e9-ae3a-c18928f1f401 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:38.358624 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee9d78-6131-45e9-ae3a-c18928f1f401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:38.360592 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee9d78-6131-45e9-ae3a-c18928f1f401 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:38.384063 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1444/2878] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Aug 2 09:09:38 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:09:38.388300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536a723-e134-4469-9d0d-585e79f8fff2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:38.399093 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536a723-e134-4469-9d0d-585e79f8fff2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:38.403985 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e88fa-a3e1-4d35-a315-446ee1925d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:38.404641 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e88fa-a3e1-4d35-a315-446ee1925d51 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:38.404924 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e88fa-a3e1-4d35-a315-446ee1925d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:38.405199 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e88fa-a3e1-4d35-a315-446ee1925d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:38.405901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e88fa-a3e1-4d35-a315-446ee1925d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:38.407524 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e88fa-a3e1-4d35-a315-446ee1925d51 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:38.418497 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1435/2879] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:09:38.422560 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee9d78-6131-45e9-ae3a-c18928f1f401 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:38.434129 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee9d78-6131-45e9-ae3a-c18928f1f401 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:38.438893 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3e4db-9195-4f89-bf2a-cdac2f96d2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:38.439515 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3e4db-9195-4f89-bf2a-cdac2f96d2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:38.439802 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3e4db-9195-4f89-bf2a-cdac2f96d2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:38.440081 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3e4db-9195-4f89-bf2a-cdac2f96d2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:38.440817 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3e4db-9195-4f89-bf2a-cdac2f96d2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:38.442430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3e4db-9195-4f89-bf2a-cdac2f96d2f2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:38.454219 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1445/2880] 10.222.0.17 () {58 vars in 1122 bytes} [Tue Aug 2 09:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:09:38.458882 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e88fa-a3e1-4d35-a315-446ee1925d51 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:38.469539 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e88fa-a3e1-4d35-a315-446ee1925d51 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:38.475402 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfa351-2a81-402b-a122-ca4a1a78184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:38.475402 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfa351-2a81-402b-a122-ca4a1a78184d admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:38.475687 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfa351-2a81-402b-a122-ca4a1a78184d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:38.475884 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfa351-2a81-402b-a122-ca4a1a78184d admin admin] PATH_INFO: `/v3/projects/2ed0a70b5f594643ba70d6b7829e3124/users/9de6a21ca5074f1598cd417d80c96feb/roles/ad3a96ed9c2944be914156fa1c4613af` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:38.494087 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfa351-2a81-402b-a122-ca4a1a78184d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed0a70b5f594643ba70d6b7829e3124, user_id=9de6a21ca5074f1598cd417d80c96feb, role_id=ad3a96ed9c2944be914156fa1c4613af)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:38.496860 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfa351-2a81-402b-a122-ca4a1a78184d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:38.510777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1436/2881] 10.222.0.17 () {60 vars in 1483 bytes} [Tue Aug 2 09:09:38 2022] PUT /identity/v3/projects/2ed0a70b5f594643ba70d6b7829e3124/users/9de6a21ca5074f1598cd417d80c96feb/roles/ad3a96ed9c2944be914156fa1c4613af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:09:38.523244 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335cd27-86e8-4909-a9de-1616110b460a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:38.523490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335cd27-86e8-4909-a9de-1616110b460a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:38.523771 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335cd27-86e8-4909-a9de-1616110b460a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:38.553171 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0335cd27-86e8-4909-a9de-1616110b460a None None] MFA Rules not processed for user `9de6a21ca5074f1598cd417d80c96feb`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:09:38.554436 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0335cd27-86e8-4909-a9de-1616110b460a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:38.620175 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1446/2882] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:09:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:09:38.631421 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfa351-2a81-402b-a122-ca4a1a78184d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:38.633229 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-94bfa351-2a81-402b-a122-ca4a1a78184d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:38.657857 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:38.698587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfa351-2a81-402b-a122-ca4a1a78184d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:38.702437 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346d7ca-9591-4c32-90b0-f44f201c8293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:38.703081 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346d7ca-9591-4c32-90b0-f44f201c8293 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:38.703350 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346d7ca-9591-4c32-90b0-f44f201c8293 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:38.703626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346d7ca-9591-4c32-90b0-f44f201c8293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:38.713126 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346d7ca-9591-4c32-90b0-f44f201c8293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:38.714574 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346d7ca-9591-4c32-90b0-f44f201c8293 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:38.724957 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1437/2883] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:09:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:09:40.089374 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec050a-1c4b-476b-b8b8-69b5f77f79b0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:40.089947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec050a-1c4b-476b-b8b8-69b5f77f79b0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:40.089947 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec050a-1c4b-476b-b8b8-69b5f77f79b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:40.109272 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4aec050a-1c4b-476b-b8b8-69b5f77f79b0 None None] MFA Rules not processed for user `9de6a21ca5074f1598cd417d80c96feb`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:09:40.110480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4aec050a-1c4b-476b-b8b8-69b5f77f79b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:40.117429 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1447/2884] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:09:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:09:43.284997 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346d7ca-9591-4c32-90b0-f44f201c8293 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:43.287929 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3346d7ca-9591-4c32-90b0-f44f201c8293 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:43.372932 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346d7ca-9591-4c32-90b0-f44f201c8293 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:43.380462 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceb2fb-25c5-4d7e-88ee-5cfe10d17df3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:43.381097 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceb2fb-25c5-4d7e-88ee-5cfe10d17df3 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:43.381390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceb2fb-25c5-4d7e-88ee-5cfe10d17df3 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:43.381668 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceb2fb-25c5-4d7e-88ee-5cfe10d17df3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:43.383532 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-24ceb2fb-25c5-4d7e-88ee-5cfe10d17df3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:43.396541 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ceb2fb-25c5-4d7e-88ee-5cfe10d17df3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:43.398154 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ceb2fb-25c5-4d7e-88ee-5cfe10d17df3 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:43.409520 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1438/2885] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:09:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:09:50.103911 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:53.404665 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=51 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:55.371362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec050a-1c4b-476b-b8b8-69b5f77f79b0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:55.386504 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec050a-1c4b-476b-b8b8-69b5f77f79b0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:55.392336 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7852ba3-a901-4d01-b6a4-d939bae3e1d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:55.393067 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7852ba3-a901-4d01-b6a4-d939bae3e1d3 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:55.393428 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7852ba3-a901-4d01-b6a4-d939bae3e1d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:55.393778 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7852ba3-a901-4d01-b6a4-d939bae3e1d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:55.396033 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b7852ba3-a901-4d01-b6a4-d939bae3e1d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:55.410787 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7852ba3-a901-4d01-b6a4-d939bae3e1d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:55.412589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7852ba3-a901-4d01-b6a4-d939bae3e1d3 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:55.425036 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1448/2886] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:09:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:09:56.371146 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846e430-d509-4abb-90ee-c7a17b84dc96 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:56.371626 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846e430-d509-4abb-90ee-c7a17b84dc96 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:56.371756 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846e430-d509-4abb-90ee-c7a17b84dc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:56.390424 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6846e430-d509-4abb-90ee-c7a17b84dc96 None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:09:56.391611 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6846e430-d509-4abb-90ee-c7a17b84dc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:56.448457 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1439/2887] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:09:56.495152 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7852ba3-a901-4d01-b6a4-d939bae3e1d3 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:56.496623 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b7852ba3-a901-4d01-b6a4-d939bae3e1d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:56.566903 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7852ba3-a901-4d01-b6a4-d939bae3e1d3 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:56.572234 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b789d-7a60-472b-830d-02f99f4aa90d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:56.572856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b789d-7a60-472b-830d-02f99f4aa90d service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:56.573143 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b789d-7a60-472b-830d-02f99f4aa90d service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:56.573423 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b789d-7a60-472b-830d-02f99f4aa90d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:56.581640 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b789d-7a60-472b-830d-02f99f4aa90d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:56.583253 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b789d-7a60-472b-830d-02f99f4aa90d service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:56.591744 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1449/2888] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 09:09:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:09:57.102039 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf37f3-fb26-4b36-a539-e32ec97a42cf None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:57.102331 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf37f3-fb26-4b36-a539-e32ec97a42cf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:57.102614 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf37f3-fb26-4b36-a539-e32ec97a42cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:57.121533 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9cdf37f3-fb26-4b36-a539-e32ec97a42cf None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:09:57.122730 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9cdf37f3-fb26-4b36-a539-e32ec97a42cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:57.129901 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1440/2889] 10.222.0.17 () {58 vars in 967 bytes} [Tue Aug 2 09:09:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:09:57.142321 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b789d-7a60-472b-830d-02f99f4aa90d service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:57.153328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b789d-7a60-472b-830d-02f99f4aa90d service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:57.158549 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439e25-1c8c-4a69-aa1b-efbc15283fda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:57.159199 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439e25-1c8c-4a69-aa1b-efbc15283fda service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:57.159490 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439e25-1c8c-4a69-aa1b-efbc15283fda service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:57.159762 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439e25-1c8c-4a69-aa1b-efbc15283fda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:57.167774 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46439e25-1c8c-4a69-aa1b-efbc15283fda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:57.169374 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46439e25-1c8c-4a69-aa1b-efbc15283fda service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:57.177542 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1450/2890] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 09:09:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:09:57.395070 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d4120-0921-4c06-933b-a555a8178c87 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:57.395544 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d4120-0921-4c06-933b-a555a8178c87 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:57.395644 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d4120-0921-4c06-933b-a555a8178c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:57.414287 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e45d4120-0921-4c06-933b-a555a8178c87 None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:09:57.415481 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e45d4120-0921-4c06-933b-a555a8178c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:57.422704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1441/2891] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Aug 2 09:09:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:09:57.434701 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439e25-1c8c-4a69-aa1b-efbc15283fda service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:57.446109 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439e25-1c8c-4a69-aa1b-efbc15283fda service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:57.451200 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dbec0-a52d-4504-bddd-07f6668e9d2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:57.451795 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dbec0-a52d-4504-bddd-07f6668e9d2e service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:57.452074 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dbec0-a52d-4504-bddd-07f6668e9d2e service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:57.452378 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dbec0-a52d-4504-bddd-07f6668e9d2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:57.460419 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dbec0-a52d-4504-bddd-07f6668e9d2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:57.461991 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dbec0-a52d-4504-bddd-07f6668e9d2e service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:57.469854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1451/2892] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 09:09:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:09:57.790535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0282e7-496c-460c-9dac-611b853479ae None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:57.790827 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0282e7-496c-460c-9dac-611b853479ae None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:57.791108 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0282e7-496c-460c-9dac-611b853479ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:57.810279 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7b0282e7-496c-460c-9dac-611b853479ae None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:09:57.811488 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7b0282e7-496c-460c-9dac-611b853479ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:09:57.818805 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1442/2893] 10.222.0.17 () {58 vars in 967 bytes} [Tue Aug 2 09:09:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:09:57.831443 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dbec0-a52d-4504-bddd-07f6668e9d2e service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:09:57.842507 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dbec0-a52d-4504-bddd-07f6668e9d2e service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:09:57.847680 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db75037-a8bf-46cc-8eac-7478d9fccd17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:09:57.848471 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75037-a8bf-46cc-8eac-7478d9fccd17 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:09:57.848764 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75037-a8bf-46cc-8eac-7478d9fccd17 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:09:57.849271 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75037-a8bf-46cc-8eac-7478d9fccd17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:09:57.857432 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db75037-a8bf-46cc-8eac-7478d9fccd17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:09:57.858982 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db75037-a8bf-46cc-8eac-7478d9fccd17 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:09:57.866885 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1452/2894] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 09:09:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:00.158686 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0282e7-496c-460c-9dac-611b853479ae None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:00.221270 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0282e7-496c-460c-9dac-611b853479ae None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:00.226408 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:00.227038 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:00.227318 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:00.227592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] PATH_INFO: `/v3/users/9de6a21ca5074f1598cd417d80c96feb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:00.228746 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de6a21ca5074f1598cd417d80c96feb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:00.230678 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:00.279483 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de6a21ca5074f1598cd417d80c96feb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:00.280163 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de6a21ca5074f1598cd417d80c96feb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:00.292576 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de6a21ca5074f1598cd417d80c96feb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:00.300908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de6a21ca5074f1598cd417d80c96feb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:00.308089 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de6a21ca5074f1598cd417d80c96feb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:00.314061 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1443/2895] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:10:00 2022] DELETE /identity/v3/users/9de6a21ca5074f1598cd417d80c96feb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:00.318678 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545906-48b7-4e63-be8d-9aff71938ccb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:00.319178 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545906-48b7-4e63-be8d-9aff71938ccb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:00.319339 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545906-48b7-4e63-be8d-9aff71938ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:00.338512 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b7545906-48b7-4e63-be8d-9aff71938ccb None None] MFA Rules not processed for user `5c37b28fc7d64a6c86abaeae5a87cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:00.339723 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b7545906-48b7-4e63-be8d-9aff71938ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:00.398486 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1453/2896] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:00.407974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:00.409495 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:00.416818 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:00.469816 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295d224-d67c-4506-82c8-429ea25d83fc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:00.473627 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aec3d-95c1-4b3b-839c-e3d7ebc3237b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:00.474248 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aec3d-95c1-4b3b-839c-e3d7ebc3237b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:00.474535 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aec3d-95c1-4b3b-839c-e3d7ebc3237b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:00.474814 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aec3d-95c1-4b3b-839c-e3d7ebc3237b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:00.484721 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2aec3d-95c1-4b3b-839c-e3d7ebc3237b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:00.486172 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2aec3d-95c1-4b3b-839c-e3d7ebc3237b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:00.496077 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1444/2897] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:00.666796 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7545906-48b7-4e63-be8d-9aff71938ccb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:00.668362 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b7545906-48b7-4e63-be8d-9aff71938ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:00.680728 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7545906-48b7-4e63-be8d-9aff71938ccb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:00.685290 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:00.685931 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:00.686213 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:00.686491 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] PATH_INFO: `/v3/projects/2ed0a70b5f594643ba70d6b7829e3124` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:00.687666 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed0a70b5f594643ba70d6b7829e3124)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:00.689631 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:00.726850 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:00.741809 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed0a70b5f594643ba70d6b7829e3124', 'request_id': 'req-68235d07-a86c-434f-815a-a8a514667aa2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:00.747350 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed0a70b5f594643ba70d6b7829e3124', 'request_id': 'req-68235d07-a86c-434f-815a-a8a514667aa2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:00.755419 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed0a70b5f594643ba70d6b7829e3124', 'request_id': 'req-68235d07-a86c-434f-815a-a8a514667aa2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:00.767391 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] The token cache is being invalidate because project 2ed0a70b5f594643ba70d6b7829e3124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:10:00.767709 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:00.768373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:00.769909 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1454/2898] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:10:00 2022] DELETE /identity/v3/projects/2ed0a70b5f594643ba70d6b7829e3124 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:10.491564 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=24 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:10.764247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:27.185335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c8dad-006a-4f37-aa29-4455f1668d2e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:27.185794 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c8dad-006a-4f37-aa29-4455f1668d2e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:27.185921 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c8dad-006a-4f37-aa29-4455f1668d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:27.205948 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2c2c8dad-006a-4f37-aa29-4455f1668d2e None None] MFA Rules not processed for user `ba31cc812281466f90d0c2bfce49d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:27.207139 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2c2c8dad-006a-4f37-aa29-4455f1668d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:27.261335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1445/2899] 10.222.0.17 () {58 vars in 967 bytes} [Tue Aug 2 09:10:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:27.273439 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:27.274854 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:27.343588 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68235d07-a86c-434f-815a-a8a514667aa2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:27.348718 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917de3e-c9e4-427f-8832-6573be931897 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd182c7050f0040559f69a231bee6dccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:27.349328 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917de3e-c9e4-427f-8832-6573be931897 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:27.349667 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917de3e-c9e4-427f-8832-6573be931897 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:27.349894 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917de3e-c9e4-427f-8832-6573be931897 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:27.358665 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917de3e-c9e4-427f-8832-6573be931897 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:27.360303 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917de3e-c9e4-427f-8832-6573be931897 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:27.369409 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1455/2900] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Aug 2 09:10:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:34.091335 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c8dad-006a-4f37-aa29-4455f1668d2e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:34.093388 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2c2c8dad-006a-4f37-aa29-4455f1668d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:34.161000 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c8dad-006a-4f37-aa29-4455f1668d2e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:34.166060 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:34.166701 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:34.166984 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:34.167262 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] PATH_INFO: `/v3/users/3639081f2d814af4bd963399a7a63312` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:34.168449 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3639081f2d814af4bd963399a7a63312)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:34.170366 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:34.219510 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3639081f2d814af4bd963399a7a63312'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.220271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3639081f2d814af4bd963399a7a63312'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.232552 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3639081f2d814af4bd963399a7a63312'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.239903 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3639081f2d814af4bd963399a7a63312'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.247472 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3639081f2d814af4bd963399a7a63312'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.253332 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1446/2901] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:10:34 2022] DELETE /identity/v3/users/3639081f2d814af4bd963399a7a63312 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:34.426536 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917de3e-c9e4-427f-8832-6573be931897 service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:34.438247 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917de3e-c9e4-427f-8832-6573be931897 service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:34.499668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:34.500460 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:34.500810 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:34.501150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] PATH_INFO: `/v3/projects/4e302e615c17471fa0c5638c2bc08b8c` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:34.502767 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e302e615c17471fa0c5638c2bc08b8c)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:34.505052 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:34.551682 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e302e615c17471fa0c5638c2bc08b8c', 'request_id': 'req-a184247c-4588-4f27-98a7-e55cab1dede0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.557434 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e302e615c17471fa0c5638c2bc08b8c', 'request_id': 'req-a184247c-4588-4f27-98a7-e55cab1dede0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.564918 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e302e615c17471fa0c5638c2bc08b8c', 'request_id': 'req-a184247c-4588-4f27-98a7-e55cab1dede0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.576469 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] The token cache is being invalidate because project 4e302e615c17471fa0c5638c2bc08b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:10:34.576768 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.577406 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.578901 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1456/2902] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:10:34 2022] DELETE /identity/v3/projects/4e302e615c17471fa0c5638c2bc08b8c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:34.582963 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:34.584393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:34.598383 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff5cea-7538-4bc5-8252-3fa219c4fc9d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:34.618752 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:34.658322 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:34.658628 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:34.658908 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:34.659271 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] PATH_INFO: `/v3/users/4fd9dd03771f4299a005f58c45d78bfe` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:34.660369 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd9dd03771f4299a005f58c45d78bfe)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:34.662300 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:34.708461 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd9dd03771f4299a005f58c45d78bfe'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.709129 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd9dd03771f4299a005f58c45d78bfe'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.722205 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd9dd03771f4299a005f58c45d78bfe'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.729777 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd9dd03771f4299a005f58c45d78bfe'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.736983 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd9dd03771f4299a005f58c45d78bfe'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:34.742868 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1447/2903] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:10:34 2022] DELETE /identity/v3/users/4fd9dd03771f4299a005f58c45d78bfe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:34.920134 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:34.921568 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:34.934908 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184247c-4588-4f27-98a7-e55cab1dede0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:34.953564 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:34.996373 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565c165-f867-4fc9-9932-e7ad9af4ec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:34.997020 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565c165-f867-4fc9-9932-e7ad9af4ec72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:34.998150 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565c165-f867-4fc9-9932-e7ad9af4ec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:34.998438 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565c165-f867-4fc9-9932-e7ad9af4ec72 admin admin] PATH_INFO: `/v3/projects/1f3e9e056d8f442392b7943dee8e5855` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:34.999601 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565c165-f867-4fc9-9932-e7ad9af4ec72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f3e9e056d8f442392b7943dee8e5855)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:35.001668 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565c165-f867-4fc9-9932-e7ad9af4ec72 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:35.048220 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2565c165-f867-4fc9-9932-e7ad9af4ec72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f3e9e056d8f442392b7943dee8e5855', 'request_id': 'req-2565c165-f867-4fc9-9932-e7ad9af4ec72'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:35.053698 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2565c165-f867-4fc9-9932-e7ad9af4ec72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f3e9e056d8f442392b7943dee8e5855', 'request_id': 'req-2565c165-f867-4fc9-9932-e7ad9af4ec72'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:35.060760 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2565c165-f867-4fc9-9932-e7ad9af4ec72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f3e9e056d8f442392b7943dee8e5855', 'request_id': 'req-2565c165-f867-4fc9-9932-e7ad9af4ec72'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:35.072448 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2565c165-f867-4fc9-9932-e7ad9af4ec72 admin admin] The token cache is being invalidate because project 1f3e9e056d8f442392b7943dee8e5855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:10:35.072733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2565c165-f867-4fc9-9932-e7ad9af4ec72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:35.073377 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2565c165-f867-4fc9-9932-e7ad9af4ec72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:35.074856 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1457/2904] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:10:34 2022] DELETE /identity/v3/projects/1f3e9e056d8f442392b7943dee8e5855 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:44.739352 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:45.069454 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:38.598506 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:38.599974 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:38.662592 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ca50f-22dd-4f8b-be14-24b51211a855 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:38.714490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eebb2d-7f42-46be-8576-b4833722b6e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2c5059aacc149deb6cdb86d3341e78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:38.715115 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eebb2d-7f42-46be-8576-b4833722b6e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:38.715394 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eebb2d-7f42-46be-8576-b4833722b6e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:38.715666 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eebb2d-7f42-46be-8576-b4833722b6e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:38.717465 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c9eebb2d-7f42-46be-8576-b4833722b6e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:38.777530 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eebb2d-7f42-46be-8576-b4833722b6e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:38.778967 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eebb2d-7f42-46be-8576-b4833722b6e3 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:38.788652 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1448/2905] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:48.784470 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=68 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:49.860480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1089d-b814-4d7e-8b39-c62fd0abe022 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:49.860480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1089d-b814-4d7e-8b39-c62fd0abe022 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:49.860480 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1089d-b814-4d7e-8b39-c62fd0abe022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:49.881057 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e5f1089d-b814-4d7e-8b39-c62fd0abe022 None None] MFA Rules not processed for user `e469194b140942bf929001c7e12a0933`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:49.882366 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e5f1089d-b814-4d7e-8b39-c62fd0abe022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:49.889777 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1458/2906] 10.222.0.17 () {58 vars in 958 bytes} [Tue Aug 2 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:11:52.859512 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eebb2d-7f42-46be-8576-b4833722b6e3 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:52.861018 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c9eebb2d-7f42-46be-8576-b4833722b6e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:52.935737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eebb2d-7f42-46be-8576-b4833722b6e3 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:52.941885 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617a461-0a54-4801-82d2-cf4db628da26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:52.942527 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617a461-0a54-4801-82d2-cf4db628da26 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:52.943062 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617a461-0a54-4801-82d2-cf4db628da26 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:52.943339 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617a461-0a54-4801-82d2-cf4db628da26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:52.945230 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2617a461-0a54-4801-82d2-cf4db628da26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:52.958729 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617a461-0a54-4801-82d2-cf4db628da26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:52.960393 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617a461-0a54-4801-82d2-cf4db628da26 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:52.975244 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1449/2907] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:59.875551 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:02.966870 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=32 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:11.178722 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1089d-b814-4d7e-8b39-c62fd0abe022 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:11.181254 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e5f1089d-b814-4d7e-8b39-c62fd0abe022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:11.379291 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1089d-b814-4d7e-8b39-c62fd0abe022 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:11.388751 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336055-30ca-41a3-9bba-7f448fb8c56b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1de289ba7ae4140a421127b8f18901f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:11.390255 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336055-30ca-41a3-9bba-7f448fb8c56b service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:11.390697 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336055-30ca-41a3-9bba-7f448fb8c56b service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:11.391031 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336055-30ca-41a3-9bba-7f448fb8c56b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:11.392967 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-24336055-30ca-41a3-9bba-7f448fb8c56b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:11.415147 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24336055-30ca-41a3-9bba-7f448fb8c56b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:11.418223 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24336055-30ca-41a3-9bba-7f448fb8c56b service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:11.436889 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1459/2908] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:12:15.195345 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617a461-0a54-4801-82d2-cf4db628da26 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:15.197736 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2617a461-0a54-4801-82d2-cf4db628da26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:15.337766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617a461-0a54-4801-82d2-cf4db628da26 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:15.341766 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80b51f-a888-483f-9d0e-d7aa4448ccfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:15.342939 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80b51f-a888-483f-9d0e-d7aa4448ccfb service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:15.343225 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80b51f-a888-483f-9d0e-d7aa4448ccfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:15.343504 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80b51f-a888-483f-9d0e-d7aa4448ccfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:15.345511 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5b80b51f-a888-483f-9d0e-d7aa4448ccfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:15.432414 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80b51f-a888-483f-9d0e-d7aa4448ccfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:15.435187 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80b51f-a888-483f-9d0e-d7aa4448ccfb service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:15.455411 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1450/2909] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:21.428501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=56 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:25.446390 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=72 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:49.401176 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336055-30ca-41a3-9bba-7f448fb8c56b service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:49.428980 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336055-30ca-41a3-9bba-7f448fb8c56b service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:49.434765 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c0077-ffe1-45c0-8179-8f93743d68f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:49.435476 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c0077-ffe1-45c0-8179-8f93743d68f9 service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:49.435798 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c0077-ffe1-45c0-8179-8f93743d68f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:49.436218 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c0077-ffe1-45c0-8179-8f93743d68f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:49.439567 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1c1c0077-ffe1-45c0-8179-8f93743d68f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:49.468848 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c0077-ffe1-45c0-8179-8f93743d68f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:49.470582 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c0077-ffe1-45c0-8179-8f93743d68f9 service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:49.482826 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1460/2910] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:59.478079 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=15 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:21.865867 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80b51f-a888-483f-9d0e-d7aa4448ccfb service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:21.876192 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5b80b51f-a888-483f-9d0e-d7aa4448ccfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:21.893257 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80b51f-a888-483f-9d0e-d7aa4448ccfb service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:21.902674 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f7982-d480-4918-9403-c2ba76fd7629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:21.903585 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f7982-d480-4918-9403-c2ba76fd7629 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:21.904069 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f7982-d480-4918-9403-c2ba76fd7629 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:21.904616 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f7982-d480-4918-9403-c2ba76fd7629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:21.907637 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f85f7982-d480-4918-9403-c2ba76fd7629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:21.929200 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f7982-d480-4918-9403-c2ba76fd7629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:21.930723 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f7982-d480-4918-9403-c2ba76fd7629 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:21.957715 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1451/2911] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:14:22.035995 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c0077-ffe1-45c0-8179-8f93743d68f9 service placement] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:22.048013 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c0077-ffe1-45c0-8179-8f93743d68f9 service placement] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:22.052696 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a30301-fbde-4778-9225-0a548cc3e231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:22.053337 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a30301-fbde-4778-9225-0a548cc3e231 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:22.053619 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a30301-fbde-4778-9225-0a548cc3e231 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:22.053917 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a30301-fbde-4778-9225-0a548cc3e231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:22.056066 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-81a30301-fbde-4778-9225-0a548cc3e231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:22.102141 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a30301-fbde-4778-9225-0a548cc3e231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:22.104729 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a30301-fbde-4778-9225-0a548cc3e231 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:22.146562 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1461/2912] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:23.407214 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f7982-d480-4918-9403-c2ba76fd7629 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:23.420587 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f7982-d480-4918-9403-c2ba76fd7629 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:23.425737 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715feea-d128-4a6e-ac24-e7e5e972003f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:23.426490 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715feea-d128-4a6e-ac24-e7e5e972003f service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:23.426887 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715feea-d128-4a6e-ac24-e7e5e972003f service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:23.427240 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715feea-d128-4a6e-ac24-e7e5e972003f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:23.430072 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8715feea-d128-4a6e-ac24-e7e5e972003f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:23.450217 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715feea-d128-4a6e-ac24-e7e5e972003f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:23.452059 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715feea-d128-4a6e-ac24-e7e5e972003f service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:23.466433 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1452/2913] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:32.143948 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=18 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:33.459016 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=12 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:36.613905 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a30301-fbde-4778-9225-0a548cc3e231 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:36.624323 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a30301-fbde-4778-9225-0a548cc3e231 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:36.628907 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d9a9e-501e-4eaf-b94d-8fd40f1245ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9162dcfb8d542679c7217fae8f5c185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:36.629859 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d9a9e-501e-4eaf-b94d-8fd40f1245ac service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:36.630327 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d9a9e-501e-4eaf-b94d-8fd40f1245ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:36.630775 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d9a9e-501e-4eaf-b94d-8fd40f1245ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:36.632934 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-979d9a9e-501e-4eaf-b94d-8fd40f1245ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:36.752139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d9a9e-501e-4eaf-b94d-8fd40f1245ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:36.753711 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d9a9e-501e-4eaf-b94d-8fd40f1245ac service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:36.778032 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1462/2914] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:40.658409 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715feea-d128-4a6e-ac24-e7e5e972003f service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:40.672509 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715feea-d128-4a6e-ac24-e7e5e972003f service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:40.678329 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25206d20-d04d-40c4-8002-3ad402dea71f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:40.678972 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25206d20-d04d-40c4-8002-3ad402dea71f service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:40.679258 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25206d20-d04d-40c4-8002-3ad402dea71f service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:40.679563 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25206d20-d04d-40c4-8002-3ad402dea71f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:40.683121 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-25206d20-d04d-40c4-8002-3ad402dea71f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:40.700046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25206d20-d04d-40c4-8002-3ad402dea71f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:40.701722 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25206d20-d04d-40c4-8002-3ad402dea71f service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:40.716371 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1453/2915] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:44.409087 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d9a9e-501e-4eaf-b94d-8fd40f1245ac service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:44.454821 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d9a9e-501e-4eaf-b94d-8fd40f1245ac service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:44.461137 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7372a-688f-4299-a652-a575f925170c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:44.462269 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7372a-688f-4299-a652-a575f925170c service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:44.463139 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7372a-688f-4299-a652-a575f925170c service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:44.463468 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7372a-688f-4299-a652-a575f925170c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:44.466673 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-05f7372a-688f-4299-a652-a575f925170c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:44.488105 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7372a-688f-4299-a652-a575f925170c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:44.491594 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7372a-688f-4299-a652-a575f925170c service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:44.503731 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25206d20-d04d-40c4-8002-3ad402dea71f service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:44.505565 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-25206d20-d04d-40c4-8002-3ad402dea71f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:44.508009 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1463/2916] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:44.528999 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25206d20-d04d-40c4-8002-3ad402dea71f service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:44.536046 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:44.536833 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:44.537180 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:44.537517 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] PATH_INFO: `/v3/users/e469194b140942bf929001c7e12a0933` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:44.538899 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e469194b140942bf929001c7e12a0933)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:44.541704 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:44.628681 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e469194b140942bf929001c7e12a0933'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:44.629754 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e469194b140942bf929001c7e12a0933'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:44.649699 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e469194b140942bf929001c7e12a0933'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:44.660080 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e469194b140942bf929001c7e12a0933'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:44.674823 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e469194b140942bf929001c7e12a0933'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:44.686422 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1454/2917] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:14:44 2022] DELETE /identity/v3/users/e469194b140942bf929001c7e12a0933 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:14:44.962072 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7372a-688f-4299-a652-a575f925170c service placement] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:44.980959 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7372a-688f-4299-a652-a575f925170c service placement] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:45.091049 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:45.092140 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:45.092645 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:45.093151 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] PATH_INFO: `/v3/projects/4b7960c66a61441faa18ef4ba42f5e5e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:45.114589 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7960c66a61441faa18ef4ba42f5e5e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:45.117652 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:45.186835 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:45.190804 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7960c66a61441faa18ef4ba42f5e5e', 'request_id': 'req-106b5657-57bd-4862-9b7e-db5f546ad27e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.201626 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7960c66a61441faa18ef4ba42f5e5e', 'request_id': 'req-106b5657-57bd-4862-9b7e-db5f546ad27e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.215750 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7960c66a61441faa18ef4ba42f5e5e', 'request_id': 'req-106b5657-57bd-4862-9b7e-db5f546ad27e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.236862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] The token cache is being invalidate because project 4b7960c66a61441faa18ef4ba42f5e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:14:45.237313 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.238132 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.240283 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1464/2918] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:14:44 2022] DELETE /identity/v3/projects/4b7960c66a61441faa18ef4ba42f5e5e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:14:45.245357 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:45.247158 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:45.264601 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a6321-fbb3-4356-bea9-0e06d066930d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:45.364075 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:45.365171 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:45.365639 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:45.366117 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] PATH_INFO: `/v3/users/47c6c60dc66c477f896403c4d9ed11ba` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:45.368263 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47c6c60dc66c477f896403c4d9ed11ba)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:45.372029 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:45.443825 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47c6c60dc66c477f896403c4d9ed11ba'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.444635 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47c6c60dc66c477f896403c4d9ed11ba'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.458385 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:45.461852 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47c6c60dc66c477f896403c4d9ed11ba'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.474386 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47c6c60dc66c477f896403c4d9ed11ba'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.484446 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47c6c60dc66c477f896403c4d9ed11ba'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.492197 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1455/2919] 10.222.0.17 () {58 vars in 1224 bytes} [Tue Aug 2 09:14:45 2022] DELETE /identity/v3/users/47c6c60dc66c477f896403c4d9ed11ba => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:14:45.712501 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:45.715630 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:45.740485 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b5657-57bd-4862-9b7e-db5f546ad27e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:45.849231 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab66728-be5e-47b3-8eb3-6f9273aa0479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c37b28fc7d64a6c86abaeae5a87cc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '373878c44f1d4227ba8ac54103602eff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:45.850340 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab66728-be5e-47b3-8eb3-6f9273aa0479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:45.850862 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab66728-be5e-47b3-8eb3-6f9273aa0479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:45.851346 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab66728-be5e-47b3-8eb3-6f9273aa0479 admin admin] PATH_INFO: `/v3/projects/a3f510dd776842519420769b4c784fe4` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:45.854025 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab66728-be5e-47b3-8eb3-6f9273aa0479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f510dd776842519420769b4c784fe4)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:45.857643 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab66728-be5e-47b3-8eb3-6f9273aa0479 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:45.944230 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1ab66728-be5e-47b3-8eb3-6f9273aa0479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f510dd776842519420769b4c784fe4', 'request_id': 'req-1ab66728-be5e-47b3-8eb3-6f9273aa0479'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.953655 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1ab66728-be5e-47b3-8eb3-6f9273aa0479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f510dd776842519420769b4c784fe4', 'request_id': 'req-1ab66728-be5e-47b3-8eb3-6f9273aa0479'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.963981 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1ab66728-be5e-47b3-8eb3-6f9273aa0479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f510dd776842519420769b4c784fe4', 'request_id': 'req-1ab66728-be5e-47b3-8eb3-6f9273aa0479'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.984430 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1ab66728-be5e-47b3-8eb3-6f9273aa0479 admin admin] The token cache is being invalidate because project a3f510dd776842519420769b4c784fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:14:45.984926 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1ab66728-be5e-47b3-8eb3-6f9273aa0479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.986077 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1ab66728-be5e-47b3-8eb3-6f9273aa0479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:45.989028 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1465/2920] 10.222.0.17 () {58 vars in 1233 bytes} [Tue Aug 2 09:14:45 2022] DELETE /identity/v3/projects/a3f510dd776842519420769b4c784fe4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:14:55.487739 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=2,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:55.977733 dv-cinder-787296-14-iscsi devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=11,keystone:SELECT=58,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:51.542182 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:51.543735 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:51.613438 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8466b5-0e96-4b9f-bb3d-9d2dd41d548a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:51.675024 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe2ce6-0040-4601-af68-1eed00d5c875 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9f2dc3c1c442b4b1b09964ff7c000b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e1649f32d3d494682dc06e05ae34f3d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:51.676374 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2ce6-0040-4601-af68-1eed00d5c875 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:51.676698 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2ce6-0040-4601-af68-1eed00d5c875 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:51.676986 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2ce6-0040-4601-af68-1eed00d5c875 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:51.678799 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5afe2ce6-0040-4601-af68-1eed00d5c875 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:51.690547 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe2ce6-0040-4601-af68-1eed00d5c875 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:51.692211 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe2ce6-0040-4601-af68-1eed00d5c875 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:51.702189 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1456/2921] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:01.697907 dv-cinder-787296-14-iscsi devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=58 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}